New Build - RAID Question..??

[Wirezfree]

Well again out of curiosity... I created a Linux Lite VM in Virtualbox,
and manually created "4" vdi's of 8GB each used 7GB for each of the RAID partitions.


I followed these instructions "Install Ubuntu with Software RAID 10" so this gives performance & redundancy.
((But I now have a LL Update problem, noted at the end))


In the instructions, 2 changes:
- Step 3, needed to do apt-get update done first.
also at
- Step 3, changed makefs.xfs to makefs.ext4
xfs was not available, without installing it, did not know what this would do to LL, so used ext4


End result was this, 28GB of disksapce gave me a 14GB RAID Array




Not sure how valid disk tests are in Virtualbox...
But here is 1 on RAID & 1 on REGULAR install


Disk Test on RAID install:
dave@ll-vm-test:~$ sudo hdparm -t /dev/md0
[sudo] password for dave:
/dev/md0:
 Timing buffered disk reads: 242 MB in  3.02 seconds =  80.10 MB/sec


Disk Test on REGULAR install:
dave@vm-ll22:~$ sudo hdparm -t /dev/sda
[sudo] password for dave:
/dev/sda:
 Timing buffered disk reads: 226 MB in  3.01 seconds =  74.96 MB/sec


"Problem"
After doing this, the LL Updates are now failing, "Couldn't fetch the package cache list"
So doing the RAID Software install broke the updates process by the look of it...

Code: [Select]


dave@ll-vm-test:~$ sudo apt-get update
[sudo] password for dave:
Hit http://archive.canonical.com trusty InRelease
Ign http://dl.google.com trusty InRelease                                     
Ign http://archive.ubuntu.com trusty InRelease                                 
Hit http://ppa.launchpad.net trusty InRelease                                 
Hit http://ppa.launchpad.net trusty InRelease                                 
Hit http://archive.ubuntu.com trusty-updates InRelease                         
Hit http://archive.canonical.com trusty/partner amd64 Packages                 
Ign http://dl.google.com trusty InRelease                                     
Ign http://ppa.launchpad.net trusty InRelease                                 
Hit http://archive.ubuntu.com trusty-backports InRelease                       
Hit http://archive.canonical.com trusty/partner i386 Packages                 
Ign http://ppa.launchpad.net trusty InRelease                                 
Ign http://dl.google.com trusty Release.gpg                                   
Hit http://archive.ubuntu.com trusty-security InRelease                       
Ign http://ppa.launchpad.net trusty InRelease                                 
Hit http://ppa.launchpad.net trusty/main amd64 Packages                       
Ign http://dl.google.com trusty Release.gpg                                   
Hit http://archive.ubuntu.com trusty Release.gpg                               
Hit http://ppa.launchpad.net trusty/main i386 Packages                         
Hit http://archive.ubuntu.com trusty-updates/main Sources                     
Ign http://archive.canonical.com trusty/partner Translation-en                 
Hit http://ppa.launchpad.net trusty/main Translation-en                       
Hit http://ppa.launchpad.net trusty/main amd64 Packages                       
Hit http://archive.ubuntu.com trusty-updates/restricted Sources               
Hit http://ppa.launchpad.net trusty/main i386 Packages                         
Ign http://repo.linuxliteos.com trusty InRelease                               
Ign http://dl.google.com trusty Release                                       
Hit http://archive.ubuntu.com trusty-updates/universe Sources         
Hit http://ppa.launchpad.net trusty/main Translation-en                       
Hit http://ppa.launchpad.net trusty Release.gpg                               
Hit http://archive.ubuntu.com trusty-updates/multiverse Sources               
Ign http://dl.google.com trusty Release                                       
Hit http://ppa.launchpad.net trusty Release.gpg                               
Hit http://archive.ubuntu.com trusty-updates/main amd64 Packages     
Hit http://ppa.launchpad.net trusty Release.gpg                               
Hit http://archive.ubuntu.com trusty-updates/restricted amd64 Packages         
Hit http://ppa.launchpad.net trusty Release                                   
Ign http://repo.linuxliteos.com trusty Release.gpg                             
Hit http://ppa.launchpad.net trusty Release                                   
Hit http://archive.ubuntu.com trusty-updates/universe amd64 Packages           
Hit http://ppa.launchpad.net trusty Release                                   
Hit http://archive.ubuntu.com trusty-updates/multiverse amd64 Packages         
Hit http://ppa.launchpad.net trusty/main amd64 Packages                       
Hit http://archive.ubuntu.com trusty-updates/main i386 Packages               
Hit http://archive.ubuntu.com trusty-updates/restricted i386 Packages         
Ign http://repo.linuxliteos.com trusty Release                                 
Hit http://ppa.launchpad.net trusty/main i386 Packages                         
Hit http://archive.ubuntu.com trusty-updates/universe i386 Packages           
Hit http://ppa.launchpad.net trusty/main Translation-en                       
Hit http://archive.ubuntu.com trusty-updates/multiverse i386 Packages         
Hit http://ppa.launchpad.net trusty/main amd64 Packages                       
Hit http://ppa.launchpad.net trusty/main i386 Packages                         
Hit http://archive.ubuntu.com trusty-updates/main Translation-en               
Hit http://ppa.launchpad.net trusty/main Translation-en                       
Hit http://ppa.launchpad.net trusty/main amd64 Packages                       
Hit http://ppa.launchpad.net trusty/main i386 Packages                         
Hit http://ppa.launchpad.net trusty/main Translation-en                       
Hit http://archive.ubuntu.com trusty-updates/multiverse Translation-en         
Hit http://archive.ubuntu.com trusty-updates/restricted Translation-en         
Hit http://archive.ubuntu.com trusty-updates/universe Translation-en           
Hit http://archive.ubuntu.com trusty-backports/main Sources                   
Hit http://archive.ubuntu.com trusty-backports/restricted Sources             
Hit http://archive.ubuntu.com trusty-backports/universe Sources               
Hit http://archive.ubuntu.com trusty-backports/multiverse Sources             
Hit http://archive.ubuntu.com trusty-backports/main amd64 Packages   
Hit http://archive.ubuntu.com trusty-backports/restricted amd64 Packages
Hit http://archive.ubuntu.com trusty-backports/universe amd64 Packages
Hit http://archive.ubuntu.com trusty-backports/multiverse amd64 Packages       
Hit http://archive.ubuntu.com trusty-backports/main i386 Packages     
Hit http://archive.ubuntu.com trusty-backports/restricted i386 Packages       
Hit http://archive.ubuntu.com trusty-backports/universe i386 Packages
Hit http://archive.ubuntu.com trusty-backports/multiverse i386 Packages       
Hit http://archive.ubuntu.com trusty-backports/main Translation-en   
Hit http://archive.ubuntu.com trusty-backports/multiverse Translation-en
Hit http://archive.ubuntu.com trusty-backports/restricted Translation-en
Hit http://archive.ubuntu.com trusty-backports/universe Translation-en
Hit http://archive.ubuntu.com trusty-security/main Sources                     
Hit http://archive.ubuntu.com trusty-security/restricted Sources               
Hit http://archive.ubuntu.com trusty-security/universe Sources       
Hit http://archive.ubuntu.com trusty-security/multiverse Sources     
Hit http://archive.ubuntu.com trusty-security/main amd64 Packages     
Hit http://archive.ubuntu.com trusty-security/restricted amd64 Packages       
Hit http://archive.ubuntu.com trusty-security/universe amd64 Packages         
Hit http://archive.ubuntu.com trusty-security/multiverse amd64 Packages       
Hit http://archive.ubuntu.com trusty-security/main i386 Packages               
Hit http://archive.ubuntu.com trusty-security/restricted i386 Packages         
Hit http://archive.ubuntu.com trusty-security/universe i386 Packages           
Hit http://archive.ubuntu.com trusty-security/multiverse i386 Packages         
Hit http://archive.ubuntu.com trusty-security/main Translation-en             
Hit http://archive.ubuntu.com trusty-security/multiverse Translation-en       
Hit http://archive.ubuntu.com trusty-security/restricted Translation-en       
Hit http://archive.ubuntu.com trusty-security/universe Translation-en         
Hit http://archive.ubuntu.com trusty Release                                   
Err http://dl.google.com trusty/main amd64 Packages                   
  404  Not Found [IP: 216.58.208.78 80]
Hit http://archive.ubuntu.com trusty/main Sources                     
Hit http://archive.ubuntu.com trusty/restricted Sources                       
Err http://dl.google.com trusty/main i386 Packages                             
  404  Not Found [IP: 216.58.208.78 80]
Hit http://archive.ubuntu.com trusty/universe Sources                         
Hit http://archive.ubuntu.com trusty/multiverse Sources                       
Hit http://archive.ubuntu.com trusty/main amd64 Packages                       
Hit http://archive.ubuntu.com trusty/restricted amd64 Packages                 
Hit http://archive.ubuntu.com trusty/universe amd64 Packages                   
Ign http://dl.google.com trusty/main Translation-en_GB                         
Hit http://archive.ubuntu.com trusty/multiverse amd64 Packages                 
Hit http://archive.ubuntu.com trusty/main i386 Packages                       
Hit http://archive.ubuntu.com trusty/restricted i386 Packages                 
Ign http://dl.google.com trusty/main Translation-en                           
Hit http://archive.ubuntu.com trusty/universe i386 Packages                   
Hit http://archive.ubuntu.com trusty/multiverse i386 Packages                 
Hit http://archive.ubuntu.com trusty/main Translation-en_GB                   
Ign http://dl.google.com trusty/main Translation-en_US                         
Hit http://archive.ubuntu.com trusty/main Translation-en                       
Err http://dl.google.com trusty/main amd64 Packages                           
  404  Not Found [IP: 216.58.208.78 80]
Err http://dl.google.com trusty/main i386 Packages                             
  404  Not Found [IP: 216.58.208.78 80]
Hit http://archive.ubuntu.com trusty/multiverse Translation-en_GB
Ign http://dl.google.com trusty/main Translation-en_GB                         
Hit http://archive.ubuntu.com trusty/multiverse Translation-en                 
Ign http://dl.google.com trusty/main Translation-en                           
Hit http://archive.ubuntu.com trusty/restricted Translation-en_GB             
Ign http://dl.google.com trusty/main Translation-en_US                         
Hit http://archive.ubuntu.com trusty/restricted Translation-en                 
Hit http://archive.ubuntu.com trusty/universe Translation-en_GB     
Hit http://archive.ubuntu.com trusty/universe Translation-en
Ign http://archive.ubuntu.com trusty/main Translation-en_US       
Ign http://archive.ubuntu.com trusty/multiverse Translation-en_US   
Err http://repo.linuxliteos.com trusty/main amd64 Packages         
  404  Not Found
Ign http://archive.ubuntu.com trusty/restricted Translation-en_US   
Ign http://archive.ubuntu.com trusty/universe Translation-en_US     
Err http://repo.linuxliteos.com trusty/main i386 Packages           
  404  Not Found
Ign http://repo.linuxliteos.com trusty/main Translation-en_GB
Ign http://repo.linuxliteos.com trusty/main Translation-en
Ign http://repo.linuxliteos.com trusty/main Translation-en_US
W: Failed to fetch http://dl.google.com/linux/chrome/deb/dists/trusty/main/binary-amd64/Packages  404  Not Found [IP: 216.58.208.78 80]
W: Failed to fetch http://dl.google.com/linux/chrome/deb/dists/trusty/main/binary-i386/Packages  404  Not Found [IP: 216.58.208.78 80]
W: Failed to fetch http://dl.google.com/linux/talkplugin/deb/dists/trusty/main/binary-amd64/Packages  404  Not Found [IP: 216.58.208.78 80]
W: Failed to fetch http://dl.google.com/linux/talkplugin/deb/dists/trusty/main/binary-i386/Packages  404  Not Found [IP: 216.58.208.78 80]
W: Failed to fetch http://repo.linuxliteos.com/linuxlite/dists/trusty/main/binary-amd64/Packages  404  Not Found
W: Failed to fetch http://repo.linuxliteos.com/linuxlite/dists/trusty/main/binary-i386/Packages  404  Not Found
E: Some index files failed to download. They have been ignored, or old ones used instead.


[Wirezfree]

Well, I'm going to have a play and see if I can create a test setup in Virtualbox with multiple disks...

Having read lots on RAID, I then got side-tracked on to ZoL(ZFS on Linux) and btrfs
Now I have even more of an headache, but I did learn lots of new stuff

So from what I have read, I "just" need to do the following:
Use 4 disks in RAID 10 config with btrfs for just the OS
Use 4 disks with ZFS to create a "pool" for all my data



A simple set-up that gives high performance, redundancy and self healing data repository
Ay, that should be straightforward, "not" LOL

[firenice03]

I hear ya,  especially when you start looking at the differences, the gains and then the one offs...

But @ $220 for 2 X mSATA(120GB) and the mSATA Card,
It could prove to be an expensive experiment....

Isn't that just about everything  lol

[Wirezfree]

I have been reading some of the stuff on setting up RAID...
I got a headache, seems like luck if you get it working, very mixed results.
I think I will suggest he thinks about normal install...
To be honest I'm not sure how much improvement it will give over just using single SSD disk.??

Yes, that dual mSATA H/W raid looks interesting
But @ $220 for 2 X mSATA(120GB) and the mSATA Card,
It could prove to be an expensive experiment....

[firenice03]

Thanks Wirezfree

@firenice03,

Yes, there are risks... Certain types of RAID allow you to have disk failures,
then when you replace the disk, it re-builds the array itself based on content on remaining disks.
Normally RAID is used in Servers.
I think it was curiosity because it's unusual to have multiple mSata slots in such a small PC.



There are H/W devices that allow you to build a RAID device from 2 X mSata cards
that then fit in a single 2.5" slot, but they have mixed reviews...
Like this one 2 X mSata Adapter

That adapter is cool... Back in the day I RAID'ed (lol)  a workstation, but just for storage the OS was on a separate disk for that reason... I'm curious how well it works..
I've thought about a Windows server with drives in a RAID mostly for storage and redundancy (pictures), then debated a NAS (FreeNAS is pretty slick) but hey if LL can pull it off too ...

[Wirezfree]

@firenice03,

Yes, there are risks... Certain types of RAID allow you to have disk failures,
then when you replace the disk, it re-builds the array itself based on content on remaining disks.
Normally RAID is used in Servers.
I think it was curiosity because it's unusual to have multiple mSata slots in such a small PC.



There are H/W devices that allow you to build a RAID device from 2 X mSata cards
that then fit in a single 2.5" slot, but they have mixed reviews...
Like this one 2 X mSata Adapter

[firenice03]

If looking to RAID, I've always heard hardware RAIDs were preferred over software - now sure software has come along way and maybe the hardware doesn't support it in the set up....
If an OS level RAID for a workstation, wouldn't there be concern if the OS went corrupt??? Just thinking out loud..
Defiantly intriguing though 

[Wirezfree]

Thanks...

Found a couple of things, but they are on Mint RAID 0 & MINT RAID 1 need to read a few times... seems a little techy

[rokytnji]

Well, if looking for a software raid solution, instead of a hardware raid solution.

You get to pick the search term.

http://www.googlubuntu.com/

Good Luck.

[Wirezfree]

Yes, you can have H/W based raid controllers, but also Software based.
In Windows it was possible in Software, it was added from XP Pro on, depending on version.


EDIT..
Just found this on "Ubuntu Software Raid"
Quick read seems to indicate a "Alternate Install".. need to read more

[rokytnji]

Would that not be op to the bios more than the operating system wirezfree?

[Wirezfree]

Hi,


Probably one for the dev's..??
A friends ask me to look at putting together a "Mini i7 PC" bare bones with LL on it.
((It's new, only 4 review's, 3 are running Linux on it.))


It's got 2 X mSATA slots, and he asked if it's possible to do a "RAID 0" set-up on them,
for improved throughput, but at the loss of redundancy. So put the OS across 2 X 120GB SSD's