Projects
Syndicate This Blog
Photography
Wednesday, August 9. 2006
Data Scrub with Linux RAID or Die
It is absolutely critical to use data scrubbing with Linux software RAID. If you fail to do so, when one of the drives fail and the new one is put in place to resync with, the chance of losing all data is very high. When Linux resyncs a RAID array, it steps through each and every block on the disk(s) it is syncing from. If there are any bad blocks on the 'good' drives data scrubbing hasn't found (or data scrubbing isn't being used), that drive will also be marked as unusable. This renders your array useless unless an array is in use that can recover from multiple drive failures at the same time, or you have quite a few days to spend on manual recovery.See this information on how to do data scrubbing with Linux RAID for another description and instructions on how to do this.
More information on Linux RAID issues and its risks can be found at the following URLs:
http://www.nber.org/sys-admin/linux-nas-raid.html (see the "Why do drive failures come in pairs?" section)
http://linas.org/linux/peeves.html (see the The IDE/fsck/RAID Tirade)
This is unlikely to be fixed (current efforts seem to be in EVMS, a horrifically complicated solution so complex they can't even answer their own FAQ items). The best bet seems to be to pray for ZFS to be completed for Linux soon, which completely rethinks the problem without adding yet another complicated layer and vastly simplifies storage management.
Trackbacks
Trackback specific URI for this entry
No Trackbacks
Comments
Display comments as
(Linear | Threaded)
When I first saw this comment in my queue I almost deleted it thinking it was spam, the link being from Anonymous and with no description. It's actually an informative site with some valid points on issues with RAID.
Here is a more friendly link if you want to check it out:
Battle Against Any Raid Five/Four/Free
http://www.baarf.com/
Here is a more friendly link if you want to check it out:
Battle Against Any Raid Five/Four/Free
http://www.baarf.com/
was told about this after meeting up with some friends at LRUG, so got to put this in place quickly.
really glad he mentioned it,
John.
really glad he mentioned it,
John.
Information
Quicksearch
Lexiyntax @ Twitter
@CPOSC An iPad? A closed device that disallows open source as a prize for an open source conference? Very ironic. Friday, September 3 2010
Garden Salsa flavor Sun Chips are possibly my favorite flavor. More testing/tasting required. Monday, August 30 2010
Looking for pbcopy and pbpaste from OS X on Linux? Check out 'xsel'; it automatically does the right operation without needing two commands. Thursday, August 26 2010
Watched Moon http://en.wikipedia.org/wiki/Moon_(film) tonight. Predictable but fun movie. Thursday, August 26 2010
RT @CPOSC: Central PA Open Source Conference 10/16 Harrisburg, PA. 21 speakers, 3 tracks. Tickets avail now! http://cposc.org Wednesday, August 25 2010
Eating breakfast on the road, I really miss real maple syrup. I should carry a bottle with me hidden in my coat, sneaking it onto my food. Saturday, August 14 2010
Addicted to mutt (http://mutt.org)? Use Google Contacts? Check out http://code.google.com/p/goobook/ Thursday, August 12 2010
Hershey's Ice Cream 'Extreme Chocolate' is excellent. Rich dark chocolate flavor, not too sweet, and almost black in color. Tuesday, August 10 2010
Here I am at the Debconf baseball game http://www.flickr.com/photos/aigarius/4863382564/in/set-72157624469399089/ Monday, August 9 2010
Aigarius shot me at Debconf http://www.flickr.com/photos/aigarius/4869036038/in/set-72157624469399089/ Monday, August 9 2010
Garden Salsa flavor Sun Chips are possibly my favorite flavor. More testing/tasting required. Monday, August 30 2010
Looking for pbcopy and pbpaste from OS X on Linux? Check out 'xsel'; it automatically does the right operation without needing two commands. Thursday, August 26 2010
Watched Moon http://en.wikipedia.org/wiki/Moon_(film) tonight. Predictable but fun movie. Thursday, August 26 2010
RT @CPOSC: Central PA Open Source Conference 10/16 Harrisburg, PA. 21 speakers, 3 tracks. Tickets avail now! http://cposc.org Wednesday, August 25 2010
Eating breakfast on the road, I really miss real maple syrup. I should carry a bottle with me hidden in my coat, sneaking it onto my food. Saturday, August 14 2010
Addicted to mutt (http://mutt.org)? Use Google Contacts? Check out http://code.google.com/p/goobook/ Thursday, August 12 2010
Hershey's Ice Cream 'Extreme Chocolate' is excellent. Rich dark chocolate flavor, not too sweet, and almost black in color. Tuesday, August 10 2010
Here I am at the Debconf baseball game http://www.flickr.com/photos/aigarius/4863382564/in/set-72157624469399089/ Monday, August 9 2010
Aigarius shot me at Debconf http://www.flickr.com/photos/aigarius/4869036038/in/set-72157624469399089/ Monday, August 9 2010