Linux Software RAID and SATA Hot Swap

I know there are a million pages online about Linux Software RAID, but I wanted to record my own experience with it.

My home server has a lot of storage:

• a 160GB RAID1 array, for my boot volume, on one of the motherboard's RAID controllers
• a 500GB RAID1 array, for backups, again on a RAID controller
• a 2TB RAID1 array, for home directories and virtual machines, on a RAID controller
• a 3TB RAID1 array, for other stuff, using software RAID.
• a single 3TB drive, for daily backups of my 3TB array

My motherboard is a number of years old now, and the onboard controllers could not do RAID for 3TB drives, as they only recognized them as 873GB. So I left these as standard drives, and set them up in software RAID.

My goal for this endeavor was to convert my 500GB and 2TB over to software RAID. The reasons being:

• Actually getting notifications regarding any issues
• Control over rebuilds, being able to add/remove disks
• Not being tied to a specific RAID controller with a specific firmware version. If the motherboard were to die, I can easily move the drives.
• No reboots required to work with the drives
• Linux can do SATA hot swap, so I don't need to power down to swap a disk

The minor performance hit isn't an issue, so the pros far outweigh the cons.

Fiasco #1: The 500GB Array

I decided to do the 500GB array first, since it was small and quick to work with.

I moved the data off the drive, rebooted the server to get into the BIOS, deleted the array, then booted the server back up. Then I:

• partitioned the drives using fdisk (not showing this step, you'll see why...)
• created the RAID1 array and waited for it to sync
• formatted it
• mounted the drive
• put all my files back on

Then I rebooted the server, and what do I get? No operating system found