Re: Striping a live file system RAID 10 help
On Wednesday 29 July 2009 15:54:42 Richard Fairbanks wrote: OK, so this is what I want to do. I have 4 big fast drives that I want to run in RAID 10 (1+0). So, I'll need to mirror two sets of two disks, then stripe those two mirrors. So, how do I do this if I want this striped set of mirrors to be my entire fs? I can create both mirrors and have the entire fs on one of the mirrors (*mirror0*), but then I need to stripe it with the other mirrors (*mirror1*), and trying to create a stripe (*stripe*) from that a set of mirrors in which one of the mirrors contains the live file system does not work, obviously. I was thinking, very generally, of creating the fstab file that I'll need to point to the stripe instead of ad4 for example, rsyncing everything to a disk on a diffferent server, using a live CD to create the stripe, then rsyncing back to the stripe. I don't know if this will work, and haven't even come to a conclusion of the particulars needed. When changing disk configurations on the same server I generally do everything by hand, then use dump+restore (rather than rsync) to move (UFS) filesystems around. (ZFS has zfs send/recv). Of course, if there is a way to create the striped set off mirrors before installation then installing onto that stripe, that'd be perfect. I don't know if that can be done. I'm sure someone has configured a RAID 10 standalone system before. (Oh, I'm using 7.2). I'm just stuck at this point! You need to consider where/how you are going to boot the system. It's straightforward to boot from a gmirror'ed UFS filesystem (the BIOS just uses one disk and thinks everything is normal), but you can't do the same from a stripe. You will either need a separate disk/device for your / or /boot partition or you will need to use slices/partitions on your disks. I frequently have the root filesystem on a small gmirror (partitions on 2 disks) then use the equivalent extra space on the remaining disk(s) for swap. Youi should be able to do this pre-install from the Fixit shell. Boot to the live CD, enter the shell, kldload geom_mirror and geom_stripe, create the mirrors, create the stripe, exit the shell, start the install, and tell sysinstall to use the device node under /dev/stripe for your filesystem. Alternatively you could just do a regular install to one of the disks and do everything post-install. In this case you'd still create two mirrors but one of them would only contain a single disk at first. Then create your stripe, dump/restore your files, update fstab (in both locations if needed), reboot using the stripe, then add the original system disk into its mirror. If you provide more details of how you want your setup to look I can give you a specific walkthrough if needed. JN ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Striping a live file system RAID 10 help
2009/7/30 John Nielsen li...@jnielsen.net On Wednesday 29 July 2009 15:54:42 Richard Fairbanks wrote: OK, so this is what I want to do. I have 4 big fast drives that I want to run in RAID 10 (1+0). So, I'll need to mirror two sets of two disks, then stripe those two mirrors. So, how do I do this if I want this striped set of mirrors to be my entire fs? I can create both mirrors and have the entire fs on one of the mirrors (*mirror0*), but then I need to stripe it with the other mirrors (*mirror1*), and trying to create a stripe (*stripe*) from that a set of mirrors in which one of the mirrors contains the live file system does not work, obviously. I was thinking, very generally, of creating the fstab file that I'll need to point to the stripe instead of ad4 for example, rsyncing everything to a disk on a diffferent server, using a live CD to create the stripe, then rsyncing back to the stripe. I don't know if this will work, and haven't even come to a conclusion of the particulars needed. When changing disk configurations on the same server I generally do everything by hand, then use dump+restore (rather than rsync) to move (UFS) filesystems around. (ZFS has zfs send/recv). Of course, if there is a way to create the striped set off mirrors before installation then installing onto that stripe, that'd be perfect. I don't know if that can be done. I'm sure someone has configured a RAID 10 standalone system before. (Oh, I'm using 7.2). I'm just stuck at this point! You need to consider where/how you are going to boot the system. It's straightforward to boot from a gmirror'ed UFS filesystem (the BIOS just uses one disk and thinks everything is normal), but you can't do the same from a stripe. You will either need a separate disk/device for your / or /boot partition or you will need to use slices/partitions on your disks. I frequently have the root filesystem on a small gmirror (partitions on 2 disks) then use the equivalent extra space on the remaining disk(s) for swap. Youi should be able to do this pre-install from the Fixit shell. Boot to the live CD, enter the shell, kldload geom_mirror and geom_stripe, create the mirrors, create the stripe, exit the shell, start the install, and tell sysinstall to use the device node under /dev/stripe for your filesystem. Alternatively you could just do a regular install to one of the disks and do everything post-install. In this case you'd still create two mirrors but one of them would only contain a single disk at first. Then create your stripe, dump/restore your files, update fstab (in both locations if needed), reboot using the stripe, then add the original system disk into its mirror. If you provide more details of how you want your setup to look I can give you a specific walkthrough if needed. JN ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org one thing i find invaluable whan doing fancy disk installs is my bootable use stick with a full bsd installation on it. Much nicer than fixit. Also if the kit is in the data center it means I can ssh into the box rather than having to sit in there I used the howto below to set up the stick http://typo.submonkey.net/articles/2006/04/13/installing-freebsd-on-usb-stick-episode-2 ive also used this to do zfs boot zfsboot install http://wiki.freebsd.org/ZFSOnRootWithZFSboot#installFreeBSD If you dont want to do a zfs one and use gstripe on top of gmirror but dont want to partition up all the drives you could of course leave the use stick in permanently, and have the root fs on there. Just make sure fs that take lots of writes dont reside on the stick ie /tmp /var Also when you create your file systems make sure you label them with newfs's -L flag. It can make the devices you need to mount slightly easier to use. Also consider the use of gjournal as it could save you a lot of time with not having to fsck large file systems ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Striping a live file system RAID 10 help
OK, so this is what I want to do. I have 4 big fast drives that I want to run in RAID 10 (1+0). So, I'll need to mirror two sets of two disks, then stripe those two mirrors. So, how do I do this if I want this striped set of mirrors to be my entire fs? I can create both mirrors and have the entire fs on one of the mirrors (*mirror0*), but then I need to stripe it with the other mirrors (*mirror1*), and trying to create a stripe (*stripe*) from that a set of mirrors in which one of the mirrors contains the live file system does not work, obviously. I was thinking, very generally, of creating the fstab file that I'll need to point to the stripe instead of ad4 for example, rsyncing everything to a disk on a diffferent server, using a live CD to create the stripe, then rsyncing back to the stripe. I don't know if this will work, and haven't even come to a conclusion of the particulars needed. Of course, if there is a way to create the striped set off mirrors before installation then installing onto that stripe, that'd be perfect. I don't know if that can be done. I'm sure someone has configured a RAID 10 standalone system before. (Oh, I'm using 7.2). I'm just stuck at this point! Thanks for any and all help! ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
