Re: Help booting FreeBSD with a ZFS root filesystem
On 27 January 2010 23:18, Dan Naumov dan.nau...@gmail.com wrote: I didn't want a mirror though, I wanted a stripe. I still don't understand why what I'm doing isn't working. As far as I know, having the root pool on a stripe isn't supported. OpenSolaris supports having the root pool on a simple pool and a mirror pool. FreeBSD supports having the root pool on a simple pool, mirror pool and raidz, but afaik booting off raidz used to have issues. - Sincerely, Dan Naumov ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org Even if a stripe did work its questionable why you need it for the os itself. Mostly you only need to read from the os pool, so you will still benefit from the speed of 2 drives with a mirror. If you are worried about db writes etc, then partition up the drives and have another pool for the db with the zpool configuration you want. Better still put it on its own spindles. Use tmpfs for tmp space etc and you could put swap on the striped pool as well. Just keep the os pool as a mirror its far safer. I also set copies=2 on the root zfs fs as well just for a bit more paranoia ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
On Tue, Jan 26, 2010 at 7:39 AM, Randal L. Schwartz mer...@stonehenge.com wrote: Ross == Ross Penner ross.pen...@gmail.com writes: Ross That seems to have been the problem. Yes, what I learned the hard way is that every single step there needs to be precisely followed, without deviation, even if you don't understand it or think it's important. :) Yes! But because I was extra anal retentive this time around, I've run into some more trouble. I have 2 disks and I only added one when I created the zroot pool. Now that my system is booted I figured I could just go 'zpool add -f zroot /dev/gpt/disk1' but I get the error message: cannot add to 'zroot': root pool cannot have multiple vdevs or seperate logs. I prepared the second disk in a similar manner to the first: gpart -t freebsd-zfs -l disk1 ad6. Any advice would be greatly appreciated! ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
2010/1/27 Ross Penner ross.pen...@gmail.com On Tue, Jan 26, 2010 at 7:39 AM, Randal L. Schwartz mer...@stonehenge.com wrote: Ross == Ross Penner ross.pen...@gmail.com writes: Ross That seems to have been the problem. Yes, what I learned the hard way is that every single step there needs to be precisely followed, without deviation, even if you don't understand it or think it's important. :) Yes! But because I was extra anal retentive this time around, I've run into some more trouble. I have 2 disks and I only added one when I created the zroot pool. Now that my system is booted I figured I could just go 'zpool add -f zroot /dev/gpt/disk1' but I get the error message: cannot add to 'zroot': root pool cannot have multiple vdevs or seperate logs. I prepared the second disk in a similar manner to the first: gpart -t freebsd-zfs -l disk1 ad6. Any advice would be greatly appreciated! u need to attach the drive create a mirror, adding creates a new vdev ie creates a stripe aka raid0 ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
On Wed, Jan 27, 2010 at 1:59 PM, krad kra...@googlemail.com wrote: 2010/1/27 Ross Penner ross.pen...@gmail.com On Tue, Jan 26, 2010 at 7:39 AM, Randal L. Schwartz mer...@stonehenge.com wrote: Ross == Ross Penner ross.pen...@gmail.com writes: Ross That seems to have been the problem. Yes, what I learned the hard way is that every single step there needs to be precisely followed, without deviation, even if you don't understand it or think it's important. :) Yes! But because I was extra anal retentive this time around, I've run into some more trouble. I have 2 disks and I only added one when I created the zroot pool. Now that my system is booted I figured I could just go 'zpool add -f zroot /dev/gpt/disk1' but I get the error message: cannot add to 'zroot': root pool cannot have multiple vdevs or seperate logs. I prepared the second disk in a similar manner to the first: gpart -t freebsd-zfs -l disk1 ad6. Any advice would be greatly appreciated! u need to attach the drive create a mirror, adding creates a new vdev ie creates a stripe aka raid0 I didn't want a mirror though, I wanted a stripe. I still don't understand why what I'm doing isn't working. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
RE: Help booting FreeBSD with a ZFS root filesystem
I didn't want a mirror though, I wanted a stripe. I still don't understand why what I'm doing isn't working. As far as I know, having the root pool on a stripe isn't supported. OpenSolaris supports having the root pool on a simple pool and a mirror pool. FreeBSD supports having the root pool on a simple pool, mirror pool and raidz, but afaik booting off raidz used to have issues. - Sincerely, Dan Naumov ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
On Tuesday 26 of January 2010 03:29:07 George Liaskos wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. Yes, that is also mandatory. I forgot to mention... Elias ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
That seems to have been the problem. Thanks for the help. On Mon, Jan 25, 2010 at 5:29 PM, George Liaskos geo.lias...@gmail.com wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. On Mon, Jan 25, 2010 at 9:31 PM, Ross Penner ross.pen...@gmail.com wrote: I'm trying to set up a system using ZFS as the root filesystem. I followed this guide: (http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot). Everything went swimmingly until I rebooted and the system failed to load. output: FreeBSD/i386 bootstrap loader, Revision 1.1 (root@, Mon Jan 25 13:03:11 UTC 2010) \ can't load 'kernel' Type '?' for a list of command, 'help' for more detailed help. OK I used the memstick 8.0-Release. Can anybody suggest what could have gone wrong, or how I could find out what could have gone wrong? Thank you for any help ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
2010/1/26 Ross Penner ross.pen...@gmail.com That seems to have been the problem. Thanks for the help. On Mon, Jan 25, 2010 at 5:29 PM, George Liaskos geo.lias...@gmail.com wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. On Mon, Jan 25, 2010 at 9:31 PM, Ross Penner ross.pen...@gmail.com wrote: I'm trying to set up a system using ZFS as the root filesystem. I followed this guide: (http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot). Everything went swimmingly until I rebooted and the system failed to load. output: FreeBSD/i386 bootstrap loader, Revision 1.1 (root@, Mon Jan 25 13:03:11 UTC 2010) \ can't load 'kernel' Type '?' for a list of command, 'help' for more detailed help. OK I used the memstick 8.0-Release. Can anybody suggest what could have gone wrong, or how I could find out what could have gone wrong? Thank you for any help ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org once you have generated the zpool.cache never never never export the boot pool again. Exporting isnt the same as unmounting (a common misconception). If you do export it the pool will become unbootable. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
krad wrote: 2010/1/26 Ross Penner ross.pen...@gmail.com That seems to have been the problem. Thanks for the help. On Mon, Jan 25, 2010 at 5:29 PM, George Liaskos geo.lias...@gmail.com wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. once you have generated the zpool.cache never never never export the boot pool again. Exporting isnt the same as unmounting (a common misconception). If you do export it the pool will become unbootable. Out of curiosity (because I had this problem a few weeks back), how does one move a bootable pool into another physical server in order to be able to see the pool as a 'data' set without exporting/importing, and then moving the pool back to the hardware that it normally boots from? Perhaps I was lucky when copying the cache back onto itself worked... Steve ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
2010/1/26 Steve Bertrand st...@ibctech.ca krad wrote: 2010/1/26 Ross Penner ross.pen...@gmail.com That seems to have been the problem. Thanks for the help. On Mon, Jan 25, 2010 at 5:29 PM, George Liaskos geo.lias...@gmail.com wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. once you have generated the zpool.cache never never never export the boot pool again. Exporting isnt the same as unmounting (a common misconception). If you do export it the pool will become unbootable. Out of curiosity (because I had this problem a few weeks back), how does one move a bootable pool into another physical server in order to be able to see the pool as a 'data' set without exporting/importing, and then moving the pool back to the hardware that it normally boots from? Perhaps I was lucky when copying the cache back onto itself worked... Steve with difficulty i suspect. You will probably have to specify an alternate root and zpool.cache file. Then copy the cache file onto the zpool before powering down, and NOT exporting. If you don't use an alternate zpool.cache file I suspect you will get issues as the test systems zpools will be referenced in there, and will cause a pickle when you bring the broken system up. Its probably best to use a non zfs based rescue system just to keep things simpler. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
2010/1/26 krad kra...@googlemail.com 2010/1/26 Steve Bertrand st...@ibctech.ca krad wrote: 2010/1/26 Ross Penner ross.pen...@gmail.com That seems to have been the problem. Thanks for the help. On Mon, Jan 25, 2010 at 5:29 PM, George Liaskos geo.lias...@gmail.com wrote: I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. once you have generated the zpool.cache never never never export the boot pool again. Exporting isnt the same as unmounting (a common misconception). If you do export it the pool will become unbootable. Out of curiosity (because I had this problem a few weeks back), how does one move a bootable pool into another physical server in order to be able to see the pool as a 'data' set without exporting/importing, and then moving the pool back to the hardware that it normally boots from? Perhaps I was lucky when copying the cache back onto itself worked... Steve with difficulty i suspect. You will probably have to specify an alternate root and zpool.cache file. Then copy the cache file onto the zpool before powering down, and NOT exporting. If you don't use an alternate zpool.cache file I suspect you will get issues as the test systems zpools will be referenced in there, and will cause a pickle when you bring the broken system up. Its probably best to use a non zfs based rescue system just to keep things simpler. Not sure if there will be any issues with hostid being different. I presume the pool is imported with a -f option on boot ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
Ross == Ross Penner ross.pen...@gmail.com writes: Ross That seems to have been the problem. Yes, what I learned the hard way is that every single step there needs to be precisely followed, without deviation, even if you don't understand it or think it's important. :) -- Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095 mer...@stonehenge.com URL:http://www.stonehenge.com/merlyn/ Smalltalk/Perl/Unix consulting, Technical writing, Comedy, etc. etc. See http://methodsandmessages.vox.com/ for Smalltalk and Seaside discussion ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
krad == krad kra...@googlemail.com writes: krad Not sure if there will be any issues with hostid being different. I krad presume the pool is imported with a -f option on boot No. The bootloader will not work with drives that were not imported at time of shutdown. One of the things I learned the hard way. I kept exporting after installation, out of my OCD to cleanly unmount everything before shutting down, and then cursed at my machine for not seeing the disk on boot. After four times of installing from scratch, I finally followed the instructions precisely (*without* the export), and it worked just fine. So, no, the bootloader will not import and especially not import -f. -- Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095 mer...@stonehenge.com URL:http://www.stonehenge.com/merlyn/ Smalltalk/Perl/Unix consulting, Technical writing, Comedy, etc. etc. See http://methodsandmessages.vox.com/ for Smalltalk and Seaside discussion ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
2010/1/26 Randal L. Schwartz mer...@stonehenge.com krad == krad kra...@googlemail.com writes: krad Not sure if there will be any issues with hostid being different. I krad presume the pool is imported with a -f option on boot No. The bootloader will not work with drives that were not imported at time of shutdown. One of the things I learned the hard way. I kept exporting after installation, out of my OCD to cleanly unmount everything before shutting down, and then cursed at my machine for not seeing the disk on boot. After four times of installing from scratch, I finally followed the instructions precisely (*without* the export), and it worked just fine. So, no, the bootloader will not import and especially not import -f. -- Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095 mer...@stonehenge.com URL:http://www.stonehenge.com/merlyn/ Smalltalk/Perl/Unix consulting, Technical writing, Comedy, etc. etc. See http://methodsandmessages.vox.com/ for Smalltalk and Seaside discussion thats not what i meant. The pool could be in an imported state. However the pool knows who imported it, or rather the hostid of the machine. If you import it on another machine and dont export it then try to import it on another machine you have to use the -f flag. Not sure if this hostid mismatch would cause an issue on boot as i haven't tested it. You are right about exporting it does totally bugger all, hence my 1st post on this thread ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Help booting FreeBSD with a ZFS root filesystem
I'm trying to set up a system using ZFS as the root filesystem. I followed this guide: (http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot). Everything went swimmingly until I rebooted and the system failed to load. output: FreeBSD/i386 bootstrap loader, Revision 1.1 (root@, Mon Jan 25 13:03:11 UTC 2010) \ can't load 'kernel' Type '?' for a list of command, 'help' for more detailed help. OK I used the memstick 8.0-Release. Can anybody suggest what could have gone wrong, or how I could find out what could have gone wrong? Thank you for any help ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
On Monday 25 of January 2010 23:31:26 Ross Penner wrote: I'm trying to set up a system using ZFS as the root filesystem. I followed this guide: (http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot). Everything went swimmingly until I rebooted and the system failed to load. output: FreeBSD/i386 bootstrap loader, Revision 1.1 (root@, Mon Jan 25 13:03:11 UTC 2010) \ can't load 'kernel' Type '?' for a list of command, 'help' for more detailed help. OK I used the memstick 8.0-Release. Can anybody suggest what could have gone wrong, or how I could find out what could have gone wrong? Thank you for any help ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org It seems that the system cannot mount the ZFS partition properly and see the /boot/kernel. Can you boot using fixit console, kldload the opensolaris and zfs modules and see if you have everything configured properly (like loader.conf, etc., set the mountpoint of the zfs partition to legacy and zpool set bootfs=zroot zroot)? Remember that the zfs pool is there, so zpool list first and if you can see the pool, import it. Actually I'm not a zfs geek, but these are the first steps I would follow to debug the problem. I've used the same guide to make my system a zfs-only system and everything went fine. I didn't install a new FreeBSD system but I dump-restored my existing one... Elias ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: Help booting FreeBSD with a ZFS root filesystem
I had the same issue because i forgot to copy the zpool.cache under /zroot/boot/zfs. On Mon, Jan 25, 2010 at 9:31 PM, Ross Penner ross.pen...@gmail.com wrote: I'm trying to set up a system using ZFS as the root filesystem. I followed this guide: (http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot). Everything went swimmingly until I rebooted and the system failed to load. output: FreeBSD/i386 bootstrap loader, Revision 1.1 (root@, Mon Jan 25 13:03:11 UTC 2010) \ can't load 'kernel' Type '?' for a list of command, 'help' for more detailed help. OK I used the memstick 8.0-Release. Can anybody suggest what could have gone wrong, or how I could find out what could have gone wrong? Thank you for any help ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
