Re: Zpool doesn't boot anymore after FreeBSD 12.1
Ok, thanks. Please keep me posted. On Thu, Oct 22, 2020 at 5:37 PM Toomas Soome wrote: > > > On 22. Oct 2020, at 23:29, Cassiano Peixoto > wrote: > > > Hi Toomas, > > Thank you for this patch. Can I know when it will be MFCed? I'd like to > try. > > > > MFC will take a bit because I need to bring it together with asize > updates, so we would need to do a bit of cherry-picking and testing. > > rgds, > toomas > > > > > Hi! > > Please try 366951:) I think, it should get things better for you. > > rgds, > toomas > > On Thu, Oct 22, 2020 at 3:04 PM Cassiano Peixoto < > peixotocassi...@gmail.com> wrote: > >> Sergey, >> >> I agree with you. The best thing is to revert the commit on zfsloader. >> Many people didn't realize this issue yet, but they will run into a big >> problem soon. >> >> On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko >> wrote: >> >>> On Thu, 22 Oct 2020 16:42:16 +0300 >>> Andriy Gapon wrote: >>> >>> > On 22/10/2020 16:39, Cassiano Peixoto wrote: >>> > > Hi Andriy, >>> > > >>> > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to >>> FreeBSD >>> > > 12.1 and 12.2 (STABLE) and fixed the issue. >>> > > >>> > > I also tried to use zfsloader of 11.3 but didn't work and the same >>> issue >>> > > happened. >>> > > >>> > > So it seems that something has changed on zfsloader after 11.2 that >>> brings >>> > > this issue. >>> > > >>> > > My question is: Should it be expected or is it a bug to be fixed? >>> > > >>> > >>> > In my opinion it's a bug. >>> > zfsloader should not require that disks must be partitioned. >>> > >>> >>> +1 >>> That's why I have terribly outdated 13-CURRENT on bunch of servers and >>> can't >>> update them. >>> >>> Most of them look like this: >>> [tiger@st25]:~>zpool status >>> pool: st25 >>> state: ONLINE >>> scan: none requested >>> config: >>> >>> NAMESTATE READ WRITE CKSUM >>> st25 ONLINE 0 0 0 >>> mirror-0 ONLINE 0 0 0 >>> ada0ONLINE 0 0 0 >>> ada1ONLINE 0 0 0 >>> mirror-1 ONLINE 0 0 0 >>> ada2ONLINE 0 0 0 >>> ada3ONLINE 0 0 0 >>> mirror-2 ONLINE 0 0 0 >>> ada4ONLINE 0 0 0 >>> ada5ONLINE 0 0 0 >>> mirror-3 ONLINE 0 0 0 >>> ada6ONLINE 0 0 0 >>> ada7ONLINE 0 0 0 >>> >>> errors: No known data errors >>> >>> They haven't separate boot device and have from 7 to 30+ Tb of data that >>> I >>> can't backup anywhere for re-install server with disk partitioning. Some >>> time >>> ago I managed to get aroud this reverting 2 commits ( r342151 + don't >>> remember revision) but then there where some other improvements after >>> which I >>> lost the opportunity to revert this commits >>> >>> -- >>> wbr, Sergey >>> >>> ___ >>> freebsd-stable@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org >>> " >>> >> > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
On Thu, 22 Oct 2020 23:04:09 +0300 Toomas Soome wrote: > Hi! > > Please try 366951:) I think, it should get things better for you. > > rgds, > toomas > Thanks! I'll try as soon as I can find 7-8Tb for backup :) btw, can I update my head@r324614 to 366951 at once ? > > On 22. Oct 2020, at 20:37, Sergey V. Dyatko wrote: > > > > On Thu, 22 Oct 2020 16:42:16 +0300 > > Andriy Gapon wrote: > > > >> On 22/10/2020 16:39, Cassiano Peixoto wrote: > >>> Hi Andriy, > >>> > >>> I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD > >>> 12.1 and 12.2 (STABLE) and fixed the issue. > >>> > >>> I also tried to use zfsloader of 11.3 but didn't work and the same issue > >>> happened. > >>> > >>> So it seems that something has changed on zfsloader after 11.2 that brings > >>> this issue. > >>> > >>> My question is: Should it be expected or is it a bug to be fixed? > >>> > >> > >> In my opinion it's a bug. > >> zfsloader should not require that disks must be partitioned. > >> > > > > +1 > > That's why I have terribly outdated 13-CURRENT on bunch of servers and can't > > update them. > > > > Most of them look like this: > > [tiger@st25]:~>zpool status > > pool: st25 > > state: ONLINE > > scan: none requested > > config: > > > >NAMESTATE READ WRITE CKSUM > >st25 ONLINE 0 0 0 > > mirror-0 ONLINE 0 0 0 > >ada0ONLINE 0 0 0 > >ada1ONLINE 0 0 0 > > mirror-1 ONLINE 0 0 0 > >ada2ONLINE 0 0 0 > >ada3ONLINE 0 0 0 > > mirror-2 ONLINE 0 0 0 > >ada4ONLINE 0 0 0 > >ada5ONLINE 0 0 0 > > mirror-3 ONLINE 0 0 0 > >ada6ONLINE 0 0 0 > >ada7ONLINE 0 0 0 > > > > errors: No known data errors > > > > They haven't separate boot device and have from 7 to 30+ Tb of data that I > > can't backup anywhere for re-install server with disk partitioning. Some > > time ago I managed to get aroud this reverting 2 commits ( r342151 + don't > > remember revision) but then there where some other improvements after which > > I lost the opportunity to revert this commits > > > > -- > > wbr, Sergey > > > > ___ > > freebsd-curr...@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org" > -- wbr, Sergey ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi Toomas, Thank you for this patch. Can I know when it will be MFCed? I'd like to try. Hi! Please try 366951:) I think, it should get things better for you. rgds, toomas On Thu, Oct 22, 2020 at 3:04 PM Cassiano Peixoto wrote: > Sergey, > > I agree with you. The best thing is to revert the commit on zfsloader. > Many people didn't realize this issue yet, but they will run into a big > problem soon. > > On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko > wrote: > >> On Thu, 22 Oct 2020 16:42:16 +0300 >> Andriy Gapon wrote: >> >> > On 22/10/2020 16:39, Cassiano Peixoto wrote: >> > > Hi Andriy, >> > > >> > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to >> FreeBSD >> > > 12.1 and 12.2 (STABLE) and fixed the issue. >> > > >> > > I also tried to use zfsloader of 11.3 but didn't work and the same >> issue >> > > happened. >> > > >> > > So it seems that something has changed on zfsloader after 11.2 that >> brings >> > > this issue. >> > > >> > > My question is: Should it be expected or is it a bug to be fixed? >> > > >> > >> > In my opinion it's a bug. >> > zfsloader should not require that disks must be partitioned. >> > >> >> +1 >> That's why I have terribly outdated 13-CURRENT on bunch of servers and >> can't >> update them. >> >> Most of them look like this: >> [tiger@st25]:~>zpool status >> pool: st25 >> state: ONLINE >> scan: none requested >> config: >> >> NAMESTATE READ WRITE CKSUM >> st25 ONLINE 0 0 0 >> mirror-0 ONLINE 0 0 0 >> ada0ONLINE 0 0 0 >> ada1ONLINE 0 0 0 >> mirror-1 ONLINE 0 0 0 >> ada2ONLINE 0 0 0 >> ada3ONLINE 0 0 0 >> mirror-2 ONLINE 0 0 0 >> ada4ONLINE 0 0 0 >> ada5ONLINE 0 0 0 >> mirror-3 ONLINE 0 0 0 >> ada6ONLINE 0 0 0 >> ada7ONLINE 0 0 0 >> >> errors: No known data errors >> >> They haven't separate boot device and have from 7 to 30+ Tb of data that I >> can't backup anywhere for re-install server with disk partitioning. Some >> time >> ago I managed to get aroud this reverting 2 commits ( r342151 + don't >> remember revision) but then there where some other improvements after >> which I >> lost the opportunity to revert this commits >> >> -- >> wbr, Sergey >> >> ___ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" >> > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Sergey, I agree with you. The best thing is to revert the commit on zfsloader. Many people didn't realize this issue yet, but they will run into a big problem soon. On Thu, Oct 22, 2020 at 2:41 PM Sergey V. Dyatko wrote: > On Thu, 22 Oct 2020 16:42:16 +0300 > Andriy Gapon wrote: > > > On 22/10/2020 16:39, Cassiano Peixoto wrote: > > > Hi Andriy, > > > > > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to > FreeBSD > > > 12.1 and 12.2 (STABLE) and fixed the issue. > > > > > > I also tried to use zfsloader of 11.3 but didn't work and the same > issue > > > happened. > > > > > > So it seems that something has changed on zfsloader after 11.2 that > brings > > > this issue. > > > > > > My question is: Should it be expected or is it a bug to be fixed? > > > > > > > In my opinion it's a bug. > > zfsloader should not require that disks must be partitioned. > > > > +1 > That's why I have terribly outdated 13-CURRENT on bunch of servers and > can't > update them. > > Most of them look like this: > [tiger@st25]:~>zpool status > pool: st25 > state: ONLINE > scan: none requested > config: > > NAMESTATE READ WRITE CKSUM > st25 ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > ada0ONLINE 0 0 0 > ada1ONLINE 0 0 0 > mirror-1 ONLINE 0 0 0 > ada2ONLINE 0 0 0 > ada3ONLINE 0 0 0 > mirror-2 ONLINE 0 0 0 > ada4ONLINE 0 0 0 > ada5ONLINE 0 0 0 > mirror-3 ONLINE 0 0 0 > ada6ONLINE 0 0 0 > ada7ONLINE 0 0 0 > > errors: No known data errors > > They haven't separate boot device and have from 7 to 30+ Tb of data that I > can't backup anywhere for re-install server with disk partitioning. Some > time > ago I managed to get aroud this reverting 2 commits ( r342151 + don't > remember revision) but then there where some other improvements after > which I > lost the opportunity to revert this commits > > -- > wbr, Sergey > > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
On Thu, 22 Oct 2020 16:42:16 +0300 Andriy Gapon wrote: > On 22/10/2020 16:39, Cassiano Peixoto wrote: > > Hi Andriy, > > > > I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD > > 12.1 and 12.2 (STABLE) and fixed the issue. > > > > I also tried to use zfsloader of 11.3 but didn't work and the same issue > > happened. > > > > So it seems that something has changed on zfsloader after 11.2 that brings > > this issue. > > > > My question is: Should it be expected or is it a bug to be fixed? > > > > In my opinion it's a bug. > zfsloader should not require that disks must be partitioned. > +1 That's why I have terribly outdated 13-CURRENT on bunch of servers and can't update them. Most of them look like this: [tiger@st25]:~>zpool status pool: st25 state: ONLINE scan: none requested config: NAMESTATE READ WRITE CKSUM st25 ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0ONLINE 0 0 0 ada1ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 ada2ONLINE 0 0 0 ada3ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 ada4ONLINE 0 0 0 ada5ONLINE 0 0 0 mirror-3 ONLINE 0 0 0 ada6ONLINE 0 0 0 ada7ONLINE 0 0 0 errors: No known data errors They haven't separate boot device and have from 7 to 30+ Tb of data that I can't backup anywhere for re-install server with disk partitioning. Some time ago I managed to get aroud this reverting 2 commits ( r342151 + don't remember revision) but then there where some other improvements after which I lost the opportunity to revert this commits -- wbr, Sergey ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi Andriy, I've just tried copying my zfsloader from 11.2-STABLE (R350026) to FreeBSD 12.1 and 12.2 (STABLE) and fixed the issue. I also tried to use zfsloader of 11.3 but didn't work and the same issue happened. So it seems that something has changed on zfsloader after 11.2 that brings this issue. My question is: Should it be expected or is it a bug to be fixed? Thanks. On Thu, Oct 22, 2020 at 4:39 AM Andriy Gapon wrote: > On 21/10/2020 15:20, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > Can you try to replace /boot/zfsloader with zfsloader from other FreeBSD > versions? > E.g., 12.0, 12.2-RC, 11.4, recent snapshot of the CURRENT? > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassi...@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time with > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >>da1ONLINE 0 0 0 > >>da2ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn’t boot anymore, i got the following error: > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org > " > > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Thanks for the tip! I've fixed the issue following the following steps: 1) added two new disks with the same size: da3 and da4 2) Made a partition for both: gpart create -s gpt da3 gpart create -s gpt da4 gpart add -t freebsd-zfs da3 gpart add -t freebsd-zfs da4 3) replace both disks on pool zpool replace zroot da2 da3p1 zpool replace zroot da3 da4p1 4) rebuild bootcode gpart boocode -b /boot/pmbr -p /boot/gptzfsboot -i 1 da0 Done! I rebooted and everything is working again. Thank you guys for the support. On Wed, Oct 21, 2020 at 5:36 PM Walter Cramer wrote: > I very much doubt that there's any remotely sane way to re-partition da1 & > da2 while they are in the pool. > > If you carefully edit the output of the 'gpart backup' command, you > probably can use 'gpart restore' to partition da1 and da2. Read the > 'gpart' man page very carefully, if you aren't familiar with that. Also, > you'll probably want to install bootstrap code on da1 & da2 with 'gpart > bootstrap'. > > -Walter > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > Walter, > > Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. > But is there a way to make the partition of da1 and da2 since both are > already inserted on pool? I think it's not allowed... > > Thanks. > > > On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: > > > My guess - there is a work-around or two, but you'll face a lot more > > grief, long-term, if you don't do things the right way (aka do a bunch of > > re-install work) now. > > > > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to > > see how the original disk is partitioned. Then duplicate that > > partitioning on da1 and da2. > > > > -Walter > > > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > > > Hi guys, > > > > Thank your for your answer. > > > > @Ricchard First of all I didn't have a chance to run zpool upgrade, > because > > after the system update reboot i ran into the issue. > > > > @Walter and @mike Regarding making a partition, I never see any > > recommendation about this, I've been always using the entire disk on a > pool > > to expand it. Until FreeBSD 11.2 it worked fine. > > > > Is there a workaround for this or should I reinstall the entire pool? > > > > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > > > > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 > is > > > ? Or is it perhaps trying to boot from da1 or da2 which does not have > > > boot info ? Generally its not recommended to use the entire disk as > > > part of a pool. Create a partition scheme first > > > > > > gpart create -s gpt da1 > > > > > > gpart add -t freebsd-zfs da1 > > > > > > then add da1p1 to the pool > > > > > > ---Mike > > > > > > > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > > > Hi there, > > > > > > > > Anyone can help please? I've many servers with this same issue. > Thanks > > > > > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > > > peixotocassi...@gmail.com> > > > > wrote: > > > > > > > >> Hi there, > > > >> > > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > > > added two more disks to expand my pool. BTW I already did it many time > > with > > > no issues. > > > >> > > > >> I ran: > > > >> > > > >> # zpool status > > > >> pool: zroot > > > >> state: ONLINE > > > >> status: Some supported features are not enabled on the pool. The > pool > > > can > > > >> still be used, but some features are unavailable. > > > >> action: Enable all features using 'zpool upgrade'. Once this is > done, > > > >> the pool may no longer be accessible by software that does not > > > support > > > >> the features. See zpool-features(7) for details. > > > >> scan: none requested > > > >> config: > > > >> > > > >> NAME STATE READ WRITE CKSUM > > > >> zrootONLINE 0 0 0 > > > >>gpt/disk0 ONLINE 0 0 0 > > > >> > > > >> errors: No known data errors > > > >> > > > >> # zpool add -f zroot da1 > > > >> # zpool add -f zroot da2 > > > >> # zpool status > > > >> pool: zroot > > > >> state: ONLINE > > > >> scan: none requested > > > >> config: > > > >> > > > >> NAME STATE READ WRITE CKSUM > > > >> zrootONLINE 0 0 0 > > > >>gpt/disk0 ONLINE 0 0 0 > > > >>da1ONLINE 0 0 0 > > > >>da2ONLINE 0 0 0 > > > >> > > > >> errors: No known data errors > > > >> # reboot > > > >> > > > >> Then my system doesn’t boot anymore, i got the following error: > > > >> > > > >> gptzfsboot: error 4 lba 2038346899 > > > >> gptzfsboot: error 4 lba 1361327267 > > > >> /boot/config: -Dh > > > >> > > > >> BTX loader 1.00 BTX version is 1.02 > > > >> Consoles: internal video/keyboard serial port > > > >> BIOS drive A: is fd0 > > > >> BIOS drive C: is disk0 > > > >> BIOS drive D: is disk1 > > > >> BIOS drive E: is
Re: Zpool doesn't boot anymore after FreeBSD 12.1
I very much doubt that there's any remotely sane way to re-partition da1 & da2 while they are in the pool. If you carefully edit the output of the 'gpart backup' command, you probably can use 'gpart restore' to partition da1 and da2. Read the 'gpart' man page very carefully, if you aren't familiar with that. Also, you'll probably want to install bootstrap code on da1 & da2 with 'gpart bootstrap'. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: Walter, Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. But is there a way to make the partition of da1 and da2 since both are already inserted on pool? I think it's not allowed... Thanks. On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: My guess - there is a work-around or two, but you'll face a lot more grief, long-term, if you don't do things the right way (aka do a bunch of re-install work) now. I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to see how the original disk is partitioned. Then duplicate that partitioning on da1 and da2. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > ? Or is it perhaps trying to boot from da1 or da2 which does not have > boot info ? Generally its not recommended to use the entire disk as > part of a pool. Create a partition scheme first > > gpart create -s gpt da1 > > gpart add -t freebsd-zfs da1 > > then add da1p1 to the pool > > ---Mike > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassi...@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time with > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >>da1ONLINE 0 0 0 > >>da2ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn???t boot anymore, i got the following error: > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to " freebsd-stable-unsubscr...@freebsd.org > " > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Walter, Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd. But is there a way to make the partition of da1 and da2 since both are already inserted on pool? I think it's not allowed... Thanks. On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer wrote: > My guess - there is a work-around or two, but you'll face a lot more > grief, long-term, if you don't do things the right way (aka do a bunch of > re-install work) now. > > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to > see how the original disk is partitioned. Then duplicate that > partitioning on da1 and da2. > > -Walter > > On Wed, 21 Oct 2020, Cassiano Peixoto wrote: > > > Hi guys, > > Thank your for your answer. > > @Ricchard First of all I didn't have a chance to run zpool upgrade, because > after the system update reboot i ran into the issue. > > @Walter and @mike Regarding making a partition, I never see any > recommendation about this, I've been always using the entire disk on a pool > to expand it. Until FreeBSD 11.2 it worked fine. > > Is there a workaround for this or should I reinstall the entire pool? > > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > > ? Or is it perhaps trying to boot from da1 or da2 which does not have > > boot info ? Generally its not recommended to use the entire disk as > > part of a pool. Create a partition scheme first > > > > gpart create -s gpt da1 > > > > gpart add -t freebsd-zfs da1 > > > > then add da1p1 to the pool > > > > ---Mike > > > > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > > Hi there, > > > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > > peixotocassi...@gmail.com> > > > wrote: > > > > > >> Hi there, > > >> > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > > added two more disks to expand my pool. BTW I already did it many time > with > > no issues. > > >> > > >> I ran: > > >> > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> status: Some supported features are not enabled on the pool. The pool > > can > > >> still be used, but some features are unavailable. > > >> action: Enable all features using 'zpool upgrade'. Once this is done, > > >> the pool may no longer be accessible by software that does not > > support > > >> the features. See zpool-features(7) for details. > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zrootONLINE 0 0 0 > > >>gpt/disk0 ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> > > >> # zpool add -f zroot da1 > > >> # zpool add -f zroot da2 > > >> # zpool status > > >> pool: zroot > > >> state: ONLINE > > >> scan: none requested > > >> config: > > >> > > >> NAME STATE READ WRITE CKSUM > > >> zrootONLINE 0 0 0 > > >>gpt/disk0 ONLINE 0 0 0 > > >>da1ONLINE 0 0 0 > > >>da2ONLINE 0 0 0 > > >> > > >> errors: No known data errors > > >> # reboot > > >> > > >> Then my system doesn’t boot anymore, i got the following error: > > >> > > >> gptzfsboot: error 4 lba 2038346899 > > >> gptzfsboot: error 4 lba 1361327267 > > >> /boot/config: -Dh > > >> > > >> BTX loader 1.00 BTX version is 1.02 > > >> Consoles: internal video/keyboard serial port > > >> BIOS drive A: is fd0 > > >> BIOS drive C: is disk0 > > >> BIOS drive D: is disk1 > > >> BIOS drive E: is disk2 > > >> BIOS drive F: is disk3 > > >> BIOS drive G: is disk4 > > >> BIOS drive H: is disk5 > > >> ZFS: i/o error - all block copies unavailable > > >> ZFS: failed to read pool zroot directory object > > >> BIOS 638kB/3143616kB available memory > > >> > > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > > >> > > >> Type '?' for list of commands, 'help' for more datailed help. > > >> OK > > >> > > >> I can import my pool with no problems using the lived, but I could not > > fix it. > > >> > > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > > >> > > >> Thanks. > > >> > > >> > > >> > > >> > > > ___ > > > freebsd-stable@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > > To unsubscribe, send any mail to " > freebsd-stable-unsubscr...@freebsd.org > > " > > > > > > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" ___ freebsd-stable@freebsd.org mailing list
Re: Zpool doesn't boot anymore after FreeBSD 12.1
My guess - there is a work-around or two, but you'll face a lot more grief, long-term, if you don't do things the right way (aka do a bunch of re-install work) now. I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to see how the original disk is partitioned. Then duplicate that partitioning on da1 and da2. -Walter On Wed, 21 Oct 2020, Cassiano Peixoto wrote: Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is ? Or is it perhaps trying to boot from da1 or da2 which does not have boot info ? Generally its not recommended to use the entire disk as part of a pool. Create a partition scheme first gpart create -s gpt da1 gpart add -t freebsd-zfs da1 then add da1p1 to the pool ---Mike On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > Hi there, > > Anyone can help please? I've many servers with this same issue. Thanks > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < peixotocassi...@gmail.com> > wrote: > >> Hi there, >> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added two more disks to expand my pool. BTW I already did it many time with no issues. >> >> I ran: >> >> # zpool status >> pool: zroot >> state: ONLINE >> status: Some supported features are not enabled on the pool. The pool can >> still be used, but some features are unavailable. >> action: Enable all features using 'zpool upgrade'. Once this is done, >> the pool may no longer be accessible by software that does not support >> the features. See zpool-features(7) for details. >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >> >> errors: No known data errors >> >> # zpool add -f zroot da1 >> # zpool add -f zroot da2 >> # zpool status >> pool: zroot >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >>da1ONLINE 0 0 0 >>da2ONLINE 0 0 0 >> >> errors: No known data errors >> # reboot >> >> Then my system doesn???t boot anymore, i got the following error: >> >> gptzfsboot: error 4 lba 2038346899 >> gptzfsboot: error 4 lba 1361327267 >> /boot/config: -Dh >> >> BTX loader 1.00 BTX version is 1.02 >> Consoles: internal video/keyboard serial port >> BIOS drive A: is fd0 >> BIOS drive C: is disk0 >> BIOS drive D: is disk1 >> BIOS drive E: is disk2 >> BIOS drive F: is disk3 >> BIOS drive G: is disk4 >> BIOS drive H: is disk5 >> ZFS: i/o error - all block copies unavailable >> ZFS: failed to read pool zroot directory object >> BIOS 638kB/3143616kB available memory >> >> FreeBSD/x86 bootstrap loader, Revision 1.1 >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. >> >> Type '?' for list of commands, 'help' for more datailed help. >> OK >> >> I can import my pool with no problems using the lived, but I could not fix it. >> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? >> >> Thanks. >> >> >> >> > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org " > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi guys, Thank your for your answer. @Ricchard First of all I didn't have a chance to run zpool upgrade, because after the system update reboot i ran into the issue. @Walter and @mike Regarding making a partition, I never see any recommendation about this, I've been always using the entire disk on a pool to expand it. Until FreeBSD 11.2 it worked fine. Is there a workaround for this or should I reinstall the entire pool? On Wed, Oct 21, 2020 at 4:45 PM mike tancsa wrote: > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is > ? Or is it perhaps trying to boot from da1 or da2 which does not have > boot info ? Generally its not recommended to use the entire disk as > part of a pool. Create a partition scheme first > > gpart create -s gpt da1 > > gpart add -t freebsd-zfs da1 > > then add da1p1 to the pool > > ---Mike > > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > > Hi there, > > > > Anyone can help please? I've many servers with this same issue. Thanks > > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto < > peixotocassi...@gmail.com> > > wrote: > > > >> Hi there, > >> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I > added two more disks to expand my pool. BTW I already did it many time with > no issues. > >> > >> I ran: > >> > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> status: Some supported features are not enabled on the pool. The pool > can > >> still be used, but some features are unavailable. > >> action: Enable all features using 'zpool upgrade'. Once this is done, > >> the pool may no longer be accessible by software that does not > support > >> the features. See zpool-features(7) for details. > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >> > >> errors: No known data errors > >> > >> # zpool add -f zroot da1 > >> # zpool add -f zroot da2 > >> # zpool status > >> pool: zroot > >> state: ONLINE > >> scan: none requested > >> config: > >> > >> NAME STATE READ WRITE CKSUM > >> zrootONLINE 0 0 0 > >>gpt/disk0 ONLINE 0 0 0 > >>da1ONLINE 0 0 0 > >>da2ONLINE 0 0 0 > >> > >> errors: No known data errors > >> # reboot > >> > >> Then my system doesn’t boot anymore, i got the following error: > >> > >> gptzfsboot: error 4 lba 2038346899 > >> gptzfsboot: error 4 lba 1361327267 > >> /boot/config: -Dh > >> > >> BTX loader 1.00 BTX version is 1.02 > >> Consoles: internal video/keyboard serial port > >> BIOS drive A: is fd0 > >> BIOS drive C: is disk0 > >> BIOS drive D: is disk1 > >> BIOS drive E: is disk2 > >> BIOS drive F: is disk3 > >> BIOS drive G: is disk4 > >> BIOS drive H: is disk5 > >> ZFS: i/o error - all block copies unavailable > >> ZFS: failed to read pool zroot directory object > >> BIOS 638kB/3143616kB available memory > >> > >> FreeBSD/x86 bootstrap loader, Revision 1.1 > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. > >> > >> Type '?' for list of commands, 'help' for more datailed help. > >> OK > >> > >> I can import my pool with no problems using the lived, but I could not > fix it. > >> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > >> > >> Thanks. > >> > >> > >> > >> > > ___ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org > " > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is ? Or is it perhaps trying to boot from da1 or da2 which does not have boot info ? Generally its not recommended to use the entire disk as part of a pool. Create a partition scheme first gpart create -s gpt da1 gpart add -t freebsd-zfs da1 then add da1p1 to the pool ---Mike On 10/21/2020 8:20 AM, Cassiano Peixoto wrote: > Hi there, > > Anyone can help please? I've many servers with this same issue. Thanks > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto > wrote: > >> Hi there, >> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added >> two more disks to expand my pool. BTW I already did it many time with no >> issues. >> >> I ran: >> >> # zpool status >> pool: zroot >> state: ONLINE >> status: Some supported features are not enabled on the pool. The pool can >> still be used, but some features are unavailable. >> action: Enable all features using 'zpool upgrade'. Once this is done, >> the pool may no longer be accessible by software that does not support >> the features. See zpool-features(7) for details. >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >> >> errors: No known data errors >> >> # zpool add -f zroot da1 >> # zpool add -f zroot da2 >> # zpool status >> pool: zroot >> state: ONLINE >> scan: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> zrootONLINE 0 0 0 >>gpt/disk0 ONLINE 0 0 0 >>da1ONLINE 0 0 0 >>da2ONLINE 0 0 0 >> >> errors: No known data errors >> # reboot >> >> Then my system doesn’t boot anymore, i got the following error: >> >> gptzfsboot: error 4 lba 2038346899 >> gptzfsboot: error 4 lba 1361327267 >> /boot/config: -Dh >> >> BTX loader 1.00 BTX version is 1.02 >> Consoles: internal video/keyboard serial port >> BIOS drive A: is fd0 >> BIOS drive C: is disk0 >> BIOS drive D: is disk1 >> BIOS drive E: is disk2 >> BIOS drive F: is disk3 >> BIOS drive G: is disk4 >> BIOS drive H: is disk5 >> ZFS: i/o error - all block copies unavailable >> ZFS: failed to read pool zroot directory object >> BIOS 638kB/3143616kB available memory >> >> FreeBSD/x86 bootstrap loader, Revision 1.1 >> ERROR: cannot open /boot/lua/loader.lua: invalid argument. >> >> Type '?' for list of commands, 'help' for more datailed help. >> OK >> >> I can import my pool with no problems using the lived, but I could not fix >> it. >> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? >> >> Thanks. >> >> >> >> > ___ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org" > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Re: Zpool doesn't boot anymore after FreeBSD 12.1
Hi there, Anyone can help please? I've many servers with this same issue. Thanks On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto wrote: > Hi there, > > I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added > two more disks to expand my pool. BTW I already did it many time with no > issues. > > I ran: > > # zpool status > pool: zroot > state: ONLINE > status: Some supported features are not enabled on the pool. The pool can > still be used, but some features are unavailable. > action: Enable all features using 'zpool upgrade'. Once this is done, > the pool may no longer be accessible by software that does not support > the features. See zpool-features(7) for details. > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zrootONLINE 0 0 0 > gpt/disk0 ONLINE 0 0 0 > > errors: No known data errors > > # zpool add -f zroot da1 > # zpool add -f zroot da2 > # zpool status > pool: zroot > state: ONLINE > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > zrootONLINE 0 0 0 > gpt/disk0 ONLINE 0 0 0 > da1ONLINE 0 0 0 > da2ONLINE 0 0 0 > > errors: No known data errors > # reboot > > Then my system doesn’t boot anymore, i got the following error: > > gptzfsboot: error 4 lba 2038346899 > gptzfsboot: error 4 lba 1361327267 > /boot/config: -Dh > > BTX loader 1.00 BTX version is 1.02 > Consoles: internal video/keyboard serial port > BIOS drive A: is fd0 > BIOS drive C: is disk0 > BIOS drive D: is disk1 > BIOS drive E: is disk2 > BIOS drive F: is disk3 > BIOS drive G: is disk4 > BIOS drive H: is disk5 > ZFS: i/o error - all block copies unavailable > ZFS: failed to read pool zroot directory object > BIOS 638kB/3143616kB available memory > > FreeBSD/x86 bootstrap loader, Revision 1.1 > ERROR: cannot open /boot/lua/loader.lua: invalid argument. > > Type '?' for list of commands, 'help' for more datailed help. > OK > > I can import my pool with no problems using the lived, but I could not fix it. > > Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that? > > Thanks. > > > > ___ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
