FreeBSD Quarterly Status Report - Third Quarter 2020

2020-10-21 Thread Daniel Ebdrup Jensen
FreeBSD Project Quarterly Status Report - Third Quarter 2020
Introduction

   This report covers FreeBSD related projects for the period between July
   and September, and is the third of four planned reports for 2020.

   This quarter brings a good mix of additions and changes to the FreeBSD
   Project and community, from a diverse number of teams and people
   covering everything from architectures, continuous integration,
   wireless networking and drivers, over drm, desktop and third-party
   project work, as well as several team reports, along with many other
   interesting subjects too numerous to mention.

   As the world is still affected by the epidemic, we hope that this
   report can also serve as a good reminder that there is good work that
   can be done by people working together, even if we're apart.

   We hope you'll be as interested in reading it, as we've been in making
   it. Daniel Ebdrup Jensen, on behalf of the quarterly team.
 __

FreeBSD Team Reports

 * FreeBSD Foundation
 * FreeBSD Release Engineering Team
 * Cluster Administration Team
 * Continuous Integration
 * Ports Collection
 * FreeBSD Office team - 3rd quarter 2020 report
 * FreeBSD Graphics Team status report

Projects

 * FreeBSD on Microsoft HyperV and Azure
 * Building FreeBSD on non-FreeBSD hosts
 * Git Migration Working Group
 * Linux compatibility layer update
 * LLDB Debugger Improvements
 * Lua usage in FreeBSD
 * NFS over TLS implementation
 * syzkaller on FreeBSD

Kernel

 * DRM Drivers Update
 * DTS Update
 * DesignWare Ethernet adapter driver improvements
 * Google Summer of Code'20 Project - eBPF XDP Hooks
 * ENA FreeBSD Driver Update
 * IPSec Extended Sequence Number (ESN) support
 * NXP ARM64 SoC support
 * Addition of PowerPC64LE Architecture
 * ure - USB 3.0 Gigabit Ethernet Driver update
 * Stateless hardware offloads for VXLANs
 * Wireless updates
 * ZSTD Compression in ZFS

Architectures

 * CheriBSD 2020 Q3
 * FreeBSD/RISC-V Project

Ports

 * Update to grub-bhyve
 * KDE on FreeBSD

Documentation

 * DOCNG on FreeBSD

Third-Party Projects

 * Potluck - Flavour & Image Repository for pot
 __

FreeBSD Team Reports

   Entries from the various official and semi-official teams, as found in
   the Administration Page.

FreeBSD Foundation

   Contact: Deb Goodkin 

   The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated
   to supporting and promoting the FreeBSD Project and community
   worldwide. Funding comes from individual and corporate donations and is
   used to fund and manage software development projects, conferences and
   developer summits, and provide travel grants to FreeBSD contributors.
   The Foundation purchases and supports hardware to improve and maintain
   FreeBSD infrastructure and provides resources to improve security,
   quality assurance, and release engineering efforts; publishes marketing
   material to promote, educate, and advocate for the FreeBSD Project;
   facilitates collaboration between commercial vendors and FreeBSD
   developers; and finally, represents the FreeBSD Project in executing
   contracts, license agreements, and other legal arrangements that
   require a recognized legal entity.

   Here are some highlights of what we did to help FreeBSD last quarter:

COVID-19 Impact to the Foundation

   Like other organizations, we put policies in place for all of our staff
   members to work from home. We also put a temporary ban on travel for
   staff members. We are continuing our work supporting the community and
   Project, but some of our work and responses may be delayed because of
   changes in some of our priorities and the impact of limited childcare
   for a few of our staff members.

Partnerships and Commercial User Support

   We help facilitate collaboration between commercial users and FreeBSD
   developers. We also meet with companies to discuss their needs and
   bring that information back to the Project. Not surprisingly, the stay
   at home orders, combined with our company ban on travel during Q3 made
   in-person meetings non-existent. However, the team was able to continue
   meeting with our partners and commercial users virtually. These
   meetings help us understand some of the applications where FreeBSD is
   used.

   We are currently scheduling Zoom company meetings for Q4, please reach
   out if you would like to schedule a meeting with us.

Fundraising Efforts

   Last quarter we raised $192,874.43! Thank you to the individuals and
   organizations that stepped in, to help fund our efforts. We'd like to
   thank Arm for their large contribution last quarter, which helped bring
   our 2020 fundraising effort to $521k. We hope other organizations will
   follow 

Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Cassiano Peixoto
Thanks for the tip! I've fixed the issue following the following steps:

1) added two new disks with the same size: da3 and da4

2) Made a partition for both:
gpart create -s gpt da3
gpart create -s gpt da4
gpart add -t freebsd-zfs da3
gpart  add -t freebsd-zfs da4

3) replace both disks on pool
zpool replace zroot da2 da3p1
zpool replace zroot da3 da4p1

4) rebuild bootcode
gpart boocode -b /boot/pmbr -p /boot/gptzfsboot -i 1 da0

Done! I rebooted and everything is working again.

Thank you guys for the support.

On Wed, Oct 21, 2020 at 5:36 PM Walter Cramer  wrote:

> I very much doubt that there's any remotely sane way to re-partition da1 &
> da2 while they are in the pool.
>
> If you carefully edit the output of the 'gpart backup' command, you
> probably can use 'gpart restore' to partition da1 and da2.  Read the
> 'gpart' man page very carefully, if you aren't familiar with that.  Also,
> you'll probably want to install bootstrap code on da1 & da2 with 'gpart
> bootstrap'.
>
> -Walter
>
> On Wed, 21 Oct 2020, Cassiano Peixoto wrote:
>
> > Walter,
>
> Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd.
> But is there a way to make the partition of da1 and da2 since both are
> already inserted on pool? I think it's not allowed...
>
> Thanks.
>
>
> On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer  wrote:
>
> > My guess - there is a work-around or two, but you'll face a lot more
> > grief, long-term, if you don't do things the right way (aka do a bunch of
> > re-install work) now.
> >
> > I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to
> > see how the original disk is partitioned.  Then duplicate that
> > partitioning on da1 and da2.
> >
> > -Walter
> >
> > On Wed, 21 Oct 2020, Cassiano Peixoto wrote:
> >
> > > Hi guys,
> >
> > Thank your for your answer.
> >
> > @Ricchard First of all I didn't have a chance to run zpool upgrade,
> because
> > after the system update reboot i ran into the issue.
> >
> > @Walter and @mike Regarding making a partition, I never see any
> > recommendation about this, I've been always using the entire disk on a
> pool
> > to expand it. Until FreeBSD 11.2 it worked fine.
> >
> > Is there a workaround for this or should I reinstall the entire pool?
> >
> > On Wed, Oct 21, 2020 at 4:45 PM mike tancsa  wrote:
> >
> > > Just a guess, Is your VM still trying to boot from whatever gpt/disk0
> is
> > > ? Or is it perhaps trying to boot from da1 or da2 which does not have
> > > boot info ?  Generally its not recommended to use the entire disk as
> > > part of a pool. Create a partition scheme first
> > >
> > > gpart create -s gpt da1
> > >
> > > gpart add -t freebsd-zfs da1
> > >
> > > then add da1p1 to the pool
> > >
> > > ---Mike
> > >
> > >
> > > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> > > > Hi there,
> > > >
> > > > Anyone can help please? I've many servers with this same issue.
> Thanks
> > > >
> > > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
> > > peixotocassi...@gmail.com>
> > > > wrote:
> > > >
> > > >> Hi there,
> > > >>
> > > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
> > > added two more disks to expand my pool. BTW I already did it many time
> > with
> > > no issues.
> > > >>
> > > >> I ran:
> > > >>
> > > >> # zpool status
> > > >>   pool: zroot
> > > >>  state: ONLINE
> > > >> status: Some supported features are not enabled on the pool. The
> pool
> > > can
> > > >>  still be used, but some features are unavailable.
> > > >> action: Enable all features using 'zpool upgrade'. Once this is
> done,
> > > >>  the pool may no longer be accessible by software that does not
> > > support
> > > >>  the features. See zpool-features(7) for details.
> > > >>   scan: none requested
> > > >> config:
> > > >>
> > > >>  NAME STATE READ WRITE CKSUM
> > > >>  zrootONLINE   0 0 0
> > > >>gpt/disk0  ONLINE   0 0 0
> > > >>
> > > >> errors: No known data errors
> > > >>
> > > >> # zpool add -f zroot da1
> > > >> # zpool add -f zroot da2
> > > >> # zpool status
> > > >>   pool: zroot
> > > >>  state: ONLINE
> > > >>   scan: none requested
> > > >> config:
> > > >>
> > > >>  NAME STATE READ WRITE CKSUM
> > > >>  zrootONLINE   0 0 0
> > > >>gpt/disk0  ONLINE   0 0 0
> > > >>da1ONLINE   0 0 0
> > > >>da2ONLINE   0 0 0
> > > >>
> > > >> errors: No known data errors
> > > >> # reboot
> > > >>
> > > >> Then my system doesn’t boot anymore, i got the following error:
> > > >>
> > > >> gptzfsboot: error 4 lba 2038346899
> > > >> gptzfsboot: error 4 lba 1361327267
> > > >> /boot/config: -Dh
> > > >>
> > > >> BTX loader 1.00  BTX version is 1.02
> > > >> Consoles: internal video/keyboard serial port
> > > >> BIOS drive A: is fd0
> > > >> BIOS drive C: is disk0
> > > >> BIOS drive D: is disk1
> > > >> BIOS drive E: is 

Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Walter Cramer
I very much doubt that there's any remotely sane way to re-partition da1 & 
da2 while they are in the pool.


If you carefully edit the output of the 'gpart backup' command, you 
probably can use 'gpart restore' to partition da1 and da2.  Read the 
'gpart' man page very carefully, if you aren't familiar with that.  Also, 
you'll probably want to install bootstrap code on da1 & da2 with 'gpart 
bootstrap'.


-Walter

On Wed, 21 Oct 2020, Cassiano Peixoto wrote:


Walter,


Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd.
But is there a way to make the partition of da1 and da2 since both are
already inserted on pool? I think it's not allowed...

Thanks.


On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer  wrote:


My guess - there is a work-around or two, but you'll face a lot more
grief, long-term, if you don't do things the right way (aka do a bunch of
re-install work) now.

I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to
see how the original disk is partitioned.  Then duplicate that
partitioning on da1 and da2.

-Walter

On Wed, 21 Oct 2020, Cassiano Peixoto wrote:

> Hi guys,

Thank your for your answer.

@Ricchard First of all I didn't have a chance to run zpool upgrade, because
after the system update reboot i ran into the issue.

@Walter and @mike Regarding making a partition, I never see any
recommendation about this, I've been always using the entire disk on a pool
to expand it. Until FreeBSD 11.2 it worked fine.

Is there a workaround for this or should I reinstall the entire pool?

On Wed, Oct 21, 2020 at 4:45 PM mike tancsa  wrote:

> Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is
> ? Or is it perhaps trying to boot from da1 or da2 which does not have
> boot info ?  Generally its not recommended to use the entire disk as
> part of a pool. Create a partition scheme first
>
> gpart create -s gpt da1
>
> gpart add -t freebsd-zfs da1
>
> then add da1p1 to the pool
>
> ---Mike
>
>
> On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> > Hi there,
> >
> > Anyone can help please? I've many servers with this same issue. Thanks
> >
> > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
> peixotocassi...@gmail.com>
> > wrote:
> >
> >> Hi there,
> >>
> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
> added two more disks to expand my pool. BTW I already did it many time
with
> no issues.
> >>
> >> I ran:
> >>
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >> status: Some supported features are not enabled on the pool. The pool
> can
> >>  still be used, but some features are unavailable.
> >> action: Enable all features using 'zpool upgrade'. Once this is done,
> >>  the pool may no longer be accessible by software that does not
> support
> >>  the features. See zpool-features(7) for details.
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >>
> >> # zpool add -f zroot da1
> >> # zpool add -f zroot da2
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>da1ONLINE   0 0 0
> >>da2ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >> # reboot
> >>
> >> Then my system doesn???t boot anymore, i got the following error:
> >>
> >> gptzfsboot: error 4 lba 2038346899
> >> gptzfsboot: error 4 lba 1361327267
> >> /boot/config: -Dh
> >>
> >> BTX loader 1.00  BTX version is 1.02
> >> Consoles: internal video/keyboard serial port
> >> BIOS drive A: is fd0
> >> BIOS drive C: is disk0
> >> BIOS drive D: is disk1
> >> BIOS drive E: is disk2
> >> BIOS drive F: is disk3
> >> BIOS drive G: is disk4
> >> BIOS drive H: is disk5
> >> ZFS: i/o error - all block copies unavailable
> >> ZFS: failed to read pool zroot directory object
> >> BIOS 638kB/3143616kB available memory
> >>
> >> FreeBSD/x86 bootstrap loader, Revision 1.1
> >> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
> >>
> >> Type '?' for list of commands, 'help' for more datailed help.
> >> OK
> >>
> >> I can import my pool with no problems using the lived, but I could not
> fix it.
> >>
> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
> >>
> >> Thanks.
> >>
> >>
> >>
> >>
> > ___
> > freebsd-stable@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> > To unsubscribe, send any mail to "
freebsd-stable-unsubscr...@freebsd.org
> "
> >
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To 

Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Cassiano Peixoto
Walter,

Yes, gpt/disk0 is da0. I can do the partition backup booting from livecd.
But is there a way to make the partition of da1 and da2 since both are
already inserted on pool? I think it's not allowed...

Thanks.


On Wed, Oct 21, 2020 at 5:18 PM Walter Cramer  wrote:

> My guess - there is a work-around or two, but you'll face a lot more
> grief, long-term, if you don't do things the right way (aka do a bunch of
> re-install work) now.
>
> I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to
> see how the original disk is partitioned.  Then duplicate that
> partitioning on da1 and da2.
>
> -Walter
>
> On Wed, 21 Oct 2020, Cassiano Peixoto wrote:
>
> > Hi guys,
>
> Thank your for your answer.
>
> @Ricchard First of all I didn't have a chance to run zpool upgrade, because
> after the system update reboot i ran into the issue.
>
> @Walter and @mike Regarding making a partition, I never see any
> recommendation about this, I've been always using the entire disk on a pool
> to expand it. Until FreeBSD 11.2 it worked fine.
>
> Is there a workaround for this or should I reinstall the entire pool?
>
> On Wed, Oct 21, 2020 at 4:45 PM mike tancsa  wrote:
>
> > Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is
> > ? Or is it perhaps trying to boot from da1 or da2 which does not have
> > boot info ?  Generally its not recommended to use the entire disk as
> > part of a pool. Create a partition scheme first
> >
> > gpart create -s gpt da1
> >
> > gpart add -t freebsd-zfs da1
> >
> > then add da1p1 to the pool
> >
> > ---Mike
> >
> >
> > On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> > > Hi there,
> > >
> > > Anyone can help please? I've many servers with this same issue. Thanks
> > >
> > > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
> > peixotocassi...@gmail.com>
> > > wrote:
> > >
> > >> Hi there,
> > >>
> > >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
> > added two more disks to expand my pool. BTW I already did it many time
> with
> > no issues.
> > >>
> > >> I ran:
> > >>
> > >> # zpool status
> > >>   pool: zroot
> > >>  state: ONLINE
> > >> status: Some supported features are not enabled on the pool. The pool
> > can
> > >>  still be used, but some features are unavailable.
> > >> action: Enable all features using 'zpool upgrade'. Once this is done,
> > >>  the pool may no longer be accessible by software that does not
> > support
> > >>  the features. See zpool-features(7) for details.
> > >>   scan: none requested
> > >> config:
> > >>
> > >>  NAME STATE READ WRITE CKSUM
> > >>  zrootONLINE   0 0 0
> > >>gpt/disk0  ONLINE   0 0 0
> > >>
> > >> errors: No known data errors
> > >>
> > >> # zpool add -f zroot da1
> > >> # zpool add -f zroot da2
> > >> # zpool status
> > >>   pool: zroot
> > >>  state: ONLINE
> > >>   scan: none requested
> > >> config:
> > >>
> > >>  NAME STATE READ WRITE CKSUM
> > >>  zrootONLINE   0 0 0
> > >>gpt/disk0  ONLINE   0 0 0
> > >>da1ONLINE   0 0 0
> > >>da2ONLINE   0 0 0
> > >>
> > >> errors: No known data errors
> > >> # reboot
> > >>
> > >> Then my system doesn’t boot anymore, i got the following error:
> > >>
> > >> gptzfsboot: error 4 lba 2038346899
> > >> gptzfsboot: error 4 lba 1361327267
> > >> /boot/config: -Dh
> > >>
> > >> BTX loader 1.00  BTX version is 1.02
> > >> Consoles: internal video/keyboard serial port
> > >> BIOS drive A: is fd0
> > >> BIOS drive C: is disk0
> > >> BIOS drive D: is disk1
> > >> BIOS drive E: is disk2
> > >> BIOS drive F: is disk3
> > >> BIOS drive G: is disk4
> > >> BIOS drive H: is disk5
> > >> ZFS: i/o error - all block copies unavailable
> > >> ZFS: failed to read pool zroot directory object
> > >> BIOS 638kB/3143616kB available memory
> > >>
> > >> FreeBSD/x86 bootstrap loader, Revision 1.1
> > >> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
> > >>
> > >> Type '?' for list of commands, 'help' for more datailed help.
> > >> OK
> > >>
> > >> I can import my pool with no problems using the lived, but I could not
> > fix it.
> > >>
> > >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
> > >>
> > >> Thanks.
> > >>
> > >>
> > >>
> > >>
> > > ___
> > > freebsd-stable@freebsd.org mailing list
> > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> > > To unsubscribe, send any mail to "
> freebsd-stable-unsubscr...@freebsd.org
> > "
> > >
> >
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
___
freebsd-stable@freebsd.org mailing list

Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Walter Cramer
My guess - there is a work-around or two, but you'll face a lot more 
grief, long-term, if you don't do things the right way (aka do a bunch of 
re-install work) now.


I'd start with 'gpart backup da0' (guessing that gpt/disk0 is on da0), to 
see how the original disk is partitioned.  Then duplicate that 
partitioning on da1 and da2.


-Walter

On Wed, 21 Oct 2020, Cassiano Peixoto wrote:


Hi guys,


Thank your for your answer.

@Ricchard First of all I didn't have a chance to run zpool upgrade, because
after the system update reboot i ran into the issue.

@Walter and @mike Regarding making a partition, I never see any
recommendation about this, I've been always using the entire disk on a pool
to expand it. Until FreeBSD 11.2 it worked fine.

Is there a workaround for this or should I reinstall the entire pool?

On Wed, Oct 21, 2020 at 4:45 PM mike tancsa  wrote:


Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is
? Or is it perhaps trying to boot from da1 or da2 which does not have
boot info ?  Generally its not recommended to use the entire disk as
part of a pool. Create a partition scheme first

gpart create -s gpt da1

gpart add -t freebsd-zfs da1

then add da1p1 to the pool

---Mike


On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> Hi there,
>
> Anyone can help please? I've many servers with this same issue. Thanks
>
> On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
peixotocassi...@gmail.com>
> wrote:
>
>> Hi there,
>>
>> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
added two more disks to expand my pool. BTW I already did it many time with
no issues.
>>
>> I ran:
>>
>> # zpool status
>>   pool: zroot
>>  state: ONLINE
>> status: Some supported features are not enabled on the pool. The pool
can
>>  still be used, but some features are unavailable.
>> action: Enable all features using 'zpool upgrade'. Once this is done,
>>  the pool may no longer be accessible by software that does not
support
>>  the features. See zpool-features(7) for details.
>>   scan: none requested
>> config:
>>
>>  NAME STATE READ WRITE CKSUM
>>  zrootONLINE   0 0 0
>>gpt/disk0  ONLINE   0 0 0
>>
>> errors: No known data errors
>>
>> # zpool add -f zroot da1
>> # zpool add -f zroot da2
>> # zpool status
>>   pool: zroot
>>  state: ONLINE
>>   scan: none requested
>> config:
>>
>>  NAME STATE READ WRITE CKSUM
>>  zrootONLINE   0 0 0
>>gpt/disk0  ONLINE   0 0 0
>>da1ONLINE   0 0 0
>>da2ONLINE   0 0 0
>>
>> errors: No known data errors
>> # reboot
>>
>> Then my system doesn???t boot anymore, i got the following error:
>>
>> gptzfsboot: error 4 lba 2038346899
>> gptzfsboot: error 4 lba 1361327267
>> /boot/config: -Dh
>>
>> BTX loader 1.00  BTX version is 1.02
>> Consoles: internal video/keyboard serial port
>> BIOS drive A: is fd0
>> BIOS drive C: is disk0
>> BIOS drive D: is disk1
>> BIOS drive E: is disk2
>> BIOS drive F: is disk3
>> BIOS drive G: is disk4
>> BIOS drive H: is disk5
>> ZFS: i/o error - all block copies unavailable
>> ZFS: failed to read pool zroot directory object
>> BIOS 638kB/3143616kB available memory
>>
>> FreeBSD/x86 bootstrap loader, Revision 1.1
>> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
>>
>> Type '?' for list of commands, 'help' for more datailed help.
>> OK
>>
>> I can import my pool with no problems using the lived, but I could not
fix it.
>>
>> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
>>
>> Thanks.
>>
>>
>>
>>
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org
"
>


___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Cassiano Peixoto
Hi guys,

Thank your for your answer.

@Ricchard First of all I didn't have a chance to run zpool upgrade, because
after the system update reboot i ran into the issue.

@Walter and @mike Regarding making a partition, I never see any
recommendation about this, I've been always using the entire disk on a pool
to expand it. Until FreeBSD 11.2 it worked fine.

Is there a workaround for this or should I reinstall the entire pool?

On Wed, Oct 21, 2020 at 4:45 PM mike tancsa  wrote:

> Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is
> ? Or is it perhaps trying to boot from da1 or da2 which does not have
> boot info ?  Generally its not recommended to use the entire disk as
> part of a pool. Create a partition scheme first
>
> gpart create -s gpt da1
>
> gpart add -t freebsd-zfs da1
>
> then add da1p1 to the pool
>
> ---Mike
>
>
> On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> > Hi there,
> >
> > Anyone can help please? I've many servers with this same issue. Thanks
> >
> > On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto <
> peixotocassi...@gmail.com>
> > wrote:
> >
> >> Hi there,
> >>
> >> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I
> added two more disks to expand my pool. BTW I already did it many time with
> no issues.
> >>
> >> I ran:
> >>
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >> status: Some supported features are not enabled on the pool. The pool
> can
> >>  still be used, but some features are unavailable.
> >> action: Enable all features using 'zpool upgrade'. Once this is done,
> >>  the pool may no longer be accessible by software that does not
> support
> >>  the features. See zpool-features(7) for details.
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >>
> >> # zpool add -f zroot da1
> >> # zpool add -f zroot da2
> >> # zpool status
> >>   pool: zroot
> >>  state: ONLINE
> >>   scan: none requested
> >> config:
> >>
> >>  NAME STATE READ WRITE CKSUM
> >>  zrootONLINE   0 0 0
> >>gpt/disk0  ONLINE   0 0 0
> >>da1ONLINE   0 0 0
> >>da2ONLINE   0 0 0
> >>
> >> errors: No known data errors
> >> # reboot
> >>
> >> Then my system doesn’t boot anymore, i got the following error:
> >>
> >> gptzfsboot: error 4 lba 2038346899
> >> gptzfsboot: error 4 lba 1361327267
> >> /boot/config: -Dh
> >>
> >> BTX loader 1.00  BTX version is 1.02
> >> Consoles: internal video/keyboard serial port
> >> BIOS drive A: is fd0
> >> BIOS drive C: is disk0
> >> BIOS drive D: is disk1
> >> BIOS drive E: is disk2
> >> BIOS drive F: is disk3
> >> BIOS drive G: is disk4
> >> BIOS drive H: is disk5
> >> ZFS: i/o error - all block copies unavailable
> >> ZFS: failed to read pool zroot directory object
> >> BIOS 638kB/3143616kB available memory
> >>
> >> FreeBSD/x86 bootstrap loader, Revision 1.1
> >> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
> >>
> >> Type '?' for list of commands, 'help' for more datailed help.
> >> OK
> >>
> >> I can import my pool with no problems using the lived, but I could not
> fix it.
> >>
> >> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
> >>
> >> Thanks.
> >>
> >>
> >>
> >>
> > ___
> > freebsd-stable@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org
> "
> >
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread mike tancsa
Just a guess, Is your VM still trying to boot from whatever gpt/disk0 is
? Or is it perhaps trying to boot from da1 or da2 which does not have
boot info ?  Generally its not recommended to use the entire disk as
part of a pool. Create a partition scheme first

gpart create -s gpt da1

gpart add -t freebsd-zfs da1

then add da1p1 to the pool

    ---Mike


On 10/21/2020 8:20 AM, Cassiano Peixoto wrote:
> Hi there,
>
> Anyone can help please? I've many servers with this same issue. Thanks
>
> On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto 
> wrote:
>
>> Hi there,
>>
>> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added 
>> two more disks to expand my pool. BTW I already did it many time with no 
>> issues.
>>
>> I ran:
>>
>> # zpool status
>>   pool: zroot
>>  state: ONLINE
>> status: Some supported features are not enabled on the pool. The pool can
>>  still be used, but some features are unavailable.
>> action: Enable all features using 'zpool upgrade'. Once this is done,
>>  the pool may no longer be accessible by software that does not support
>>  the features. See zpool-features(7) for details.
>>   scan: none requested
>> config:
>>
>>  NAME STATE READ WRITE CKSUM
>>  zrootONLINE   0 0 0
>>gpt/disk0  ONLINE   0 0 0
>>
>> errors: No known data errors
>>
>> # zpool add -f zroot da1
>> # zpool add -f zroot da2
>> # zpool status
>>   pool: zroot
>>  state: ONLINE
>>   scan: none requested
>> config:
>>
>>  NAME STATE READ WRITE CKSUM
>>  zrootONLINE   0 0 0
>>gpt/disk0  ONLINE   0 0 0
>>da1ONLINE   0 0 0
>>da2ONLINE   0 0 0
>>
>> errors: No known data errors
>> # reboot
>>
>> Then my system doesn’t boot anymore, i got the following error:
>>
>> gptzfsboot: error 4 lba 2038346899
>> gptzfsboot: error 4 lba 1361327267
>> /boot/config: -Dh
>>
>> BTX loader 1.00  BTX version is 1.02
>> Consoles: internal video/keyboard serial port
>> BIOS drive A: is fd0
>> BIOS drive C: is disk0
>> BIOS drive D: is disk1
>> BIOS drive E: is disk2
>> BIOS drive F: is disk3
>> BIOS drive G: is disk4
>> BIOS drive H: is disk5
>> ZFS: i/o error - all block copies unavailable
>> ZFS: failed to read pool zroot directory object
>> BIOS 638kB/3143616kB available memory
>>
>> FreeBSD/x86 bootstrap loader, Revision 1.1
>> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
>>
>> Type '?' for list of commands, 'help' for more datailed help.
>> OK
>>
>> I can import my pool with no problems using the lived, but I could not fix 
>> it.
>>
>> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
>>
>> Thanks.
>>
>>
>>
>>
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: mmap and MAP_STACK

2020-10-21 Thread Nick Kostirya via freebsd-stable
On Wed, 21 Oct 2020 18:28:44 +0300
Konstantin Belousov  wrote:


> > 
> > kdump with MAP_STACK.
> > 
> >  87183 polyimport CALL  
> > mmap(0,0x1000,0x3,0x1402,0x,0,0)
> >  87183 polyimport RET   mmap -1 errno 22 Invalid argument  
> So it is anything but 'insufficient memory' (I suspected ENOMEM).
> EINVAL there is because sysctl security.bsd.stack_guard_page default value
> is 1, which means that at least one page of the stack is reserved as guard.
> Kernel does not allow to map stack that would have no data pages (all pages
> are guard).
> 
> Your mapping request is for one page, and one page is due to guard, so
> you get EINVAL.  Generally MAP_STACK is magic and requires caller to know
> what it does.

Thanks!
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: mmap and MAP_STACK

2020-10-21 Thread Konstantin Belousov
On Wed, Oct 21, 2020 at 06:18:50PM +0300, Nick Kostirya via freebsd-stable 
wrote:
> On Wed, 21 Oct 2020 17:16:57 +0300
> Konstantin Belousov  wrote:
> 
> > On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable 
> > wrote:
> > > Hello.
> > > I have question about mmap.
> > > 
> > > void *OSMem::AllocateDataArea(size_t )
> > > {
> > > // Round up to an integral number of pages.
> > > space = (space + pageSize-1) & ~(pageSize-1);
> > > int fd = -1; // This value is required by FreeBSD.  Linux doesn't care
> > > int flags = MAP_PRIVATE | MAP_ANON;
> > > #ifdef MAP_STACK
> > > if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to 
> > > require this
> > > #endif
> > > void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0);
> > > // Convert MAP_FAILED (-1) into NULL
> > > if (result == MAP_FAILED)
> > > return 0;
> > > return result;
> > > }
> > > 
> > > 
> > > When MAP_STACK is used, "insufficient memory" error occurs.
> > > When MAP_STACK removed, it is all right.
> > > 
> > > Please tell me why.  
> > Show ktrace/kdump output of the mmap(2) without and with MAP_STACK.
> > 
> > Or provide a minimal self-contained C source that demonstrates your
> > issue.
> 
> kdump with MAP_STACK.
> 
>  87183 polyimport CALL  
> mmap(0,0x1000,0x3,0x1402,0x,0,0)
>  87183 polyimport RET   mmap -1 errno 22 Invalid argument
So it is anything but 'insufficient memory' (I suspected ENOMEM).
EINVAL there is because sysctl security.bsd.stack_guard_page default value
is 1, which means that at least one page of the stack is reserved as guard.
Kernel does not allow to map stack that would have no data pages (all pages
are guard).

Your mapping request is for one page, and one page is due to guard, so
you get EINVAL.  Generally MAP_STACK is magic and requires caller to know
what it does.

> 
> 
> kdump without MAP_STACK.
> 
>  93712 polyimport CALL  
> mmap(0,0x1000,0x3,0x1002,0x,0,0)
>  93712 polyimport RET   mmap 547053568/0x209b6000
> 
> 
> 
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: mmap and MAP_STACK

2020-10-21 Thread Nick Kostirya via freebsd-stable
On Wed, 21 Oct 2020 17:16:57 +0300
Konstantin Belousov  wrote:

> On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable 
> wrote:
> > Hello.
> > I have question about mmap.
> > 
> > void *OSMem::AllocateDataArea(size_t )
> > {
> > // Round up to an integral number of pages.
> > space = (space + pageSize-1) & ~(pageSize-1);
> > int fd = -1; // This value is required by FreeBSD.  Linux doesn't care
> > int flags = MAP_PRIVATE | MAP_ANON;
> > #ifdef MAP_STACK
> > if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to 
> > require this
> > #endif
> > void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0);
> > // Convert MAP_FAILED (-1) into NULL
> > if (result == MAP_FAILED)
> > return 0;
> > return result;
> > }
> > 
> > 
> > When MAP_STACK is used, "insufficient memory" error occurs.
> > When MAP_STACK removed, it is all right.
> > 
> > Please tell me why.  
> Show ktrace/kdump output of the mmap(2) without and with MAP_STACK.
> 
> Or provide a minimal self-contained C source that demonstrates your
> issue.

kdump with MAP_STACK.

 87183 polyimport CALL  
mmap(0,0x1000,0x3,0x1402,0x,0,0)
 87183 polyimport RET   mmap -1 errno 22 Invalid argument


kdump without MAP_STACK.

 93712 polyimport CALL  
mmap(0,0x1000,0x3,0x1002,0x,0,0)
 93712 polyimport RET   mmap 547053568/0x209b6000



___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: mmap and MAP_STACK

2020-10-21 Thread Konstantin Belousov
On Wed, Oct 21, 2020 at 04:53:11PM +0300, Nick Kostirya via freebsd-stable 
wrote:
> Hello.
> I have question about mmap.
> 
> void *OSMem::AllocateDataArea(size_t )
> {
> // Round up to an integral number of pages.
> space = (space + pageSize-1) & ~(pageSize-1);
> int fd = -1; // This value is required by FreeBSD.  Linux doesn't care
> int flags = MAP_PRIVATE | MAP_ANON;
> #ifdef MAP_STACK
> if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to 
> require this
> #endif
> void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0);
> // Convert MAP_FAILED (-1) into NULL
> if (result == MAP_FAILED)
> return 0;
> return result;
> }
> 
> 
> When MAP_STACK is used, "insufficient memory" error occurs.
> When MAP_STACK removed, it is all right.
> 
> Please tell me why.
Show ktrace/kdump output of the mmap(2) without and with MAP_STACK.

Or provide a minimal self-contained C source that demonstrates your
issue.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


mmap and MAP_STACK

2020-10-21 Thread Nick Kostirya via freebsd-stable
Hello.
I have question about mmap.

void *OSMem::AllocateDataArea(size_t )
{
// Round up to an integral number of pages.
space = (space + pageSize-1) & ~(pageSize-1);
int fd = -1; // This value is required by FreeBSD.  Linux doesn't care
int flags = MAP_PRIVATE | MAP_ANON;
#ifdef MAP_STACK
if (memUsage == UsageStack) flags |= MAP_STACK; // OpenBSD seems to require 
this
#endif
void *result = mmap(0, space, PROT_READ|PROT_WRITE, flags, fd, 0);
// Convert MAP_FAILED (-1) into NULL
if (result == MAP_FAILED)
return 0;
return result;
}


When MAP_STACK is used, "insufficient memory" error occurs.
When MAP_STACK removed, it is all right.

Please tell me why.
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: Zpool doesn't boot anymore after FreeBSD 12.1

2020-10-21 Thread Cassiano Peixoto
Hi there,

Anyone can help please? I've many servers with this same issue. Thanks

On Fri, Oct 16, 2020 at 10:24 AM Cassiano Peixoto 
wrote:

> Hi there,
>
> I have a FreeBSD 12.1-STABLE running on VMWARE with one disk. Then I added 
> two more disks to expand my pool. BTW I already did it many time with no 
> issues.
>
> I ran:
>
> # zpool status
>   pool: zroot
>  state: ONLINE
> status: Some supported features are not enabled on the pool. The pool can
>   still be used, but some features are unavailable.
> action: Enable all features using 'zpool upgrade'. Once this is done,
>   the pool may no longer be accessible by software that does not support
>   the features. See zpool-features(7) for details.
>   scan: none requested
> config:
>
>   NAME STATE READ WRITE CKSUM
>   zrootONLINE   0 0 0
> gpt/disk0  ONLINE   0 0 0
>
> errors: No known data errors
>
> # zpool add -f zroot da1
> # zpool add -f zroot da2
> # zpool status
>   pool: zroot
>  state: ONLINE
>   scan: none requested
> config:
>
>   NAME STATE READ WRITE CKSUM
>   zrootONLINE   0 0 0
> gpt/disk0  ONLINE   0 0 0
> da1ONLINE   0 0 0
> da2ONLINE   0 0 0
>
> errors: No known data errors
> # reboot
>
> Then my system doesn’t boot anymore, i got the following error:
>
> gptzfsboot: error 4 lba 2038346899
> gptzfsboot: error 4 lba 1361327267
> /boot/config: -Dh
>
> BTX loader 1.00  BTX version is 1.02
> Consoles: internal video/keyboard serial port
> BIOS drive A: is fd0
> BIOS drive C: is disk0
> BIOS drive D: is disk1
> BIOS drive E: is disk2
> BIOS drive F: is disk3
> BIOS drive G: is disk4
> BIOS drive H: is disk5
> ZFS: i/o error - all block copies unavailable
> ZFS: failed to read pool zroot directory object
> BIOS 638kB/3143616kB available memory
>
> FreeBSD/x86 bootstrap loader, Revision 1.1
> ERROR: cannot open /boot/lua/loader.lua: invalid argument.
>
> Type '?' for list of commands, 'help' for more datailed help.
> OK
>
> I can import my pool with no problems using the lived, but I could not fix it.
>
> Seems a bug after 12.1-STABLE. Please, anyone can take a look ok that?
>
> Thanks.
>
>
>
>
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"