Re: Panic in getblkx() booting from disc1.iso in Qemu VM

2018-12-20 Thread Kirk McKusick
Thanks Rebecca for the report and Mark for the analysis of the problem.
This should be fixed in -r342290.

Kirk McKusick

=-=-=

From:Kirk McKusick 
Date:Fri, 21 Dec 2018 01:09:25 + (UTC)
To:  src-committ...@freebsd.org, svn-src-...@freebsd.org,
 svn-src-h...@freebsd.org
Subject: svn commit: r342290 - head/sys/kern

Author: mckusick
Date: Fri Dec 21 01:09:25 2018
New Revision: 342290
URL: https://svnweb.freebsd.org/changeset/base/342290

Log:
  Some filesystems (like cd9660 and ext3) require that VFS_STATFS()
  be called before VFS_ROOT() is called. Move the call for VFS_STATFS()
  so that it is done after VFS_MOUNT(), but before VFS_ROOT().
  This change actually improves the robustness of the mount system
  call because it returns an error rather than failing silently
  when VFS_STATFS() returns failure.
  
  Reported by:  Rebecca Cran 
  Sponsored by: Netflix

Modified:
  head/sys/kern/vfs_mount.c

Modified: head/sys/kern/vfs_mount.c
==
--- head/sys/kern/vfs_mount.c   Thu Dec 20 22:39:58 2018(r342289)
+++ head/sys/kern/vfs_mount.c   Fri Dec 21 01:09:25 2018(r342290)
@@ -895,6 +895,7 @@ vfs_domount_first(
 */
error1 = 0;
if ((error = VFS_MOUNT(mp)) != 0 ||
+   (error1 = VFS_STATFS(mp, >mnt_stat)) != 0 ||
(error1 = VFS_ROOT(mp, LK_EXCLUSIVE, )) != 0) {
if (error1 != 0) {
error = error1;
@@ -916,7 +917,6 @@ vfs_domount_first(
vfs_freeopts(mp->mnt_opt);
mp->mnt_opt = mp->mnt_optnew;
*optlist = NULL;
-   (void)VFS_STATFS(mp, >mnt_stat);
 
/*
 * Prevent external consumers of mount options from reading mnt_optnew.

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Matthew Macy
On Thu, Dec 20, 2018 at 03:11 Eugene M. Zheganin  wrote:

> Hello,
>
> On 19.12.2018 23:32, Allan Jude wrote:
> > The biggest thing to remember is that this is still OpenZFS, and still
> > run by the same developers as it has been. We are just commonizing on
> > the repo that has the most features integrated into it.
>
> Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because
> there is no such thing in ZoL ?



No, but the ZTS will need to have ACL tests re-added. Please help out by
aiding in getting this merged:

https://github.com/zfsonlinux/zfs/pull/7728

Thanks.
-M
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Matthew Macy
On Thu, Dec 20, 2018 at 06:39 Alexey Dokuchaev  wrote:

> On Thu, Dec 20, 2018 at 03:49:38PM +0500, Eugene M. Zheganin wrote:
> > On 19.12.2018 23:32, Allan Jude wrote:
> > > The biggest thing to remember is that this is still OpenZFS, and still
> > > run by the same developers as it has been. We are just commonizing on
> > > the repo that has the most features integrated into it.
> >
> > Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because
> > there is no such thing in ZoL?


> +1.  I'm also worried if this would bring more Linuxish bits into our
> kernel (cf. LinuxKPI).  Also, I thought that ZFS was never really native
> to Linux but implemented through SPL (Solaris Porting Layer), and Linux'
> VFS is not ARC-aware unlike Solaris and FreeBSD.
>

There is no LinuxKPI involved here. Please re-read Allan’s comments on
directory structuring. No open source OS supporting ZFS has a VM subsystem
that is integrated with the ARC. The limited feedback that the ARC has from
FreeBSD’s VM will remain unchanged.



> It would be quite upsetting to see ZFS as we know it in FreeBSD become
> pessimized because of those things. :-(
>

ZFS will be no more pessimized than it currently is. Talk to mjg some time
about ZFS some time, there are ... scaling issues in its locking
strategies. Apart from that FreeBSD’s VFS itself has serious scaling. None
of this will get better or worse when we change the vendor repo we use for
integrating changes.

-M
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Warner Losh
On Thu, Dec 20, 2018 at 1:49 PM Allan Jude  wrote:

> I am to give a big thanks to Matt Ahrens for organizing the monthly
> OpenZFS Leadership meeting, and the OpenZFS developer summit, and to
> Brian Behlendorf for being so helpful, and willing to work to make
> OpenZFS better for everyone.
>

I'd recommend the monthly leadership meetings. They dispelled any doubt
that I had that there were overly powerful factions present that would
disadvantage FreeBSD. The calls were worthwhile to understand the context
of a number of other things being discussed. It seems much healthier in
this context than things I've seen in the Illumos context because of a lack
of burdensome process that provided no benefit and actually got in the way
(which honestly, was my expectations going into the meeting).

There's good reason to trust OpenZFS, it's leadership and decision making
process. If ZoL is the best upstream source, then I trust their judgement
on that, regardless of the hassles it will cause us in the coming months.
>From the discussions I've seen, there is no pain-free choice that doesn't
relegate FreeBSD to a backwater of what we have today.

Warner
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Allan Jude

On 12/19/2018 13:32, Allan Jude wrote:

Today, the OpenZFS repo is just a fork of the illumos-gate repo, but
where pull requests are accepted, and where previous Delphix employees


This should say 'previously', Prakash Surya and Matt Ahrens still work 
at Delphix.



would deal with the process of trying to upstream patches to illumos.
This process has not worked well recently, as things have gotten stuck
waiting for 'merge advocates' in illumos.



The major stumbling block was the lack of modern test infrastructure.
Obviously depending on one or two people to merge stuff was a bottleneck 
as those people inevitably get busy.




Anyway, the point is that this doesn't make FreeBSD any more dependent 
on Linux. The goal is this project is to continue to make it easier and 
easier to port OpenZFS and its new features to all platforms (illumos, 
FreeBSD, Linux, OS X, Windows, NetBSD, etc), and to ensure that new 
features arrive in a timely fashion in all of the platforms.


Unifying on a single CI setup saves duplication of effort, and ensures 
that changes can easily be tested on all of the platforms.


This is a project is a good thing, it ensures that FreeBSD will keep 
current on OpenZFS going forward, and helps improve the entire OpenZFS 
ecosystem.


I am to give a big thanks to Matt Ahrens for organizing the monthly 
OpenZFS Leadership meeting, and the OpenZFS developer summit, and to 
Brian Behlendorf for being so helpful, and willing to work to make 
OpenZFS better for everyone.


--
Allan Jude
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: FreeBSD head -r341836 amd64->aarch64 cross-build of -r484783 ports via poudriere: devel/qt5-testlib hung-up during "Checking for POSIX monotonic clock"

2018-12-20 Thread Mark Millard
[A amd64->armv7 cross build shows interesting hang-up behavior as
well, apparently highly repeatable for my current context.]

On 2018-Dec-19, at 16:21, Mark Millard  wrote:

> [I attached to the hung-up process with gdb and looked around a little.]
> 
> On 2018-Dec-19, at 13:58, Mark Millard  wrote:
> 
>> [Looks like a race or some such for devel/qt5-testlib: retry of 
>> poudreire-devel
>> did not hang. The other hang-up seems to be repeating and I give some 
>> details.]
>> 
>> On 2018-Dec-19, at 12:20, Mark Millard  wrote:
>> 
>>> FYI: Based on FreeBSD head -r341836 (host and target) and ports -r484783 . 
>>> This
>>> was a rebuild based on going from perl5.26 to perl5.28 without updating the 
>>> ports
>>> tree and from system clang 6 for the prior FreeBSD-head context used to 
>>> clang 7
>>> this time. (I'm not attributing causes here.) poudriere was using 
>>> amd64-native
>>> tools for speeding up the cross-build.
>>> 
>>> # grep -r =perl5= /etc/ ~/src.configs/ /usr/local/etc/
>>> /etc/make.conf:DEFAULT_VERSIONS+=perl5=5.28 gcc=8
>>> /usr/local/etc/poudriere.d/make.conf:DEFAULT_VERSIONS+=perl5=5.28 gcc=8
>>> 
>>> There was also a "print/texinfo:configure/runaway" but I've not looked into
>>> it at all yet and it may be a while before I do. The other ports attempted
>>> built fine as far as I can tell so far.
>>> 
>>> 
>>> The devel/qt5-testlib failure looks like:
>>> 
>>> [00:00:13] Building 123 packages using 28 builders
>>> . . .
>>> [00:49:30] [10] [00:00:00] Building devel/qt5-testlib | qt5-testlib-5.11.2
>>> . . .
>>> [07:31:31] [10] [06:42:01] Saved devel/qt5-testlib | qt5-testlib-5.11.2 
>>> wrkdir to: 
>>> /usr/local/poudriere/data/wrkdirs/FBSDFSSDjailCortexA57-default/default/qt5-testlib-5.11.2.tar
>>> [07:31:32] [10] [06:42:02] Finished devel/qt5-testlib | qt5-testlib-5.11.2: 
>>> Failed: configure/runaway
>>> 
>>> With logs/errors/qt5-testlib-5.11.2.log showing:
>>> 
>>> Checking for POSIX monotonic clock... 
>>> + cd 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>>  && 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/bin/qmake
>>>  "CONFIG -= qt debug_and_release app_bundle lib_bundle" "CONFIG += shared 
>>> warn_off console single_arch" 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>> + cd 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>>  && MAKEFLAGS= make
>>> =>> Killing runaway build after 21600 seconds with no output
>>> =>> Cleaning up wrkdir
>>> ===>  Cleaning for qt5-testlib-5.11.2
>>> Killed
>>> build of devel/qt5-testlib | qt5-testlib-5.11.2 ended at Wed Dec 19 
>>> 06:45:42 PST 2018
>>> build time: 06:41:46
>>> !!! build failure encountered !!!
>>> 
>>> 
>>> # less 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.log
>>> . . .
>>> test config.qtbase_corelib.libraries.librt succeeded
>>> executing config test clock-monotonic
>>> + cd 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>>  && 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/bin/qmake
>>>  "CONFIG -= qt debug_and_release app_bundle lib_bundle" "CONFIG += shared 
>>> warn_off console single_arch" 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>> + cd 
>>> /wrkdirs/usr/ports/devel/qt5-testlib/work/qtbase-everywhere-src-5.11.2/config.tests/clock-monotonic
>>>  && MAKEFLAGS= make
>>> 
>>> 
>>> Some supporting details of context:
>>> 
>>> # uname -apKU
>>> FreeBSD FBSDFSSD 13.0-CURRENT FreeBSD 13.0-CURRENT #5 r341836M: Tue Dec 11 
>>> 16:37:42 PST 2018 
>>> markmi@FBSDFSSD:/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/sys/GENERIC-NODBG
>>>   amd64 amd64 135 135
>>> 
>>> # svnlite info /usr/ports/ | grep "Re[plv]"
>>> Relative URL: ^/head
>>> Repository Root: svn://svn.freebsd.org/ports
>>> Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5
>>> Revision: 484783
>>> Last Changed Rev: 484783
>>> 
>> 
>> I started poudriere up again with just the 2 needing to be rebuilt (plus
>> what depends on the 2). devel/qt5-testlib quickly completed just fine:
>> 
>> [00:02:16] [02] [00:00:00] Building devel/qt5-testlib | qt5-testlib-5.11.2
>> [00:04:54] [02] [00:02:38] Finished devel/qt5-testlib | qt5-testlib-5.11.2: 
>> Success
>> 
>> 
>> In the prior build that had the hang-ups I looked and dor print/texinfo :
>> 
>> /wrkdirs/usr/ports/print/texinfo/work/texinfo-6.5/config.log shows for its
>> hang-up:
>> 
>> . . .
>> configure:6639: checking for alloca
>> configure:6676: /nxb-bin/usr/bin/cc -o conftest -O2 -pipe -mcpu=cortex-a57  
>> -DLIBICONV_PLUG -g -fno-strict-aliasing  -mcpu=cortex-a57 -DLIBICONV_PLUG 
>> -D_THREAD_SAFE   conftest.c  >&5
>> configure:6676: $? = 0
>> configure:6684: result: yes
>> configure:6794: checking for 

Re: The future of ZFS in FreeBSD

2018-12-20 Thread Matthew Macy
On Thu, Dec 20, 2018 at 9:33 AM Warner Losh  wrote:
>
>
> Matt,
>
> This is a fairly comprehensive plan. Kudos for putting it together.
>
> The big question here is do you have a complete list of FreeBSD-specific 
> changes that will be lost in the cut-over? We've heard about TRIM support and 
> maybe NFSv4, but are there others that can be identified?
>
> Once you have that list, it wouldn't be hard to throw the initial email with 
> some tweaks from the replies into a FCP so everybody knows the plan, and we 
> have it ratified in case people come along later and 'forget'.

The general intent is that we not lose anything. TRIM is the only
piece of code that really needs resolution upstream causing us to lose
it temporarily. Failure to upstream FreeBSD's TRIM support has been a
recurring source of bugs when integrating new features. As for NFSv4
I've forked the ACL bits in to the OS dependent code - I'll make a
note to make sure that nothing regresses there. This is yet another
example of why there will be a 3 month period for users to try the
port before we cut over.

-M
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: Panic in getblkx() booting from disc1.iso in Qemu VM

2018-12-20 Thread Mark Johnston
On Thu, Dec 20, 2018 at 10:33:20AM -0700, Rebecca Cran wrote:
> I know booting from the cd/dvd iso worked fairly recently, but today booting 
> a 
> new build of -CURRENT in a Qemu VM resulted in a panic:
> 
> FreeBSD 13.0-CURRENT 19a6ceb89db(HEAD) GENERIC amd64
> FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 
> 7.0.1)
> WARNING: WITNESS option enabled, expect reduced performance.
> VT(efifb): resolution 800x600
> CPU: QEMU Virtual CPU version 2.5+ (2994.86-MHz K8-class CPU)
>   Origin="AuthenticAMD"  Id=0x663  Family=0x6  Model=0x6  Stepping=3
>   
> Features=0x783fbfd
>   Features2=0x80002001
>   AMD Features=0x20100800
>   AMD Features2=0x5
>   SVM: NAsids=16
> Hypervisor: Origin = "TCGTCGTCGTCG"
> real memory  = 8589934592 (8192 MB)
> avail memory = 8227643392 (7846 MB)
> 
> ...
> 
> WARNING: WITNESS option enabled, expect reduced performance.
> Trying to mount root from cd9660:/dev/iso9660/13_0_CURRENT_AMD64_DVD [ro]...
> panic: bsize == 0, check bo->bo_bsize
> cpuid = 0
> time = 2
> KDB: stack backtrace:
> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfe0041189270
> vpanic() at vpanic+0x1b4/frame 0xfe00411892d0
> panic() at panic+0x43/frame 0xfe0041189330
> getblkx() at getblkx+0x807/frame 0xfe00411893f0
> breadn_flags() at breadn_flags+0x3d/frame 0xfe0041189460
> cd9660_blkatoff() at cd9660_blkatoff+0x53/frame 0xfe00411894d0
> cd9660_vget_internal() at cd9660_vget_internal+0x26b/frame 0xfe0041189550
> vfs_domount() at vfs_domount+0x7d3/frame 0xfe0041189770
> vfs_donmount() at vfs_donmount+0x7b9/frame 0xfe0041189810
> kernel_mount() at kernel_mount+0x58/frame 0xfe0041189860
> parse_mount() at parse_mount+0x469/frame 0xfe00411899a0
> vfs_mountroot() at vfs_mountroot+0x67f/frame 0xfe0041189b10
> start_init() at start_init+0x28/frame 0xfe0041189bb0
> fork_exit() at fork_exit+0x84/frame 0xfe0041189bf0
> fork_trampoline() at fork_trampoline+0xe/frame 0xfe0041189bf0

Peter reported the same problem with ext2.  I believe this is a
regression from r342135, which moved a VFS_ROOT call before VFS_STATFS.
For most filesystems, VFS_STATFS is the place where mp->mnt_stat is
initialized, so the problem arises because mnt_stat.f_iosize is still
0 when the root vnode is initialized.  UFS initializes mnt_stat.f_iosize
in its VFS_MOUNT implementation, so it is immune to this problem.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: AESNI, /dev/crypto, and new OpenSSL

2018-12-20 Thread Alexey Dokuchaev
On Thu, Dec 20, 2018 at 09:33:41AM -0800, Freddie Cash wrote:
> On Thu, Dec 20, 2018 at 9:21 AM Alexey Dokuchaev  wrote:
> > Had something got broken here, or I'm misunderstanding how this machinery
> > now works?
> 
> Start reading here:
> 
> https://lists.freebsd.org/pipermail/freebsd-stable/2018-December/090195.html
> 
> That thread covers this issue.  :)  Along with the "fix" for it.

Thanks for the pointer.  I've checked both -current and -hackers MLs prior
to posting, but didn't expect this would show up on -stable first. :)

./danfe
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: AESNI, /dev/crypto, and new OpenSSL

2018-12-20 Thread Freddie Cash
On Thu, Dec 20, 2018 at 9:21 AM Alexey Dokuchaev  wrote:

> Had something got broken here, or I'm misunderstanding how this machinery
> now works?
>

Start reading here:

https://lists.freebsd.org/pipermail/freebsd-stable/2018-December/090195.html

That thread covers this issue.  :)  Along with the "fix" for it.

-- 
Freddie Cash
fjwc...@gmail.com
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Panic in getblkx() booting from disc1.iso in Qemu VM

2018-12-20 Thread Rebecca Cran
I know booting from the cd/dvd iso worked fairly recently, but today booting a 
new build of -CURRENT in a Qemu VM resulted in a panic:

FreeBSD 13.0-CURRENT 19a6ceb89db(HEAD) GENERIC amd64
FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 
7.0.1)
WARNING: WITNESS option enabled, expect reduced performance.
VT(efifb): resolution 800x600
CPU: QEMU Virtual CPU version 2.5+ (2994.86-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x663  Family=0x6  Model=0x6  Stepping=3
  
Features=0x783fbfd
  Features2=0x80002001
  AMD Features=0x20100800
  AMD Features2=0x5
  SVM: NAsids=16
Hypervisor: Origin = "TCGTCGTCGTCG"
real memory  = 8589934592 (8192 MB)
avail memory = 8227643392 (7846 MB)

...

WARNING: WITNESS option enabled, expect reduced performance.
Trying to mount root from cd9660:/dev/iso9660/13_0_CURRENT_AMD64_DVD [ro]...
panic: bsize == 0, check bo->bo_bsize
cpuid = 0
time = 2
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfe0041189270
vpanic() at vpanic+0x1b4/frame 0xfe00411892d0
panic() at panic+0x43/frame 0xfe0041189330
getblkx() at getblkx+0x807/frame 0xfe00411893f0
breadn_flags() at breadn_flags+0x3d/frame 0xfe0041189460
cd9660_blkatoff() at cd9660_blkatoff+0x53/frame 0xfe00411894d0
cd9660_vget_internal() at cd9660_vget_internal+0x26b/frame 0xfe0041189550
vfs_domount() at vfs_domount+0x7d3/frame 0xfe0041189770
vfs_donmount() at vfs_donmount+0x7b9/frame 0xfe0041189810
kernel_mount() at kernel_mount+0x58/frame 0xfe0041189860
parse_mount() at parse_mount+0x469/frame 0xfe00411899a0
vfs_mountroot() at vfs_mountroot+0x67f/frame 0xfe0041189b10
start_init() at start_init+0x28/frame 0xfe0041189bb0
fork_exit() at fork_exit+0x84/frame 0xfe0041189bf0
fork_trampoline() at fork_trampoline+0xe/frame 0xfe0041189bf0
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 1 tid 12 ]
Stopped at  kdb_enter+0x3b: movq$0,kdb_why
db> 


-- 
Rebecca


___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Warner Losh
Matt,

This is a fairly comprehensive plan. Kudos for putting it together.

The big question here is do you have a complete list of FreeBSD-specific
changes that will be lost in the cut-over? We've heard about TRIM support
and maybe NFSv4, but are there others that can be identified?

Once you have that list, it wouldn't be hard to throw the initial email
with some tweaks from the replies into a FCP so everybody knows the plan,
and we have it ratified in case people come along later and 'forget'.

Warner
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Dennis Glatting
On Thu, 2018-12-20 at 08:15 -0800, Cy Schubert wrote:
> I also think people will not accept regressions or other POLA
> violations.

+1



___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


AESNI, /dev/crypto, and new OpenSSL

2018-12-20 Thread Alexey Dokuchaev
Hi there,

For many years, OpenSSL was quite vocal about which hw-accelerated algos
it can use:

$ uname -UK
1200058 1200058
$ openssl version
OpenSSL 1.0.2n-freebsd  7 Dec 2017

$ openssl engine -c -t
(cryptodev) BSD cryptodev engine
 [RSA, DSA, DH] <<< word count = 3
 [ available ]
(dynamic) Dynamic engine loading support
 [ unavailable ]

# kldload aesni <<< loading AESNI(4)

$ openssl engine -c -t
(cryptodev) BSD cryptodev engine
 [RSA, DSA, DH, AES-128-CBC, AES-192-CBC, AES-256-CBC]  <<< word count = 6
 [ available ]
(dynamic) Dynamic engine loading support
 [ unavailable ]

Since recently[*], OpenSSL had switched to some new engine.  Now, the
output is less verbose and seemingly unaffected by the presence of the
aesni.ko module (or lack thereof):

$ uname -UK
135 135
$ openssl version
OpenSSL 1.1.1a-freebsd  20 Nov 2018

$ openssl engine -c -t
(devcrypto) /dev/crypto engine
 [ available ]  <<< which ones???
(dynamic) Dynamic engine loading support
 [ unavailable ]

This does not look right.  Also, now the popular "openssl speed -elapsed"
benchmark apparently does not use kernel AESNI support even when it is
loaded, because `system' CPU load is nearly zero (previously, in presence
of aesni.ko, user load would drop to zero while system load would show
that it's the kernel who's doing the job).

Had something got broken here, or I'm misunderstanding how this machinery
now works?

./danfe

[*] http://freshbsd.org/commit/freebsd/src/342009
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


RE: The future of ZFS in FreeBSD

2018-12-20 Thread Cy Schubert
I suspect the idea is to contribute the FreeBSD bits back to ZoL.

My question is, how much of a base does ZoL really have? The enterprise players 
with any significant market share won't touch it -- Ubuntu has but IMO they're 
a niche player (who has violated GPL by including CDDL in their kernel.

The next step should be throwing up a wiki page with a features todo list. 
Also, this is a large enough project to have its own project branch, with the 
goal of having it in head before 13 goes GA. I also think people will not 
accept regressions or other POLA violations.

---
Sent using a tiny phone keyboard.
Apologies for any typos and autocorrect.
Also, this old phone only supports top post. Apologies.

Cy Schubert
 or 
The need of the many outweighs the greed of the few.
---

-Original Message-
From: Alexey Dokuchaev
Sent: 20/12/2018 06:40
To: Eugene M. Zheganin
Cc: freebsd-current@freebsd.org
Subject: Re: The future of ZFS in FreeBSD

On Thu, Dec 20, 2018 at 03:49:38PM +0500, Eugene M. Zheganin wrote:
> On 19.12.2018 23:32, Allan Jude wrote:
> > The biggest thing to remember is that this is still OpenZFS, and still
> > run by the same developers as it has been. We are just commonizing on
> > the repo that has the most features integrated into it.
> 
> Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because
> there is no such thing in ZoL?

+1.  I'm also worried if this would bring more Linuxish bits into our
kernel (cf. LinuxKPI).  Also, I thought that ZFS was never really native
to Linux but implemented through SPL (Solaris Porting Layer), and Linux'
VFS is not ARC-aware unlike Solaris and FreeBSD.

It would be quite upsetting to see ZFS as we know it in FreeBSD become
pessimized because of those things. :-(

./danfe
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


RE: The future of ZFS in FreeBSD

2018-12-20 Thread Cy Schubert
We would port the feature ourselves and push the code upstream.

---
Sent using a tiny phone keyboard.
Apologies for any typos and autocorrect.
Also, this old phone only supports top post. Apologies.

Cy Schubert
 or 
The need of the many outweighs the greed of the few.
---

-Original Message-
From: Eugene M. Zheganin
Sent: 20/12/2018 03:12
To: freebsd-current@freebsd.org
Subject: Re: The future of ZFS in FreeBSD

Hello,

On 19.12.2018 23:32, Allan Jude wrote:
> The biggest thing to remember is that this is still OpenZFS, and still
> run by the same developers as it has been. We are just commonizing on
> the repo that has the most features integrated into it.

Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because 
there is no such thing in ZoL ?

Eugene.

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Alexey Dokuchaev
On Thu, Dec 20, 2018 at 03:49:38PM +0500, Eugene M. Zheganin wrote:
> On 19.12.2018 23:32, Allan Jude wrote:
> > The biggest thing to remember is that this is still OpenZFS, and still
> > run by the same developers as it has been. We are just commonizing on
> > the repo that has the most features integrated into it.
> 
> Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because
> there is no such thing in ZoL?

+1.  I'm also worried if this would bring more Linuxish bits into our
kernel (cf. LinuxKPI).  Also, I thought that ZFS was never really native
to Linux but implemented through SPL (Solaris Porting Layer), and Linux'
VFS is not ARC-aware unlike Solaris and FreeBSD.

It would be quite upsetting to see ZFS as we know it in FreeBSD become
pessimized because of those things. :-(

./danfe
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


bind 9.12.3-P1 dies after change of IP on outbound interface

2018-12-20 Thread O. Hartmann
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Lateley I realise some strange behaviour of the recent dns/bind912 port.

Running named (9.12.3-P1) on a 12-STABLE gateway/router/firewall with outbound 
interface
tun0 to our privider, named seems to crash since the last port upgrade whenver 
the ISP is
changing the IP (using ppp with some linkup/linkdown scripts due to IPv6, 
nothing fancy).

The last sign of live named provides is shown below:

[...]
Dec 20 13:22:46 <3.2> gate named[1120]: socket.c:3251: REQUIRE(sock->references 
== 1)
failed, back trace Dec 20 13:22:46 <3.2> gate named[1120]: #0 0x2c8880 in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #1 0x4b111a in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #2 0x4e35fc in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #3 0x4e9e79 in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #4 0x35554d in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #5 0x354a2f in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #6 0x4d49fa in ??
Dec 20 13:22:46 <3.2> gate named[1120]: #7 0x800dc37c6 in ??
Dec 20 13:22:46 <3.2> gate named[1120]: exiting (due to assertion failure)
Dec 20 13:46:59 <3.5> gate named[3195]: starting BIND 9.12.3-P1 

Prior to the last update of dns/bind912, this router/firewall appliance was 
running more
than a month without having such trouble, even the ISP is randomly changing the 
IPv4/IPv6
addresses spread over the day.

What is wrong?

Kind regards,

O. Hartmann


- -- 
O. Hartmann

Ich widerspreche der Nutzung oder Übermittlung meiner Daten für
Werbezwecke oder für die Markt- oder Meinungsforschung (§ 28 Abs. 4 BDSG).
-BEGIN PGP SIGNATURE-

iHUEARYIAB0WIQSy8IBxAPDkqVBaTJ44N1ZZPba5RwUCXBuVPgAKCRA4N1ZZPba5
RxB8AQDwXm7hVifhDP841aGckXLCCino95lSAtHNLoOz2nBcowD9F4lUyflB/Imq
OvERuSNKeixaDDazKj6KJfNtiE8/0gU=
=H6r2
-END PGP SIGNATURE-
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread rb

> On 20 Dec 2018, at 11:58, Steven Hartland  wrote:
> 
> 
> 
> On 20/12/2018 11:03, Bob Bishop wrote:
>> Hi,
>> 
>>> On 19 Dec 2018, at 23:16, Matthew Macy  wrote:
>>> 
>>> On Wed, Dec 19, 2018 at 15:11 Steven Hartland 
>>> wrote:
>>> 
 Sorry been off for a few weeks so must have missed that, please do prod me
 on again if you don’t see any response to anything not just this. Like many
 others I get so may emails across so many lists it’s more than likely I
 just missed it.
 
 That said would you say that with the right support we can make progress
 on the this prior to the port? I have to ask as the alternative version has
 been on the cusp for many years now so it’s feels more like a distant
 memory than something that may happen, no disrespect to anyone involved, as
 I know all too well how hard it can be to get something like this over the
 line, especially when people have competing priorities.
 
>>> I am hoping that it's sufficiently important to FreeBSD ZFS developers that
>>> they'll give the PR the attention it needs so that it can be merged before
>>> summer. My understanding is that it's mostly suffered from neglect. TRIM is
>>> most important to FreeBSD and it already had its own implementation.
>>> 
>>> https://github.com/zfsonlinux/zfs/pull/5925
>> Please correct me if I’m wrong but this looks a lot less mature than 
>> FreeBSD’s existing TRIM support for ZFS which we’ve had in production for 
>> six years.
>> 
>> What is the rationale here? I’m concerned that it looks like an opportunity 
>> for mighty regressions.
>> 
> This is the case, but overall this solution is thought to be a better 
> approach.
> 
> With anything like this there is always a risk, so we all need a concerted 
> effort to get to one solution.

Not sure what I can contribute, but I can certainly put a box up for testing 
when there’s something to test.

> Regards
> Steve
> 

--
Bob Bishop
r...@gid.co.uk




___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Steven Hartland



On 20/12/2018 11:03, Bob Bishop wrote:

Hi,


On 19 Dec 2018, at 23:16, Matthew Macy  wrote:

On Wed, Dec 19, 2018 at 15:11 Steven Hartland 
wrote:


Sorry been off for a few weeks so must have missed that, please do prod me
on again if you don’t see any response to anything not just this. Like many
others I get so may emails across so many lists it’s more than likely I
just missed it.

That said would you say that with the right support we can make progress
on the this prior to the port? I have to ask as the alternative version has
been on the cusp for many years now so it’s feels more like a distant
memory than something that may happen, no disrespect to anyone involved, as
I know all too well how hard it can be to get something like this over the
line, especially when people have competing priorities.


I am hoping that it's sufficiently important to FreeBSD ZFS developers that
they'll give the PR the attention it needs so that it can be merged before
summer. My understanding is that it's mostly suffered from neglect. TRIM is
most important to FreeBSD and it already had its own implementation.

https://github.com/zfsonlinux/zfs/pull/5925

Please correct me if I’m wrong but this looks a lot less mature than FreeBSD’s 
existing TRIM support for ZFS which we’ve had in production for six years.

What is the rationale here? I’m concerned that it looks like an opportunity for 
mighty regressions.

This is the case, but overall this solution is thought to be a better 
approach.


With anything like this there is always a risk, so we all need a 
concerted effort to get to one solution.


    Regards
    Steve
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Eugene M. Zheganin

Hello,

On 19.12.2018 23:32, Allan Jude wrote:

The biggest thing to remember is that this is still OpenZFS, and still
run by the same developers as it has been. We are just commonizing on
the repo that has the most features integrated into it.


Does it mean that ZoF and thus FreeBSD will lose NFSv4 ACLs because 
there is no such thing in ZoL ?


Eugene.

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


[Bug 227191] Cannot check battery status after upgrading to 12-CURRENT after r330957 (ACPI _STA method removed)

2018-12-20 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=227191

Andriy Gapon  changed:

   What|Removed |Added

 Resolution|--- |FIXED
 Status|In Progress |Closed

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


[Bug 227191] Cannot check battery status after upgrading to 12-CURRENT after r330957 (ACPI _STA method removed)

2018-12-20 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=227191

--- Comment #21 from commit-h...@freebsd.org ---
A commit references this bug:

Author: avg
Date: Thu Dec 20 08:45:41 UTC 2018
New revision: 342278
URL: https://svnweb.freebsd.org/changeset/base/342278

Log:
  MFC r341632: acpi_{Device,Battery}IsPresent: restore pre-r330957 behaviour

  Specifically, assume that the device is present if evaluation of _STA
  method fails.

  PR:   227191

Changes:
_U  stable/12/
  stable/12/sys/dev/acpica/acpi.c

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: The future of ZFS in FreeBSD

2018-12-20 Thread Bob Bishop
Hi,

> On 19 Dec 2018, at 23:16, Matthew Macy  wrote:
> 
> On Wed, Dec 19, 2018 at 15:11 Steven Hartland 
> wrote:
> 
>> Sorry been off for a few weeks so must have missed that, please do prod me
>> on again if you don’t see any response to anything not just this. Like many
>> others I get so may emails across so many lists it’s more than likely I
>> just missed it.
>> 
>> That said would you say that with the right support we can make progress
>> on the this prior to the port? I have to ask as the alternative version has
>> been on the cusp for many years now so it’s feels more like a distant
>> memory than something that may happen, no disrespect to anyone involved, as
>> I know all too well how hard it can be to get something like this over the
>> line, especially when people have competing priorities.
>> 
> 
> I am hoping that it's sufficiently important to FreeBSD ZFS developers that
> they'll give the PR the attention it needs so that it can be merged before
> summer. My understanding is that it's mostly suffered from neglect. TRIM is
> most important to FreeBSD and it already had its own implementation.
> 
> https://github.com/zfsonlinux/zfs/pull/5925

Please correct me if I’m wrong but this looks a lot less mature than FreeBSD’s 
existing TRIM support for ZFS which we’ve had in production for six years.

What is the rationale here? I’m concerned that it looks like an opportunity for 
mighty regressions.

> I forwarded you the private communication again as well.
> 
> -M
> 
> 
>> 
>> On Wed, 19 Dec 2018 at 22:52, Matthew Macy  wrote:
>> 
>>> 
>>> 
>>> On Wed, Dec 19, 2018 at 14:47 Steven Hartland 
>>> wrote:
>>> 
 Thanks for the write up most appreciated. One of the more meaty
 differences is that FreeBSD ZFS still has the only merged and production
 ready TRIM support so my question would be are their any plans to address
 this before creating the new port as going back to a world without TRIM
 support wouldn’t be something I’d look forward to.
 
>>> 
>>> Well, then please follow up on the request I CC'd you on a week ago
>>> asking that you engage on the deadlist based TRIM  PR. That's a better
>>> forum for discussing these details than lamenting in public lists.
>>> 
>>> Thanks.
>>> 
>>> -M
>>> 
>>> 
>>> 
>>> 
 On Wed, 19 Dec 2018 at 06:51, Matthew Macy  wrote:
 
> The sources for FreeBSD's ZFS support are currently taken directly
> from Illumos with local ifdefs to support the peculiarities of FreeBSD
> where the Solaris Portability Layer (SPL) shims fall short. FreeBSD
> has regularly pulled changes from Illumos and tried to push back any
> bug fixes and new features done in the context of FreeBSD. In the past
> few years the vast majority of new development in ZFS has taken place
> in DelphixOS and zfsonlinux (ZoL). Earlier this year Delphix announced
> that they will be moving to ZoL
> https://www.delphix.com/blog/kickoff-future-eko-2018 This shift means
> that there will be little to no net new development of Illumos. While
> working through the git history of ZoL I have also discovered that
> many races and locking bugs have been fixed in ZoL and never made it
> back to Illumos and thus FreeBSD. This state of affairs has led to a
> general agreement among the stakeholders that I have spoken to that it
> makes sense to rebase FreeBSD's ZFS on ZoL. Brian Behlendorf
> has graciously encouraged me to add FreeBSD support directly to ZoL
> https://github.com/zfsonfreebsd/ZoF so that we might all have a single
> shared code base.
> 
> A port for ZoF can be found at https://github.com/miwi-fbsd/zof-port
> Before it can be committed some additional functionality needs to be
> added to the FreeBSD opencrypto framework. These can be found at
> https://reviews.freebsd.org/D18520
> 
> This port will provide FreeBSD users with multi modifier protection,
> project quotas, encrypted datasets, allocation classes, vectorized
> raidz, vectorized checksums, and various command line improvements.
> 
> Before ZoF can be merged back in to ZoL several steps need to be taken:
> - Integrate FreeBSD support into ZoL CI
> - Have most of the ZFS test suite passing
> - Complete additional QA testing at iX
> 
> We at iX Systems need to port ZoL's EC2 CI scripts to work with
> FreeBSD and make sure that most of the ZFS Test Suite (ZTS) passes.
> Being integrated in to their CI will mean that, among other things,
> most integration issues will be caught before a PR is merged upstream
> rather than many months later when it is MFVed into FreeBSD. I’m
> hoping to submit the PR to ZoL some time in January.
> 
> This port will make it easy for end users on a range of releases to
> run the latest version of ZFS. Nonetheless, transitioning away from an
> Illumos based ZFS is not likely to be entirely seamless. The
>