Re: FreeBSD 10 and zfsd
Any hope of zfsd before the freeze for 10.1-RELEASE? Thanks! ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
Status update below: The projects/zfsd project branch is up to date. Merging it to CURRENT is blocked on these tasks. 1) (The biggie) We must resolve the issue with multiple geom opens. Geom tries to prevent any two consumers from simultaneously opening the same provider. This is why, for example, you can't do dd if=/dev/zero of=/dev/ada0 if your ada0 has a mounted file system. However, ZFS internally opens spare devices multiple times. The only way that geom will allow that is if ZFS opens devices non-exclusively. That means that you will lose your protection. Fixing this correctly requires deep changes to ZFS to remove the multiple opens. 2) Need to merge in zfsd's functional tests. I'm currently working on this issue as time allows. Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. b) Some test cases reference Spectra Logic internal bug numbers. We need to file FreeBSD PRs for all of them and change the references. c) It uses some ATF config variables that are not yet documented in tests(7). 3) It needs a manpage. 4) Various bug fixes need to be merged to the kernel and to LibZFS. Coordinating with Illumos makes that process slow. will@ is working on it as time allows. gibbs@ has been making progress here, with mahrens@ providing code review. But it is still slow. 5) libdevctl needs to be made private 6) The sequential packet feature added to devd in the zfsd project branch at revision r266519 must be merged to head. It's currently waiting for review from imp@ and ian@. Merged by r270004. To answer Mark's question: no, we can't finish all of this in time for 10.1. Sorry. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. https://svnweb.freebsd.org/base/projects/zfsd/head/libexec/atf/atf-ksh93/ https://svnweb.freebsd.org/base/projects/zfsd/head/tests/sys/cddl/zfs/include/libtest.kshlib ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Aug 26, 2014, at 12:45, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. I'm working on integrating the dtrace testcases into kyua, then atf under Kyua as time permits, but I'm not rewriting the core test code (yet), because I want to reduce divergence with upstream. Why not just require ksh93 from ports? Cheers! -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
August 26 2014 2:45 PM, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. https://svnweb.freebsd.org/base/projects/zfsd/head/libexec/atf/atf-ksh93/ https://svnweb.freebsd.org/base/projects/zfsd/head/tests/sys/cddl/zfs/include/libtest.kshlib Depending on how complicated it is we might be able to coerce dteske into checking it out. He could write an sh mastery book... I'm sure he could assist with this. :-) ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
August 26 2014 2:49 PM, Garrett Cooper yaneurab...@gmail.com wrote: Why not just require ksh93 from ports? Because zfsd is going to be in base, not in ports. Everything in base needs to work without any ports requirements. Also ksh93 has been... problematic. It has a history of breaking on i386, sparc64, current, etc. It's not exactly a reliable dependency. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 1:48 PM, Garrett Cooper yaneurab...@gmail.com wrote: On Aug 26, 2014, at 12:45, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. I'm working on integrating the dtrace testcases into kyua, then atf under Kyua as time permits, but I'm not rewriting the core test code (yet), because I want to reduce divergence with upstream. Why not just require ksh93 from ports? It's not that simple. It's certainly possible to put a require.progs ksh93 in the test case header. But you also need to use ksh93 features before invoking the test case script. For example, see zpool_upgrade_004_pos_body in tests/sys/cddl/zfs/tests/cli_root/zpool_upgrade/zpool_upgrade_test.sh . Notice how it sources some .kshlib scripts, then checks the $KEEP variable. Other tests do similar things. Perhaps they could be fixed by wrapping those lines in a here document that gets fed to ksh93. But that's very ugly. I'd rather fix all the tests to not require ksh93 before invoking the separate test case script. If you change the interpreter script from atf-ksh93 to atf-sh, you'll see errors like this: # kyua debug zfsd_test:zfsd_import_001_pos set: Illegal option -A set: Illegal option -A zfsd_test:zfsd_import_001_pos - broken: Premature exit; test case exited with code 2 -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 1:04 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 2:49 PM, Garrett Cooper yaneurab...@gmail.com wrote: Why not just require ksh93 from ports? Because zfsd is going to be in base, not in ports. Everything in base needs to work without any ports requirements. We have tests in base that require perl, and kyua itself comes from ports. Granted it's not ideal, but it works and it gives developers and test infrastructure people more flexibility with software instead of having to key it into a particular version in the base system. Also ksh93 has been... problematic. It has a history of breaking on i386, sparc64, current, etc. It's not exactly a reliable dependency. That's really unfortunate :(. If you have bug reports it'll provide ammunition for why this should be converted over to something more portable when I'm contributing patches back to IllumOS. I really didn't want to do it because the process for contributing back to IllumOS is so heavyweight, but reliability when running the tests is a must. Thanks! -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 1:51 PM, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:48 PM, Garrett Cooper yaneurab...@gmail.com wrote: On Aug 26, 2014, at 12:45, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. I'm working on integrating the dtrace testcases into kyua, then atf under Kyua as time permits, but I'm not rewriting the core test code (yet), because I want to reduce divergence with upstream. Why not just require ksh93 from ports? It's not that simple. It's certainly possible to put a require.progs ksh93 in the test case header. But you also need to use ksh93 features before invoking the test case script. For example, see zpool_upgrade_004_pos_body in tests/sys/cddl/zfs/tests/cli_root/zpool_upgrade/zpool_upgrade_test.sh . Notice how it sources some .kshlib scripts, then checks the $KEEP variable. Other tests do similar things. Perhaps they could be fixed by wrapping those lines in a here document that gets fed to ksh93. But that's very ugly. I'd rather fix all the tests to not require ksh93 before invoking the separate test case script. If you change the interpreter script from atf-ksh93 to atf-sh, you'll see errors like this: # kyua debug zfsd_test:zfsd_import_001_pos set: Illegal option -A set: Illegal option -A zfsd_test:zfsd_import_001_pos - broken: Premature exit; test case exited with code 2 This should be plugged into kyua-testers though instead of hacking around ATF -- even if it's mostly a thin layer on top of the ATF tester; we should work towards a common goal with the DTrace/ZFS testing though because they sort of follow the same design patterns. My mentor jmmv@ might have valuable input to provide here in what should be done (I've CCed him). Thanks! -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 3:32 PM, Garrett Cooper yaneurab...@gmail.com wrote: On Tue, Aug 26, 2014 at 1:51 PM, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:48 PM, Garrett Cooper yaneurab...@gmail.com wrote: On Aug 26, 2014, at 12:45, Alan Somers asom...@freebsd.org wrote: On Tue, Aug 26, 2014 at 1:39 PM, Mark Felder f...@freebsd.org wrote: August 26 2014 10:21 AM, Alan Somers asom...@freebsd.org wrote: Merged into the projects/zfsd/head branch by change 270604. Merging to head is blocked by three issues: a) The atf-ksh93 hack. The correct solution is to modify all the test programs (not the test cases) so they can run under /bin/sh. That will take some effort. Can you provide a link to the atf-ksh93 code? There's not much to it. It simply sets an environment variable and calls atf-sh. What's more interesting is libtest.kshlib. In order to eliminate atf-ksh93, we would need to modify libtest.kshlib to run under /bin/sh. Alternatively, it may be easier to split libtest.kshlib into two files: a small /bin/sh-compatible that can be sourced by the ATF test programs, and a ksh93 script that only needs to be sourced by the ATF test cases. I'm working on integrating the dtrace testcases into kyua, then atf under Kyua as time permits, but I'm not rewriting the core test code (yet), because I want to reduce divergence with upstream. Why not just require ksh93 from ports? It's not that simple. It's certainly possible to put a require.progs ksh93 in the test case header. But you also need to use ksh93 features before invoking the test case script. For example, see zpool_upgrade_004_pos_body in tests/sys/cddl/zfs/tests/cli_root/zpool_upgrade/zpool_upgrade_test.sh . Notice how it sources some .kshlib scripts, then checks the $KEEP variable. Other tests do similar things. Perhaps they could be fixed by wrapping those lines in a here document that gets fed to ksh93. But that's very ugly. I'd rather fix all the tests to not require ksh93 before invoking the separate test case script. If you change the interpreter script from atf-ksh93 to atf-sh, you'll see errors like this: # kyua debug zfsd_test:zfsd_import_001_pos set: Illegal option -A set: Illegal option -A zfsd_test:zfsd_import_001_pos - broken: Premature exit; test case exited with code 2 This should be plugged into kyua-testers though instead of hacking around ATF -- even if it's mostly a thin layer on top of the ATF tester; we should work towards a common goal with the DTrace/ZFS testing though because they sort of follow the same design patterns. My mentor jmmv@ might have valuable input to provide here in what should be done (I've CCed him). Adding a ksh93 tester to Kyua was previously discussed on kyua-discuss. But it was basically shot down. https://groups.google.com/forum/#!topic/kyua-discuss/w8oJHeZXuro Porting, in whole or in part, the tests to /bin/sh is time consuming, but it's the only option that satisfies everyone. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Aug 26, 2014 at 2:43 PM, Alan Somers asom...@freebsd.org wrote: ... Adding a ksh93 tester to Kyua was previously discussed on kyua-discuss. But it was basically shot down. https://groups.google.com/forum/#!topic/kyua-discuss/w8oJHeZXuro Maybe the idea just needs to be approached from a different angle like I did with /bin/sh/tests ( https://svnweb.freebsd.org/base/head/bin/sh/tests/functional_test.sh?revision=269902view=markup )? I know that with DTrace at least, it uses dtest.pl, which implements its own test discovery mechanism, which should be easy to hook into atf and produce testcases for dynamically. Some additional logic might be required to work around testcases that fail today on FreeBSD or cause the system to livelock/panic (e.g. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192906 ), but writing in simple hooks for this shouldn't be hard. Porting, in whole or in part, the tests to /bin/sh is time consuming, but it's the only option that satisfies everyone. Perhaps. I'm lazier nowadays and prefer not chasing after the perfect solution if I can help it (especially because it tends to bite me in the rear later). Thanks! -Garrett ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
op 24-03-14 01:18, Alan Somers schreef: On Sun, Mar 23, 2014 at 4:23 PM, Mark Felder f...@freebsd.org wrote: Hi guys, Any updates? I've been very busy, but I did finally get those two seqpacket related bugs fixed in head. The next step is finding time for the merge. Right now my FreeBSD todo list goes: 1) Commit fixes for half a dozen FIB related bugs. I already have them fixed in my private stable/9 branch, but need to port the fixes to HEAD. 2) Update the zfsd branch. I think that I'll be able to get number 1 done next week, or at least send patches out for review. I don't know if I'll get to number 2. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Hello all. Sorry for bringing up on old thread. Is there any news on the zfsd part. It seems it has been included in Truenas, but I did not see anything hit the tree regarding zfsd. Have I missed it or is it still not done. FreeBSD 9.3 is about to get released, and 10.1 will follow it would be nice to have in a new build.. regards Johan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Mon, Jun 23, 2014 at 12:50 AM, Johan Hendriks joh.hendr...@gmail.com wrote: op 24-03-14 01:18, Alan Somers schreef: On Sun, Mar 23, 2014 at 4:23 PM, Mark Felder f...@freebsd.org wrote: Hi guys, Any updates? I've been very busy, but I did finally get those two seqpacket related bugs fixed in head. The next step is finding time for the merge. Right now my FreeBSD todo list goes: 1) Commit fixes for half a dozen FIB related bugs. I already have them fixed in my private stable/9 branch, but need to port the fixes to HEAD. 2) Update the zfsd branch. I think that I'll be able to get number 1 done next week, or at least send patches out for review. I don't know if I'll get to number 2. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Hello all. Sorry for bringing up on old thread. Is there any news on the zfsd part. It seems it has been included in Truenas, but I did not see anything hit the tree regarding zfsd. Have I missed it or is it still not done. FreeBSD 9.3 is about to get released, and 10.1 will follow it would be nice to have in a new build.. The projects/zfsd project branch is up to date. Merging it to CURRENT is blocked on these tasks. 1) (The biggie) We must resolve the issue with multiple geom opens. Geom tries to prevent any two consumers from simultaneously opening the same provider. This is why, for example, you can't do dd if=/dev/zero of=/dev/ada0 if your ada0 has a mounted file system. However, ZFS internally opens spare devices multiple times. The only way that geom will allow that is if ZFS opens devices non-exclusively. That means that you will lose your protection. Fixing this correctly requires deep changes to ZFS to remove the multiple opens. 2) Need to merge in zfsd's functional tests. I'm currently working on this issue as time allows. 3) It needs a manpage. 4) Various bug fixes need to be merged to the kernel and to LibZFS. Coordinating with Illumos makes that process slow. will@ is working on it as time allows. 5) libdevctl needs to be made private 6) The sequential packet feature added to devd in the zfsd project branch at revision r266519 must be merged to head. It's currently waiting for review from imp@ and ian@. For TrueNAS, I believe that delphij@ merged an older version of zfsd from the project branch. -Alan regards Johan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
Op maandag 23 juni 2014 heeft Alan Somers asom...@freebsd.org het volgende geschreven: On Mon, Jun 23, 2014 at 12:50 AM, Johan Hendriks joh.hendr...@gmail.com javascript:; wrote: op 24-03-14 01:18, Alan Somers schreef: On Sun, Mar 23, 2014 at 4:23 PM, Mark Felder f...@freebsd.org javascript:; wrote: Hi guys, Any updates? I've been very busy, but I did finally get those two seqpacket related bugs fixed in head. The next step is finding time for the merge. Right now my FreeBSD todo list goes: 1) Commit fixes for half a dozen FIB related bugs. I already have them fixed in my private stable/9 branch, but need to port the fixes to HEAD. 2) Update the zfsd branch. I think that I'll be able to get number 1 done next week, or at least send patches out for review. I don't know if I'll get to number 2. -Alan ___ freebsd-current@freebsd.org javascript:; mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org javascript:; Hello all. Sorry for bringing up on old thread. Is there any news on the zfsd part. It seems it has been included in Truenas, but I did not see anything hit the tree regarding zfsd. Have I missed it or is it still not done. FreeBSD 9.3 is about to get released, and 10.1 will follow it would be nice to have in a new build.. The projects/zfsd project branch is up to date. Merging it to CURRENT is blocked on these tasks. 1) (The biggie) We must resolve the issue with multiple geom opens. Geom tries to prevent any two consumers from simultaneously opening the same provider. This is why, for example, you can't do dd if=/dev/zero of=/dev/ada0 if your ada0 has a mounted file system. However, ZFS internally opens spare devices multiple times. The only way that geom will allow that is if ZFS opens devices non-exclusively. That means that you will lose your protection. Fixing this correctly requires deep changes to ZFS to remove the multiple opens. 2) Need to merge in zfsd's functional tests. I'm currently working on this issue as time allows. 3) It needs a manpage. 4) Various bug fixes need to be merged to the kernel and to LibZFS. Coordinating with Illumos makes that process slow. will@ is working on it as time allows. 5) libdevctl needs to be made private 6) The sequential packet feature added to devd in the zfsd project branch at revision r266519 must be merged to head. It's currently waiting for review from imp@ and ian@. For TrueNAS, I believe that delphij@ merged an older version of zfsd from the project branch. -Alan regards Johan ___ freebsd-current@freebsd.org javascript:; mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org javascript:; Thanks for the headsup and your time explaning the issues.. Regards Johan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2014-06-23 12:39, Alan Somers wrote: The projects/zfsd project branch is up to date. Merging it to CURRENT is blocked on these tasks. 1) (The biggie) We must resolve the issue with multiple geom opens. Geom tries to prevent any two consumers from simultaneously opening the same provider. This is why, for example, you can't do dd if=/dev/zero of=/dev/ada0 if your ada0 has a mounted file system. However, ZFS internally opens spare devices multiple times. The only way that geom will allow that is if ZFS opens devices non-exclusively. That means that you will lose your protection. Fixing this correctly requires deep changes to ZFS to remove the multiple opens. 2) Need to merge in zfsd's functional tests. I'm currently working on this issue as time allows. 3) It needs a manpage. I can help with a man page. Is there an outline or readme to start from? 4) Various bug fixes need to be merged to the kernel and to LibZFS. Coordinating with Illumos makes that process slow. will@ is working on it as time allows. 5) libdevctl needs to be made private 6) The sequential packet feature added to devd in the zfsd project branch at revision r266519 must be merged to head. It's currently waiting for review from imp@ and ian@. For TrueNAS, I believe that delphij@ merged an older version of zfsd from the project branch. -Alan -- Allan Jude signature.asc Description: OpenPGP digital signature
Re: FreeBSD 10 and zfsd
On Mon, Jun 23, 2014 at 1:25 PM, Allan Jude allanj...@freebsd.org wrote: On 2014-06-23 12:39, Alan Somers wrote: The projects/zfsd project branch is up to date. Merging it to CURRENT is blocked on these tasks. 1) (The biggie) We must resolve the issue with multiple geom opens. Geom tries to prevent any two consumers from simultaneously opening the same provider. This is why, for example, you can't do dd if=/dev/zero of=/dev/ada0 if your ada0 has a mounted file system. However, ZFS internally opens spare devices multiple times. The only way that geom will allow that is if ZFS opens devices non-exclusively. That means that you will lose your protection. Fixing this correctly requires deep changes to ZFS to remove the multiple opens. 2) Need to merge in zfsd's functional tests. I'm currently working on this issue as time allows. 3) It needs a manpage. I can help with a man page. Is there an outline or readme to start from? None that I know of. Usage is simple; there is only one option. -d runs in the foreground instead of daemonizing. But the man page should also describe the location of the case files and the types of damage that zfsd can fix. Unfortunately, that's not documented anywhere except in the source right now. I appreciate the offer of help, Allan, but you may get frustrated; you just don't have much to work with. -Alan with a single l. 4) Various bug fixes need to be merged to the kernel and to LibZFS. Coordinating with Illumos makes that process slow. will@ is working on it as time allows. 5) libdevctl needs to be made private 6) The sequential packet feature added to devd in the zfsd project branch at revision r266519 must be merged to head. It's currently waiting for review from imp@ and ian@. For TrueNAS, I believe that delphij@ merged an older version of zfsd from the project branch. -Alan -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
Hi guys, Any updates? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Sun, Mar 23, 2014 at 4:23 PM, Mark Felder f...@freebsd.org wrote: Hi guys, Any updates? I've been very busy, but I did finally get those two seqpacket related bugs fixed in head. The next step is finding time for the merge. Right now my FreeBSD todo list goes: 1) Commit fixes for half a dozen FIB related bugs. I already have them fixed in my private stable/9 branch, but need to port the fixes to HEAD. 2) Update the zfsd branch. I think that I'll be able to get number 1 done next week, or at least send patches out for review. I don't know if I'll get to number 2. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Dec 19, 2013 at 6:32 PM, asom...@gmail.com wrote: On Wed, Dec 18, 2013 at 2:40 PM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 4:40 PM, Alan Somers asom...@freebsd.org wrote: On Wed, Dec 18, 2013 at 11:47 AM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it Coming up ... Sweet..!!! Sorry, but I'm running into nontrivial merge conflicts. It's going to take a few more days. -Alan Has any progress been made on an updated patch set ?? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Tue, Jan 21, 2014 at 12:37 PM, Outback Dingo outbackdi...@gmail.com wrote: On Thu, Dec 19, 2013 at 6:32 PM, asom...@gmail.com wrote: On Wed, Dec 18, 2013 at 2:40 PM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 4:40 PM, Alan Somers asom...@freebsd.org wrote: On Wed, Dec 18, 2013 at 11:47 AM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it Coming up ... Sweet..!!! Sorry, but I'm running into nontrivial merge conflicts. It's going to take a few more days. -Alan Has any progress been made on an updated patch set ?? Yes, but not any visible progress. I had to make some changes to devd and libdevctl, and I'm currently blocked by this bug. I have a tentative solution for it, and I hope to start a discussion on freebsd-net about it today or tomorrow. http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/185813 -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Wed, Dec 18, 2013 at 2:40 PM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 4:40 PM, Alan Somers asom...@freebsd.org wrote: On Wed, Dec 18, 2013 at 11:47 AM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it Coming up ... Sweet..!!! Sorry, but I'm running into nontrivial merge conflicts. It's going to take a few more days. -Alan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Wed, Dec 18, 2013 at 11:47 AM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it Coming up ... ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Wed, Dec 18, 2013 at 4:40 PM, Alan Somers asom...@freebsd.org wrote: On Wed, Dec 18, 2013 at 11:47 AM, Outback Dingo outbackdi...@gmail.com wrote: On Wed, Dec 18, 2013 at 12:39 PM, Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 11:26, Alan Somers wrote: Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Just thought I'd ping the list about the situation here... would love to see this in HEAD soon :) Id love to see an updated patch from the zfsd tree against head itself so we could continue using and testing it Coming up ... Sweet..!!! ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
Johan Hendriks schreef: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks On the wiki page Whats new for FreeBSD 10 https://wiki.freebsd.org/WhatsNew/FreeBSD10 under Other changes zfsd is mentioned as beeing part of 10.0 ZFS fault monitoring and management daemon, http://svn.freebsd.org/changeset/base/222836 Maybe it should be removed from that page. regards Johan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2013-10-28 03:35, Johan Hendriks wrote: Johan Hendriks schreef: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks On the wiki page Whats new for FreeBSD 10 https://wiki.freebsd.org/WhatsNew/FreeBSD10 under Other changes zfsd is mentioned as beeing part of 10.0 ZFS fault monitoring and management daemon, http://svn.freebsd.org/changeset/base/222836 Maybe it should be removed from that page. regards Johan ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org There has been quite a bit of activity in zfsd recently: http://freshbsd.org/search?branch=PROJECT_ZFSDamp;project=freebsd But, I don't think it will make it into 10.0-RELEASE. It was discussed quite a bit during the ZFS BOF at vBSDCon, and there is active work to upstream stuff from SpectraLogic The wiki is not really meant to be definitive, we'll have to see. -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
On Fri, 11 Oct 2013 03:24:51 -0400 Allan Jude free...@allanjude.com wrote: On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet ... so it isn't visible to the normal users. I would also appreciate a hint in the man page of zpool(8). Like Be aware: A spare declared vdev is not (yet) automatically replacing a faulty rendered drive. Human action is still required. It could save some trouble in prevention. Oliver signature.asc Description: PGP signature
Re: FreeBSD 10 and zfsd.
On 2013-10-11 04:27, O. Hartmann wrote: On Fri, 11 Oct 2013 03:24:51 -0400 Allan Jude free...@allanjude.com wrote: On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet ... so it isn't visible to the normal users. I would also appreciate a hint in the man page of zpool(8). Like Be aware: A spare declared vdev is not (yet) automatically replacing a faulty rendered drive. Human action is still required. It could save some trouble in prevention. Oliver Lyndon Nerenberg attached a patch for the man page earlier in the thread, and I have forwarded that to the docs team -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
On Fri, Oct 11, 2013 at 10:16 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-11 04:27, O. Hartmann wrote: On Fri, 11 Oct 2013 03:24:51 -0400 Allan Jude free...@allanjude.com wrote: On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet ... so it isn't visible to the normal users. I would also appreciate a hint in the man page of zpool(8). Like Be aware: A spare declared vdev is not (yet) automatically replacing a faulty rendered drive. Human action is still required. It could save some trouble in prevention. Oliver Lyndon Nerenberg attached a patch for the man page earlier in the thread, and I have forwarded that to the docs team I was under the impression rc_setvar was dropped from rc.d scripts i believe it should be rcvar=`zfsd` for /etc/rc.d/zfsd -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
On Fri, Oct 11, 2013 at 1:57 PM, Outback Dingo outbackdi...@gmail.com wrote: On Fri, Oct 11, 2013 at 10:16 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-11 04:27, O. Hartmann wrote: On Fri, 11 Oct 2013 03:24:51 -0400 Allan Jude free...@allanjude.com wrote: On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet ... so it isn't visible to the normal users. I would also appreciate a hint in the man page of zpool(8). Like Be aware: A spare declared vdev is not (yet) automatically replacing a faulty rendered drive. Human action is still required. It could save some trouble in prevention. Oliver Lyndon Nerenberg attached a patch for the man page earlier in the thread, and I have forwarded that to the docs team I was under the impression rc_setvar was dropped from rc.d scripts i believe it should be rcvar=`zfsd` for /etc/rc.d/zfsd Good catch. I obviously still have a lot of merging to do. -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd.
On Fri, Oct 11, 2013 at 4:27 PM, Alan Somers asom...@freebsd.org wrote: On Fri, Oct 11, 2013 at 1:57 PM, Outback Dingo outbackdi...@gmail.com wrote: On Fri, Oct 11, 2013 at 10:16 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-11 04:27, O. Hartmann wrote: On Fri, 11 Oct 2013 03:24:51 -0400 Allan Jude free...@allanjude.com wrote: On 2013-10-11 03:02, Johan Hendriks wrote: Johan Hendriks wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? regards Johan Hendriks Thanks all for the explanation and your time A notice in the handbook may be a good thing to let new FreeBSD users know that you can add spares, but that it is not a hot spare. So human action is required to activate the spare. regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org That bit is in the zfs handbook project branch, it just isn't published yet ... so it isn't visible to the normal users. I would also appreciate a hint in the man page of zpool(8). Like Be aware: A spare declared vdev is not (yet) automatically replacing a faulty rendered drive. Human action is still required. It could save some trouble in prevention. Oliver Lyndon Nerenberg attached a patch for the man page earlier in the thread, and I have forwarded that to the docs team I was under the impression rc_setvar was dropped from rc.d scripts i believe it should be rcvar=`zfsd` for /etc/rc.d/zfsd Good catch. I obviously still have a lot of merging to do. also in my diff against CURRENT from your updated SVN, i found the patch created a /usr/src/rc.d/zfsd instead of /usr/src/etc/rc.d a bit odd and /usr/src/sbin/zfsd instead of /usr/src/cddl/sbin ... however the Makefiles were correctly patched for both in the proper locations... though IMHO i was tired... might have been me i moved them to the proper places when i realized they were built on the first make world kernel :P might want to double check. for others sanity -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. http://svnweb.freebsd.org/base/projects/zfsd/head/ regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013 at 11:24 AM, Alan Somers asom...@freebsd.org wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. http://svnweb.freebsd.org/base/projects/zfsd/head/ might be easier to just cut a diff of it, as it 2+ months behind CURRENT as it is in this branch, be nice to review and do some testing on, but getting a diff from that to CURRENT might prove a bit difficult unless the branch was updated regards Johan Hendriks ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2013-10-10 13:26, Alan Somers wrote: On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. See, all you have to do is complain loudly enough :p -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013, at 12:40, Allan Jude wrote: On 2013-10-10 13:26, Alan Somers wrote: On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. See, all you have to do is complain loudly enough :p I was sad more than anything. I'd been waiting for zfsd since the project was announced. :-) I'm glad to know we won't have to wait until 11.0. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On Thu, 10 Oct 2013 13:41:06 -0500 Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 12:40, Allan Jude wrote: On 2013-10-10 13:26, Alan Somers wrote: On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. See, all you have to do is complain loudly enough :p I was sad more than anything. I'd been waiting for zfsd since the project was announced. :-) I'm glad to know we won't have to wait until 11.0. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Ha! Very funny. I created a RAIDZ1 pool and by reading the man page for zpool, which states precisely how to create a hot spare for a given pool. I wasn't aware until now that this action was useless, and even dangerous. Well, bravo, I must admit, the man page does not give any kind of warning that one can not rely on a hot spare. oh signature.asc Description: PGP signature
Re: FreeBSD 10 and zfsd
On Thu, Oct 10, 2013 at 1:26 PM, Alan Somers asom...@freebsd.org wrote: On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. Sweet... something to play with the next few days and see how stable it is. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2013-10-10 15:59, O. Hartmann wrote: On Thu, 10 Oct 2013 13:41:06 -0500 Mark Felder f...@freebsd.org wrote: On Thu, Oct 10, 2013, at 12:40, Allan Jude wrote: On 2013-10-10 13:26, Alan Somers wrote: On Thu, Oct 10, 2013 at 11:24 AM, Allan Jude free...@allanjude.com wrote: On 2013-10-10 12:13, Mark Felder wrote: On Thu, Oct 10, 2013, at 10:24, Alan Somers wrote: On Thu, Oct 10, 2013 at 8:19 AM, Johan Hendriks joh.hendr...@gmail.com wrote: When i started using ZFS on FreeBSD I quickly found out that hot spares are not possible on FreeBSD. I was told that with zfsd it should be possible and that it would be included in FreeBSD 10. Is there some info about the zfsd function and how it could be used? zfsd is currently not in FreeBSD/head and won't make it into 10, but you can still get the source code from its project branch. It's being used in production by at least two companies. So FreeBSD is going to have inferior ZFS management compared to Solaris/Illumos/etc for another 2+ years? Why are things like this allowed to miss releases? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ZFSd was a big topic of discussion at the EuroBSDCon 2013 dev summit (3 weeks ago). There is a lot of collaboration going on, to bring in some work done by vendors like SpectraLogics. This is the type of feature that can be assed in 10.1, it won't have to wait for 11. You can see Robert Watsons talk How FreeBSD Works to see why releases are based on date, rather than on feature completion (because things are never finished) -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Due to popular demand, I have located a round toit. I'm currently working on rebasing the zfsd project branch to head, after which I'll push SpectraLogic's recent changes. See, all you have to do is complain loudly enough :p I was sad more than anything. I'd been waiting for zfsd since the project was announced. :-) I'm glad to know we won't have to wait until 11.0. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org Ha! Very funny. I created a RAIDZ1 pool and by reading the man page for zpool, which states precisely how to create a hot spare for a given pool. I wasn't aware until now that this action was useless, and even dangerous. Well, bravo, I must admit, the man page does not give any kind of warning that one can not rely on a hot spare. oh The ZFS spare functinality basically just marks the drive as a spare, so you as the admin know what drive to use when replacement time comes I've been working on the handbook section on ZFS and made certain to mention that, I'll have to look at improving the man page as well, but as far as I know, the man page is imported from IllumOS, where spares do work. ZFSd is important and I hope to see more movement on it soon. -- Allan Jude ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: FreeBSD 10 and zfsd
On 2013-10-10, at 2:54 PM, Allan Jude free...@allanjude.com wrote: I've been working on the handbook section on ZFS and made certain to mention that, I'll have to look at improving the man page as well, but as far as I know, the man page is imported from IllumOS, where spares do work. This is probably worthy of an in-tree man page update. FreeBSD has a reputation for having highly accurate man pages, therefore people tend to take what they read as gospel. Right now zpool(8) clearly spells out that hot spare substitution works. When 10.0 goes live, people are going to believe that, and unknowingly put themselves in a position where Bad Things could happen. Until zfsd goes into the tree, zpool(8) should have a warning that the hot spare functionality is not available under FreeBSD. Proposed diff attached. --lyndon Index: zpool.8 === --- zpool.8 (revision 255198) +++ zpool.8 (working copy) @@ -283,6 +283,7 @@ For more information, see the .Qq Sx Hot Spares section. +.Sy (The hot spare functionality is not currently implemented on FreeBSD.) .It Sy log A separate-intent log device. If more than one log device is specified, then writes are load-balanced between devices. Log devices can be mirrored. However, @@ -425,6 +426,8 @@ attempts to put the device online automatically. Device attach detection is hardware-dependent and might not be supported on all platforms. .Ss Hot Spares +.Sy (The hot spare functionality is not currently implemented on FreeBSD.) +.Pp .Tn ZFS allows devices to be associated with pools as .Qq hot spares . @@ -1946,3 +1949,6 @@ .Xr mdoc 7 implementation of this manual page was initially written by .An Martin Matuska Aq m...@freebsd.org . +.Sh BUGS +Hot spare substitution awaits the import of +.Xr zfsd 8 . ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
