Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
2011/3/9 Pierre Beyssac p...@fasterix.frmug.org: On Tue, Mar 08, 2011 at 07:40:19PM +0100, Pawel Jakub Dawidek wrote: Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). Could you try r219404? It's fixed! Great work! Thanks a million! -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org It fixed the same problem I had under linux compat, too. Thanks ! -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: oliv...@gid0.org - against HTML email vCards X www: http://www.gid0.org - against proprietary attachments / \ Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
2011/3/7 Pierre Beyssac p...@fasterix.frmug.org: Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). On the NFS server (files are stored on a ZFS v15 volume, not yet upgraded to the v28 format): % cd /usr/ports/devel/autoconf % ls -i 311401 Makefile 204505 files 204509 pkg-plist 204504 distinfo 204508 pkg-descr On the NFS client side (FreeBSD 8.2-RELEASE): % cd /usr/ports/devel/autoconf % ls -i 204504 distinfo 204508 pkg-descr 204505 files 204509 pkg-plist Yet the missing file can be accessed: % head -3 Makefile # New ports collection makefile for: autoconf # Date created: 7th December 2006 # Whom: a...@freebsd.org I have the same behavior for files or even complete dirs in my linux jails. The files are visible on the host computer (FreeBSD 9-CURRENT amd64 with v28 ZFS root pool), but if I chroot in the linux jail (so now it's not a jail but only a chroot running linux binaries), I can't ls them. I can provide more details but I'm not in front of my computer right now. What do you need ? Note that the missing files are scattered throughout the volume, no relation to the inode number, as shown on a diff: @@ -1,8 +1,6 @@ 3 7 drwxr-xr-x 70 pb staff 93 4 mar 19:11 /usr/ports - 4 2 -rw-r--r-- 1 pb staff 241 24 jan 2007 /usr/ports/astro/tclgeomap/pkg-plist 5 3 drwxr-xr-x 2 pb staff 6 22 fév 12:04 /usr/ports/astro/tkgeomap 6 3 drwxr-xr-x 4 pb staff 6 29 jul 2008 /usr/ports/Tools - 7 5 drwxr-xr-x 33 pb staff 34 25 nov 15:59 /usr/ports/accessibility 8 3 drwxr-xr-x 12 pb staff 14 9 fév 2009 /usr/ports/arabic 11 51 drwxr-xr-x 900 pb staff 901 6 mar 14:36 /usr/ports/audio 12 3 -rw-r--r-- 1 pb staff 584 25 aoû 2006 /usr/ports/astro/tkgeomap/pkg-descr @@ -16,10 +14,8 @@ 23 3 drwxr-xr-x 3 pb staff 7 24 mar 2010 /usr/ports/astro/wcslib 24 4 -rw-r--r-- 1 pb staff 1414 5 jan 2010 /usr/ports/astro/wcslib/Makefile 25 5 drwxr-xr-x 31 pb staff 33 1 jan 23:16 /usr/ports/french - 26 2 -rw-r--r-- 1 pb staff 197 5 jan 2010 /usr/ports/astro/wcslib/distinfo 27 63 drwxr-xr-x 1110 pb staff 23 fév 15:37 /usr/ports/games 28 3 drwxr-xr-x 2 pb staff 4 24 mar 2010 /usr/ports/astro/wcslib/files - 29 2 -rw-r--r-- 1 pb staff 236 5 jan 2010 /usr/ports/astro/wcslib/files/6-patch-configure 30 3 -rw-r--r-- 1 pb staff 677 5 jan 2010 /usr/ports/astro/wcslib/files/patch-GNUmakefile 31 2 -rw-r--r-- 1 pb staff 401 17 jul 2009 /usr/ports/astro/wcslib/pkg-descr 32 4 -rw-r--r-- 1 pb staff 1515 5 jan 2010 /usr/ports/astro/wcslib/pkg-plist ... Reverting to an old 9-current kernel (January 10, before the ZFS v28 patches) fixes the problem... -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: oliv...@gid0.org - against HTML email vCards X www: http://www.gid0.org - against proprietary attachments / \ Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas. ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
On Mon, Mar 07, 2011 at 01:08:46AM +0100, Pierre Beyssac wrote: Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). [...] Could you try r219404? -- Pawel Jakub Dawidek http://www.wheelsystems.com FreeBSD committer http://www.FreeBSD.org Am I Evil? Yes, I Am! http://yomoli.com pgpeiqDGOvkQL.pgp Description: PGP signature
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
On 08.03.11 19:40, Pawel Jakub Dawidek wrote: On Mon, Mar 07, 2011 at 01:08:46AM +0100, Pierre Beyssac wrote: Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). [...] Could you try r219404? Yes, that fixed it for me. Thanks, Florian ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
RE: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Interesting - I'm having the same problem, but I thought it was due to some tweaking I was doing to NFS to force it into async mode from a ESX mount, and to remove the last of giant_lock. Now that someone else is having the same problem, maybe it's not my tweaks. I've found that if I create a new folder, and copy the files into that folder, it often fixes it. Sometimes I need to make the folder via NFS for this to work. I just did it twice today in fact. I see that r219404 fixed it for him - What was the change in r219404 that made the difference here? I guess I could go diff the code to find out.. :-) ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Hello Rick, Thanks for your reply. On Mon, Mar 07, 2011 at 06:12:43PM -0500, Rick Macklem wrote: Readdir (in both NFS servers) depends on ZFS to reply EOPNOTSUPP for VFS_VGET() when it cannot be done, so that Readdir will switch to using VP_LOOKUP(). Just a wild guess, but maybe ZFS v28 isn't doing this? My client was plain and simple ls(1). I said readdir(3) because I wrongly assumed ls used that, but actually from looking at the code it looks like it uses fts_open(3) and friends instead... Well, it will end up doing either a Readdir or ReaddirPlus RPC on the wire. (The default for the FreeBSD client is Readdir, but that can be changed with the rdirplus mount option.) It looks like pjd@ has committed a patch that fixes the problem. Thanks pjd@ for doing this, rick ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
On Tue, Mar 08, 2011 at 07:40:19PM +0100, Pawel Jakub Dawidek wrote: Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). Could you try r219404? It's fixed! Great work! Thanks a million! -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). Oh, I forgot to mention that the business related to VFS_VGET() only applies to ReaddirPlus. If your client is using regular Readdir, then I have no idea what it might be? (Assuming that is setting its file system type to zfs so that the cookies don't have to be monotonically increasing values. rick ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). Readdir (in both NFS servers) depends on ZFS to reply EOPNOTSUPP for VFS_VGET() when it cannot be done, so that Readdir will switch to using VP_LOOKUP(). Just a wild guess, but maybe ZFS v28 isn't doing this? rick On the NFS server (files are stored on a ZFS v15 volume, not yet upgraded to the v28 format): % cd /usr/ports/devel/autoconf % ls -i 311401 Makefile 204505 files 204509 pkg-plist 204504 distinfo 204508 pkg-descr On the NFS client side (FreeBSD 8.2-RELEASE): % cd /usr/ports/devel/autoconf % ls -i 204504 distinfo 204508 pkg-descr 204505 files 204509 pkg-plist Yet the missing file can be accessed: % head -3 Makefile # New ports collection makefile for: autoconf # Date created: 7th December 2006 # Whom: a...@freebsd.org Note that the missing files are scattered throughout the volume, no relation to the inode number, as shown on a diff: @@ -1,8 +1,6 @@ 3 7 drwxr-xr-x 70 pb staff 93 4 mar 19:11 /usr/ports - 4 2 -rw-r--r-- 1 pb staff 241 24 jan 2007 /usr/ports/astro/tclgeomap/pkg-plist 5 3 drwxr-xr-x 2 pb staff 6 22 fév 12:04 /usr/ports/astro/tkgeomap 6 3 drwxr-xr-x 4 pb staff 6 29 jul 2008 /usr/ports/Tools - 7 5 drwxr-xr-x 33 pb staff 34 25 nov 15:59 /usr/ports/accessibility 8 3 drwxr-xr-x 12 pb staff 14 9 fév 2009 /usr/ports/arabic 11 51 drwxr-xr-x 900 pb staff 901 6 mar 14:36 /usr/ports/audio 12 3 -rw-r--r-- 1 pb staff 584 25 aoû 2006 /usr/ports/astro/tkgeomap/pkg-descr @@ -16,10 +14,8 @@ 23 3 drwxr-xr-x 3 pb staff 7 24 mar 2010 /usr/ports/astro/wcslib 24 4 -rw-r--r-- 1 pb staff 1414 5 jan 2010 /usr/ports/astro/wcslib/Makefile 25 5 drwxr-xr-x 31 pb staff 33 1 jan 23:16 /usr/ports/french - 26 2 -rw-r--r-- 1 pb staff 197 5 jan 2010 /usr/ports/astro/wcslib/distinfo 27 63 drwxr-xr-x 1110 pb staff 23 fév 15:37 /usr/ports/games 28 3 drwxr-xr-x 2 pb staff 4 24 mar 2010 /usr/ports/astro/wcslib/files - 29 2 -rw-r--r-- 1 pb staff 236 5 jan 2010 /usr/ports/astro/wcslib/files/6-patch-configure 30 3 -rw-r--r-- 1 pb staff 677 5 jan 2010 /usr/ports/astro/wcslib/files/patch-GNUmakefile 31 2 -rw-r--r-- 1 pb staff 401 17 jul 2009 /usr/ports/astro/wcslib/pkg-descr 32 4 -rw-r--r-- 1 pb staff 1515 5 jan 2010 /usr/ports/astro/wcslib/pkg-plist ... Reverting to an old 9-current kernel (January 10, before the ZFS v28 patches) fixes the problem... -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Hello Rick, Thanks for your reply. On Mon, Mar 07, 2011 at 06:12:43PM -0500, Rick Macklem wrote: Readdir (in both NFS servers) depends on ZFS to reply EOPNOTSUPP for VFS_VGET() when it cannot be done, so that Readdir will switch to using VP_LOOKUP(). Just a wild guess, but maybe ZFS v28 isn't doing this? My client was plain and simple ls(1). I said readdir(3) because I wrongly assumed ls used that, but actually from looking at the code it looks like it uses fts_open(3) and friends instead... -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
missing files in readdir(3) on NFS export of ZFS volume (since v28?)
Hello, I'm running a 9-current server as compiled on Sat Mar 5 02:17:14 CET 2011. Since I upgraded to ZFS v28 I noticed missing files from NFS. The files are still accessible through NFS but they don't show up on a readdir(3). On the NFS server (files are stored on a ZFS v15 volume, not yet upgraded to the v28 format): % cd /usr/ports/devel/autoconf % ls -i 311401 Makefile 204505 files204509 pkg-plist 204504 distinfo 204508 pkg-descr On the NFS client side (FreeBSD 8.2-RELEASE): % cd /usr/ports/devel/autoconf % ls -i 204504 distinfo 204508 pkg-descr 204505 files204509 pkg-plist Yet the missing file can be accessed: % head -3 Makefile # New ports collection makefile for:autoconf # Date created: 7th December 2006 # Whom: a...@freebsd.org Note that the missing files are scattered throughout the volume, no relation to the inode number, as shown on a diff: @@ -1,8 +1,6 @@ 37 drwxr-xr-x 70 pb staff 93 4 mar 19:11 /usr/ports - 42 -rw-r--r--1 pb staff 241 24 jan 2007 /usr/ports/astro/tclgeomap/pkg-plist 53 drwxr-xr-x2 pb staff 6 22 fév 12:04 /usr/ports/astro/tkgeomap 63 drwxr-xr-x4 pb staff 6 29 jul 2008 /usr/ports/Tools - 75 drwxr-xr-x 33 pb staff 34 25 nov 15:59 /usr/ports/accessibility 83 drwxr-xr-x 12 pb staff 14 9 fév 2009 /usr/ports/arabic 11 51 drwxr-xr-x 900 pb staff 901 6 mar 14:36 /usr/ports/audio 123 -rw-r--r--1 pb staff 584 25 aoû 2006 /usr/ports/astro/tkgeomap/pkg-descr @@ -16,10 +14,8 @@ 233 drwxr-xr-x3 pb staff 7 24 mar 2010 /usr/ports/astro/wcslib 244 -rw-r--r--1 pb staff1414 5 jan 2010 /usr/ports/astro/wcslib/Makefile 255 drwxr-xr-x 31 pb staff 33 1 jan 23:16 /usr/ports/french -262 -rw-r--r--1 pb staff 197 5 jan 2010 /usr/ports/astro/wcslib/distinfo 27 63 drwxr-xr-x 1110 pb staff 23 fév 15:37 /usr/ports/games 283 drwxr-xr-x2 pb staff 4 24 mar 2010 /usr/ports/astro/wcslib/files -292 -rw-r--r--1 pb staff 236 5 jan 2010 /usr/ports/astro/wcslib/files/6-patch-configure 303 -rw-r--r--1 pb staff 677 5 jan 2010 /usr/ports/astro/wcslib/files/patch-GNUmakefile 312 -rw-r--r--1 pb staff 401 17 jul 2009 /usr/ports/astro/wcslib/pkg-descr 324 -rw-r--r--1 pb staff1515 5 jan 2010 /usr/ports/astro/wcslib/pkg-plist ... Reverting to an old 9-current kernel (January 10, before the ZFS v28 patches) fixes the problem... -- Sent from my FreeBSD server Pierre Beyssac p...@fasterix.frmug.org ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
