On Thu, Nov 19, 2015 at 03:58:44PM +1100, Paul Ripke wrote: > It's been a while, but here we are again: > > slave:ksh$ uname -a > NetBSD slave 7.0_RC2 NetBSD 7.0_RC2 (SLAVE) #5: Sun Aug 9 16:17:05 EST 2015 > stix@slave:/h > slave:ksh$ find /home/stix/src/compilers/llvm/llvm/.svn/pristine -ls > > /dev/null > find: /home/stix/src/compilers/llvm/llvm/.svn/pristine/85: Bad file descriptor > find: /home/stix/src/compilers/llvm/llvm/.svn/pristine/b4: Bad file descriptor > ome/netbsd/netbsd-7/obj.amd64/home/netbsd/netbsd-7/src/sys/arch/amd64/compile/SLAVE > amd64 > > This time, they're directories, not files. And they're cold, apart > from find(1) and dump(8). Perhaps there's a one in a billion race with > st_atime updates? > > Also: > > fsdb (inum: 62772027)> cd 85 > command `cd 85 > ' > component `85': current inode 71225600: unallocated inode > current inode: unallocated > I=71225600 MODE=20 SIZE=110740547584 > MTIME=Jun 2 17:06:40 1970 [-1992935936 nsec] > Memory fault (core dumped) > > yay :/
I should add: shortly afterwards, it got a little worse, and the following directory inodes got clobbered: /pgsql/data/global /pgsql/data/pg_xlog /pgsql/data/pg_clog /pgsql/data/pg_notify /pgsql/data/pg_serial fsck repaired what it could, and re-attached a bunch of unnamed files into lost+found - that's after a clean umount. I haven't even bothered rebooting as yet. Looks like postgresql committed suicide around [22/Nov/2015:01:06:54 +1100] according to the apache logs. This seems to coincide with the following rsync pulling from netbsd.org: /usr/pkg/bin/rsync -azvC --stats --del --exclude CVSROOT \ --exclude htdocs --exclude othersrc anoncvs.NetBSD.org::cvsroot \ /home/netbsd/cvsroot/ That's way too much of a coincidence for my liking. Different file hierarchy, but it's the same filesystem. I've now switched to using --delete-delay, rather than --delete-during (aka --del), perhaps that'll work around the issue? -- Paul Ripke "Great minds discuss ideas, average minds discuss events, small minds discuss people." -- Disputed: Often attributed to Eleanor Roosevelt. 1948.
