Re: zfs i/o hangs on 9-PRERELEASE

2011-12-08 Thread Mark Felder
Hi all, Just wanted to report back that I found time to do more diagnostics. ZFS/FreeBSD/etc are not to blame. ZFS / FreeBSD never reported any I/O errors and scrubs always came up clean because one of the disks was failing and had issues reading the disk but would eventually return accurate

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-28 Thread Pawel Jakub Dawidek
On Fri, Nov 25, 2011 at 01:20:01PM -0600, Mark Felder wrote: 13:14:32 nas:~ uname -a FreeBSD nas.feld.me 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #3 r227971M: Fri Nov 25 10:07:48 CST 2011 r...@nas.feld.me:/usr/obj/tank/svn/sys/GENERIC amd64 This seemed to start happening sometime after

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-28 Thread Rick Macklem
Pawel Jakub Dawidek wrote: On Fri, Nov 25, 2011 at 01:20:01PM -0600, Mark Felder wrote: 13:14:32 nas:~ uname -a FreeBSD nas.feld.me 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #3 r227971M: Fri Nov 25 10:07:48 CST 2011 r...@nas.feld.me:/usr/obj/tank/svn/sys/GENERIC amd64 This seemed to

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-27 Thread Mark Felder
After many hours of testing, reproducing, and testing again I've finally been able to narrow down what the real issue is and it's not ZFS as I suspected. After completely turning off all NFS functionality and serving my files over Samba I haven't had a single issue. It seems there is something

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-26 Thread Andriy Gapon
on 25/11/2011 21:20 Mark Felder said the following: 13:14:32 nas:~ uname -a FreeBSD nas.feld.me 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #3 r227971M: Fri Nov 25 10:07:48 CST 2011 r...@nas.feld.me:/usr/obj/tank/svn/sys/GENERIC amd64 This seemed to start happening sometime after RC1. I

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-26 Thread Mark Felder
It appears that I'm mistaken about those messages then . However this does both happen on my AMD x6 and Intel Atom machines with different hard drives, controllers, etc. I feel it would be unlikely to be hardware. Unfortunately the procstat command is probably of no use because I can't

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-26 Thread Jeremy Chadwick
On Sat, Nov 26, 2011 at 04:47:35PM -0600, Mark Felder wrote: It appears that I'm mistaken about those messages then . However this does both happen on my AMD x6 and Intel Atom machines with different hard drives, controllers, etc. I feel it would be unlikely to be hardware. Unfortunately

zfs i/o hangs on 9-PRERELEASE

2011-11-25 Thread Mark Felder
13:14:32 nas:~ uname -a FreeBSD nas.feld.me 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #3 r227971M: Fri Nov 25 10:07:48 CST 2011 r...@nas.feld.me:/usr/obj/tank/svn/sys/GENERIC amd64 This seemed to start happening sometime after RC1. I tried 8-STABLE and it's happening there too right now. I

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-25 Thread Freddie Cash
On Fri, Nov 25, 2011 at 11:20 AM, Mark Felder f...@feld.me wrote: 13:14:32 nas:~ uname -a FreeBSD nas.feld.me 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #3 r227971M: Fri Nov 25 10:07:48 CST 2011 r...@nas.feld.me:/usr/obj/**tank/svn/sys/GENERIC amd64 This seemed to start happening

Re: zfs i/o hangs on 9-PRERELEASE

2011-11-25 Thread Mark Felder
On 25.11.2011 13:39, Freddie Cash wrote: There's a lot of uma_* stuff in there. Just curious, what's the following sysctl set to: vfs.zfs.zio.use_uma Back in the 8.x days, it was recommended to set it to 0 due to bugs: