Re: Deadlocks / hangs in ZFS

2018-07-13 Thread Slawa Olhovchenkov
On Thu, Jul 12, 2018 at 02:42:29PM +0200, Alexander Leidinger wrote: > __curthread () at ./machine/pcpu.h:230 > 230 __asm("movq %%gs:%1,%0" : "=r" (td) > (kgdb) bt > #0 __curthread () at ./machine/pcpu.h:230 > #1 doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:366 > #2

Re: Deadlocks / hangs in ZFS

2018-07-13 Thread Andriy Gapon
On 12/07/2018 15:42, Alexander Leidinger wrote: > #9  0x81391fbe in arc_check_uma_cache (lowest=-1011712) >     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:4532 Do you have any local modifications to ZFS code? I cannot find that function. -- Andriy Gapon

Re: Deadlocks / hangs in ZFS

2018-07-13 Thread Alexander Leidinger
Quoting Andriy Gapon (from Fri, 13 Jul 2018 14:50:48 +0300): On 12/07/2018 15:42, Alexander Leidinger wrote: #9  0x81391fbe in arc_check_uma_cache (lowest=-1011712)     at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:4532 Do you have any local modifications to ZFS

Re: Deadlocks / hangs in ZFS

2018-07-12 Thread Alexander Leidinger
Quoting Alexander Leidinger (from Mon, 04 Jun 2018 22:31:08 +0200): Quoting Slawa Olhovchenkov (from Sun, 3 Jun 2018 22:28:14 +0300): On Sun, Jun 03, 2018 at 09:14:50PM +0200, Alexander Leidinger wrote: Quoting Alexander Leidinger (from Mon, 28 May 2018 09:02:01 +0200): Quoting

Re: Deadlocks / hangs in ZFS

2018-06-04 Thread Alexander Leidinger
Quoting Slawa Olhovchenkov (from Sun, 3 Jun 2018 22:28:14 +0300): On Sun, Jun 03, 2018 at 09:14:50PM +0200, Alexander Leidinger wrote: Quoting Alexander Leidinger (from Mon, 28 May 2018 09:02:01 +0200): > Quoting Slawa Olhovchenkov (from Mon, 28 May 2018 > 01:06:12 +0300): > >> On Sun,

Re: Deadlocks / hangs in ZFS

2018-06-03 Thread Slawa Olhovchenkov
On Sun, Jun 03, 2018 at 09:14:50PM +0200, Alexander Leidinger wrote: > Quoting Alexander Leidinger (from Mon, 28 > May 2018 09:02:01 +0200): > > > Quoting Slawa Olhovchenkov (from Mon, 28 May 2018 > > 01:06:12 +0300): > > > >> On Sun, May 27, 2018 at 09:41:59PM +0200, Kirill Ponomarev

Re: Deadlocks / hangs in ZFS

2018-06-03 Thread Alexander Leidinger
Quoting Alexander Leidinger (from Mon, 28 May 2018 09:02:01 +0200): Quoting Slawa Olhovchenkov (from Mon, 28 May 2018 01:06:12 +0300): On Sun, May 27, 2018 at 09:41:59PM +0200, Kirill Ponomarev wrote: On 05/22, Slawa Olhovchenkov wrote: > It has been a while since I tried Karl's

Re: Deadlocks / hangs in ZFS

2018-05-28 Thread Slawa Olhovchenkov
On Mon, May 28, 2018 at 09:02:01AM +0200, Alexander Leidinger wrote: > Quoting Slawa Olhovchenkov (from Mon, 28 May 2018 > 01:06:12 +0300): > > > On Sun, May 27, 2018 at 09:41:59PM +0200, Kirill Ponomarev wrote: > > > >> On 05/22, Slawa Olhovchenkov wrote: > >> > > It has

Re: Deadlocks / hangs in ZFS

2018-05-28 Thread Alexander Leidinger
Quoting Slawa Olhovchenkov (from Mon, 28 May 2018 01:06:12 +0300): On Sun, May 27, 2018 at 09:41:59PM +0200, Kirill Ponomarev wrote: On 05/22, Slawa Olhovchenkov wrote: > > It has been a while since I tried Karl's patch the last time, and I > > stopped because it didn't

Re: Deadlocks / hangs in ZFS

2018-05-27 Thread Slawa Olhovchenkov
On Sun, May 27, 2018 at 09:41:59PM +0200, Kirill Ponomarev wrote: > On 05/22, Slawa Olhovchenkov wrote: > > > It has been a while since I tried Karl's patch the last time, and I > > > stopped because it didn't apply to -current anymore at some point. > > > Will what is provided right now in the

Re: Deadlocks / hangs in ZFS

2018-05-27 Thread Kirill Ponomarev
On 05/22, Slawa Olhovchenkov wrote: > > It has been a while since I tried Karl's patch the last time, and I > > stopped because it didn't apply to -current anymore at some point. > > Will what is provided right now in the patch work on -current? > > I am mean yes, after

Re: Deadlocks / hangs in ZFS

2018-05-26 Thread Alexander Leidinger
Quoting Steve Wills (from Tue, 22 May 2018 08:17:00 -0400): I may be seeing similar issues. Have you tried leaving top -SHa running and seeing what threads are using CPU when it hangs? I did and saw pid 17 [zfskern{txg_thread_enter}] using lots of CPU but no disk

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Slawa Olhovchenkov
On Tue, May 22, 2018 at 04:16:32PM +0200, Alexander Leidinger wrote: > > Quoting Slawa Olhovchenkov (from Tue, 22 May 2018 > 15:29:24 +0300): > > > On Tue, May 22, 2018 at 08:17:00AM -0400, Steve Wills wrote: > > > >> I may be seeing similar issues. Have you tried leaving

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Alexander Leidinger
Quoting Slawa Olhovchenkov (from Tue, 22 May 2018 15:29:24 +0300): On Tue, May 22, 2018 at 08:17:00AM -0400, Steve Wills wrote: I may be seeing similar issues. Have you tried leaving top -SHa running and seeing what threads are using CPU when it hangs? I did and saw pid

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Andrea Venturoli
On 05/22/18 10:17, Alexander Leidinger wrote: Hi, does someone else experience deadlocks / hangs in ZFS? Yes, in conjunction with Poudriere, probably when it builds/activates jails. Not sure this is the same problem you are seeing. bye av.

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Luciano Mannucci
On Tue, 22 May 2018 10:17:49 +0200 Alexander Leidinger wrote: > does someone else experience deadlocks / hangs in ZFS? I did experience ZFS hangs on heavy load on relatively big iron (using rsync, in my case). Theh was cured by reducing the amount of available RAM to the

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Slawa Olhovchenkov
On Tue, May 22, 2018 at 08:17:00AM -0400, Steve Wills wrote: > I may be seeing similar issues. Have you tried leaving top -SHa running > and seeing what threads are using CPU when it hangs? I did and saw pid > 17 [zfskern{txg_thread_enter}] using lots of CPU but no disk activity > happening.

Re: Deadlocks / hangs in ZFS

2018-05-22 Thread Steve Wills
I may be seeing similar issues. Have you tried leaving top -SHa running and seeing what threads are using CPU when it hangs? I did and saw pid 17 [zfskern{txg_thread_enter}] using lots of CPU but no disk activity happening. Do you see similar? Steve On 05/22/18 04:17, Alexander Leidinger