>>>>> On Sun, 21 Jun 2020 09:08:49 -0400, Phil Stracchino said: > > On 2020-06-20 14:33, Phil Stracchino wrote: > > OK, two days with zero hung jobs. I am proceeding with re-upgrading > > ONLY the Director (well, and that host's FD) to 9.6.5. > > > That got me three successful jobs, one failed, and two hung. Here's the > failure: > > ... > > Here's the state of the Director:
It is waiting for two clients to say that they have finished (so looks normal to me). > And here's the state of one of the hung clients (the other is the Fedora > client that I don't have a debug build on): > > ... > > Thread 3 (Thread 0x7f3f354c7700 (LWP 7909)): > #0 0x00007f3f3810a4ef in write () from /lib64/libpthread.so.0 > #1 0x00007f3f3816021f in BSOCKCORE::socketWrite (this=0x7f3f2c005458, > len=35938, buf=0x7f3f2c0bb3bc, fd=<optimized out>) at ../lib/bsockcore.h:203 > #2 BSOCKCORE::write_nbytes (nbytes=<optimized out>, ptr=0x7f3f2c0bb3bc > "@", this=<optimized out>) at bsockcore.c:1079 > #3 BSOCKCORE::write_nbytes (this=this@entry=0x7f3f2c005458, > ptr=<optimized out>, nbytes=35938) at bsockcore.c:1064 > #4 0x00007f3f3813a878 in BSOCK::write_nbytes (this=0x7f3f2c005458, > ptr=<optimized out>, nbytes=35938) at bsock.c:831 > #5 0x00007f3f3813977a in BSOCK::send (aflags=0, this=0x7f3f2c005458) at > bsock.c:368 > #6 BSOCK::send (this=this@entry=0x7f3f2c005458, aflags=aflags@entry=0) > at bsock.c:249 > #7 0x000055d4f36730d1 in BSOCK::send (this=0x7f3f2c005458) at > ../lib/bsock.h:75 > #8 process_and_send_data (bctx=...) at backup.c:845 > #9 0x000055d4f36752d0 in send_data (stream=<optimized out>, bctx=...) > at backup.c:655 > #10 save_file (jcr=0x7f3f2c000ed8, ff_pkt=0x7f3f2c001558, > top_level=<optimized out>) at backup.c:502 This is sending data to the SD, but appears to be hanging waiting for the SD to read previous data (i.e. the socket buffer is full in the kernel). Whether this hangs indefinitely will depend on whether the SD really is reading data. Was this job progressing at all? Next time, please include gdb backtraces from the SD as well as the client and Director. __Martin _______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
