>>>>> On Mon, 15 Jun 2020 08:18:59 -0400, Phil Stracchino said: > > Hey folks, > Yesterday I upgraded from 9.6.3 to 9.6.5. My overnight backups are > running incredibly slowly. > > Basic setup is the following: > > asgard - SD, client - Solaris 11.3 > minbar - Director, client - Gentoo Linux > babylon5, narn - Gentoo Linux clients > fisherprice - Fedora 31 client, still running 9.4.4 fd > > Storage medium is 12TB of RAIDZ SATA disk. > > This being a Monday that is not the first Monday of the month, > differential backups are running. Asgard's differential ran in 23 > seconds and backed up 5,907 files totalling 255.8MB, for an overall rate > just over 11MB/s. > > The remaining clients - all of the over-the-wire clients - have been > running for three and a half hours, have written no more than about 40MB > each, and appear to be completely stalled. Director status appears > entirely normal. No errors have been logged, and the status of all ZFS > pools on the SD is good. Nothing looks out of place on the network. > > > I don't see anything in the 9.6.4/9.6.5 release notes that would account > for this. > > Does anyone have any diagnostic suggestions to figure out what's going > on here?
I assume you have already used status client to see if it is making any progress on files/bytes and which file it is backing up. Next I would start by using ps and/or top to see if the daemons are using any CPU time. You could also try attaching gdb to the daemons and using "thread apply all bt" to see backtraces (assuming there is enough debug info). I would start with one of the clients to see what it is waiting for and then move on to the storage daemon. > As far as I know I cannot interactively turn on debugging > without restarting the daemons. You can turn on debugging in the Director from bconsole by setdebug level=n trace=1 dir It will write the debug info to a file DirectorName.trace in the working directory. Similarly, for the other daemons use storage= or client= instead of dir. __Martin _______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
