Whoa. Your FD on your desktop is a higher version than the dir and SD? That's definitely not supported. The FD should be equal or lower version than the dir and SD. The dir and SD versions must always match. I've seen it said on this list that differences in build number (13.0.4-5 vs 13.0.4-7) generally doesn't matter.
There was a bug that broke some of that backwards compatibility in 13.x. It was fixed in 13.0.4. Because you are running 13.0.4, that bug shouldn't impact you AFAIK. I can't guarantee that lowering the FD version will do the job, but it should certainly be addressed. You've tested network performance, and by resetting the database you've theoretically eliminated database performance. What about disk performance? Maybe time some writes to disk and measure the speed you get. To be thorough I'd check the throughput of writes to the local disk the database lives on, and to the filestor where the volumes live. Maybe use dd if=/dev/urandom of=/path/to/your/target/filesystem.img status=progress bs=1G count=5 Replace urandom with zero for the fastest, but more compressible (and thus less accurate) result. There have been performance reduction over time issues for some intel raptor lake processors, especially in the high end. One of the symptoms reported was massive slowdowns in compression. Don't know if that could apply to you or your hardware. Could try disabling fileset compression to see if the performance improves. Failing hard drives often get slower before they quit altogether. Have you thoroughly checked the health of the drives in the filestor? It's interesting that your throughout went from 25-26 to 11.5. That's almost exactly half. If you had a raid 10 array on the filestor and lost half of it, I'd expect those results. How many concurrent jobs do you usually run? Robert Gerber 402-237-8692 [email protected] On Thu, Sep 18, 2025, 8:23 AM Dave Tibbetts <[email protected]> wrote: > Another slow backup issue and I'm hoping someone can help. > > I'm running Bacula 13.04 on Ubuntu 25.04. > It's been running fine for several years over many Bacula and OS upgrades. > > Suddenly on 3 August 2025, my backup speed was cut by about half. I have a > desktop that typically would run about 25 to 26 MB/s and is now running at > 11.5. This is running via ethernet. > > I'm seeing the same with another machine that's also on ethernet and a > wireless laptop. > > I'm using virtual tapes in the filestor, and the bacula director and > storage are on the same machine. Again, small setup and been very reliable. > > SpoolAttributes is set on for all jobs. > > > > > > > > > > > > > > > > > > > *I ran iperf from my desktop to my server and got solid numbers: [ ID] > Interval Transfer Bitrate Retr Cwnd [ 5] > 0.00-1.00 sec 12.4 MBytes 104 Mbits/sec 0 255 KBytes [ > 5] 1.00-2.00 sec 11.4 MBytes 95.5 Mbits/sec 0 255 KBytes > [ 5] 2.00-3.00 sec 11.0 MBytes 92.3 Mbits/sec 0 255 > KBytes [ 5] 3.00-4.00 sec 11.5 MBytes 96.4 Mbits/sec 0 > 255 KBytes [ 5] 4.00-5.00 sec 10.9 MBytes 91.2 Mbits/sec > 0 255 KBytes [ 5] 5.00-6.00 sec 11.5 MBytes 96.5 > Mbits/sec 0 255 KBytes [ 5] 6.00-7.00 sec 10.9 MBytes > 91.2 Mbits/sec 0 255 KBytes [ 5] 7.00-8.00 sec 11.5 > MBytes 96.5 Mbits/sec 0 255 KBytes [ 5] 8.00-9.00 sec > 11.4 MBytes 95.4 Mbits/sec 0 255 KBytes [ 5] 9.00-10.00 > sec 11.0 MBytes 92.2 Mbits/sec 0 255 KBytes - - - - - - - - > - - - - - - - - - - - - - - - - - [ ID] Interval Transfer > Bitrate Retr [ 5] 0.00-10.00 sec 113 MBytes 95.1 > Mbits/sec 0 sender [ 5] 0.00-10.02 sec 112 MBytes 94.1 > Mbits/sec receiver *I tried using ethtool to tweak the > NIC's - > > > * ethtool -K eno1 tso off gso off gro off But that didn't help. * > I went back through the Bacula archives and tried many, many different > things - none of which helped. I finally decided to just delete the rebuild > the Postgresql database and delete all the virtual tapes. > > So I brought everything back up and started a backup on a brand new > catalog. Same throughput 11.5 MB/s > Bugs-Bunny-dir JobId 1: End auto prune. > Bugs-Bunny-dir JobId 1: No Files found to prune. > Bugs-Bunny-dir JobId 1: Begin pruning Files. > Bugs-Bunny-dir JobId 1: No Jobs found to prune. > Bugs-Bunny-dir JobId 1: Begin pruning Jobs older than 1 month 16 days . > Bugs-Bunny-dir JobId 1: Bacula Enterprise Bugs-Bunny-dir 13.0.4 (12Feb24): > Build OS: x86_64-pc-linux-gnu-bacula-enterprise ubuntu > 22.04 > JobId: 1 > Job: Backup_Bullwinkle.2025-09-17_15.58.07_17 > Backup Level: Full (upgraded from Incremental) > Client: "Bullwinkle-fd" 15.0.3 (25Mar25) > x86_64-redhat-linux-gnu,redhat,; > FileSet: "Bullwinkle Set" 2025-09-17 15:58:07 > Pool: "File" (From Command input) > Catalog: "MyCatalog" (From Client resource) > Storage: "Filestor" (From Command input) > Scheduled time: 17-Sep-2025 15:58:07 > Start time: 17-Sep-2025 15:58:09 > End time: 18-Sep-2025 06:48:23 > Elapsed time: 14 hours 50 mins 14 secs > Priority: 10 > FD Files Written: 145,410 > SD Files Written: 145,410 > FD Bytes Written: 618,967,362,190 (618.9 GB) > SD Bytes Written: 618,992,689,163 (618.9 GB) > Rate: 11588.1 KB/s > Software Compression: 2.5% 1.0:1 > Comm Line Compression: 5.2% 1.1:1 > Snapshot/VSS: no > Encryption: no > Accurate: no > Volume name(s): > Oviedo0001|Oviedo0002|Oviedo0003|Oviedo0004|Oviedo0005|Oviedo0006|Oviedo0007|Oviedo0008|Oviedo0009|Oviedo0010|Oviedo0011|Oviedo0012|Oviedo0013|Oviedo0014|Oviedo0015|Oviedo0016|Oviedo0017|Oviedo0018|Oviedo0019|Oviedo0020|Oviedo0021|Oviedo0022|Oviedo0023|Oviedo0024|Oviedo0025|Oviedo0026|Oviedo0027|Oviedo0028|Oviedo0029|Oviedo0030|Oviedo0031|Oviedo0032|Oviedo0033|Oviedo0034|Oviedo0035|Oviedo0036|Oviedo0037|Oviedo0038|Oviedo0039| > Volume Session Id: 1 > Volume Session Time: 1758138994 > Last Volume Bytes: 7,428,533,207 (7.428 GB) > Non-fatal FD errors: 0 > SD Errors: 0 > FD termination status: OK > SD termination status: OK > Termination: Backup OK > Bugs-Bunny-sd JobId 1: Sending spooled attrs to the Director. Despooling > 40,737,115 bytes ... > Bugs-Bunny-sd JobId 1: Elapsed time=14:49:57, Transfer rate=11.59 M > Bytes/second > > Is it something crazy like my FD on the desktop is 15.0.3 and the server > is running 13.04? > > I'm just totally out of ideas. What am I missing? > > Thanks, > Dave > > > > _______________________________________________ > Bacula-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/bacula-users >
_______________________________________________ Bacula-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/bacula-users
