Re: [Bacula-users] tuning lto-4
On Thu, Dec 15, 2011 at 10:25:04AM -0800, gary artim wrote: no, full, doing a mod on run command in bconsole to force full backup on every test. cheers 40MB/sec sounds very much like a natural RAID speed limit you're hitting. Have you tried running some i/o benchmarks on the disks like bonnie+ or dd? Cheers, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tuning lto-4
Il 15/12/2011 20:31, gary artim ha scritto: will do, interestingly I picked another slot on my autochanger (different lto vol) and got (see below), running a peak time no less. Last nite I ran a 9pm, the hours of the dead, and was getting about 2.4gb min, today 2.66gb min. -- go figure... 15-Dec 10:58 bacula-dir JobId 1: Bacula bacula-dir 5.0.3 (04Aug10): 15-Dec-2011 10:58:11 Build OS: x86_64-redhat-linux-gnu redhat JobId: 1 Job:Prodbackup.2011-12-15_09.20.55_03 Backup Level: Full Client: bacula-fd 5.0.3 (04Aug10) x86_64-redhat-linux-gnu,redhat, FileSet:FileSetProd 2011-12-15 09:20:55 Pool: FullProd (From Job FullPool override) Catalog:MyCatalog (From Client resource) Storage:LTO-4 (From Job resource) Scheduled time: 15-Dec-2011 09:20:47 Start time: 15-Dec-2011 09:20:58 End time: 15-Dec-2011 10:58:11 Elapsed time: 1 hour 37 mins 13 secs Priority: 10 FD Files Written: 35,588 SD Files Written: 35,588 FD Bytes Written: 257,543,473,820 (257.5 GB) SD Bytes Written: 257,548,885,611 (257.5 GB) Rate: 44152.8 KB/s Software Compression: None VSS:no Encryption: no Accurate: no Volume name(s): fufu01 Volume Session Id: 1 Volume Session Time:1323969555 Last Volume Bytes: 257,601,203,200 (257.6 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:Backup OK On Thu, Dec 15, 2011 at 11:25 AM, John Drescher dresche...@gmail.com wrote: On Thu, Dec 15, 2011 at 2:24 PM, gary artim gar...@gmail.com wrote: no, seperate drive. g. Try enabling attribute spooling. Like the other poster said. John -- 10 Tips for Better Server Consolidation Server virtualization is being driven by many needs. But none more important than the need to reduce IT complexity while improving strategic productivity. Learn More! http://www.accelacomm.com/jaw/sdnl/114/51507609/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Was that job run supposed to use data spooling ? I ask because I have SpoolData = yes in job definitions (and that automatically enables SpoolAttributes = yes, btw), and I get messages like this: 15-dic 21:47 serverlinux-dir JobId 7965: Start Backup JobId 7965, Job=FileServerTape.2011-12-15_21.15.00_18 15-dic 21:47 serverlinux-dir JobId 7965: Using Device TapeStorage 15-dic 21:47 serverlinux-dir JobId 7965: FD compression disabled for this Job because AllowCompress=No in Storage resource. 15-dic 21:48 serverlinux-sd JobId 7965: Recycled volume ThursdayTape on device TapeStorage (/dev/nst0), all previous data lost. 15-dic 21:48 serverlinux-sd JobId 7965: Spooling data ... 15-dic 23:10 serverlinux-sd JobId 7965: Job write elapsed time = 01:22:17, Transfer rate = 8.879 M Bytes/second 15-dic 23:10 serverlinux-sd JobId 7965: Committing spooled data to Volume ThursdayTape. Despooling 43,882,656,406 bytes ... 15-dic 23:52 serverlinux-sd JobId 7965: Despooling elapsed time = 00:42:04, Transfer rate = 17.38 M Bytes/second 15-dic 23:54 serverlinux-sd JobId 7965: Sending spooled attrs to the Director. Despooling 31,284,446 bytes ... 15-dic 23:55 serverlinux-dir JobId 7965: Bacula serverlinux-dir 5.0.2 (28Apr10): 15-dic-2011 23:55:20 Build OS: i486-pc-linux-gnu debian 5.0.4 JobId: 7965 Job:FileServerTape.2011-12-15_21.15.00_18 Backup Level: Full Client: fileserver-fd 2.4.4 (28Dec08) x86_64-pc-linux-gnu,debian,lenny/sid FileSet:LinuxDefaultSet 2011-09-15 09:11:26 Pool: Tape (From Job resource) Catalog:MyCatalog (From Client resource) Storage:Tape (From Job resource) Scheduled time: 15-dic-2011 21:15:00 Start time: 15-dic-2011 21:47:57 End time: 15-dic-2011 23:55:20 Elapsed time: 2 hours 7 mins 23 secs Priority: 11 FD Files Written: 86,344 SD Files Written: 86,344 FD Bytes Written: 43,822,576,114 (43.82 GB) SD Bytes Written: 43,839,416,416 (43.83 GB) Rate: 5733.7 KB/s Software Compression: None VSS:no Encryption: no Accurate: no Volume name(s): ThursdayTape Volume Session Id: 242 Volume Session Time:1323245911 Last Volume Bytes: 60,996,096,000 (60.99 GB) Non-fatal FD errors:
Re: [Bacula-users] tuning lto-4
I'm working on going to SATA 3, current raid is SATA 1 (1.5). I have run benchmarks, but have to dig (find) them or rerun...g.) On Fri, Dec 16, 2011 at 1:18 AM, Uwe Schuerkamp uwe.schuerk...@nionex.net wrote: On Thu, Dec 15, 2011 at 10:25:04AM -0800, gary artim wrote: no, full, doing a mod on run command in bconsole to force full backup on every test. cheers 40MB/sec sounds very much like a natural RAID speed limit you're hitting. Have you tried running some i/o benchmarks on the disks like bonnie+ or dd? Cheers, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tuning lto-4
No, just Spool Attributes = yes. g. On Fri, Dec 16, 2011 at 3:27 AM, Marcello Romani mrom...@ottotecnica.com wrote: Il 15/12/2011 20:31, gary artim ha scritto: will do, interestingly I picked another slot on my autochanger (different lto vol) and got (see below), running a peak time no less. Last nite I ran a 9pm, the hours of the dead, and was getting about 2.4gb min, today 2.66gb min. -- go figure... 15-Dec 10:58 bacula-dir JobId 1: Bacula bacula-dir 5.0.3 (04Aug10): 15-Dec-2011 10:58:11 Build OS: x86_64-redhat-linux-gnu redhat JobId: 1 Job: Prodbackup.2011-12-15_09.20.55_03 Backup Level: Full Client: bacula-fd 5.0.3 (04Aug10) x86_64-redhat-linux-gnu,redhat, FileSet: FileSetProd 2011-12-15 09:20:55 Pool: FullProd (From Job FullPool override) Catalog: MyCatalog (From Client resource) Storage: LTO-4 (From Job resource) Scheduled time: 15-Dec-2011 09:20:47 Start time: 15-Dec-2011 09:20:58 End time: 15-Dec-2011 10:58:11 Elapsed time: 1 hour 37 mins 13 secs Priority: 10 FD Files Written: 35,588 SD Files Written: 35,588 FD Bytes Written: 257,543,473,820 (257.5 GB) SD Bytes Written: 257,548,885,611 (257.5 GB) Rate: 44152.8 KB/s Software Compression: None VSS: no Encryption: no Accurate: no Volume name(s): fufu01 Volume Session Id: 1 Volume Session Time: 1323969555 Last Volume Bytes: 257,601,203,200 (257.6 GB) Non-fatal FD errors: 0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination: Backup OK On Thu, Dec 15, 2011 at 11:25 AM, John Drescher dresche...@gmail.com wrote: On Thu, Dec 15, 2011 at 2:24 PM, gary artim gar...@gmail.com wrote: no, seperate drive. g. Try enabling attribute spooling. Like the other poster said. John -- 10 Tips for Better Server Consolidation Server virtualization is being driven by many needs. But none more important than the need to reduce IT complexity while improving strategic productivity. Learn More! http://www.accelacomm.com/jaw/sdnl/114/51507609/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users Was that job run supposed to use data spooling ? I ask because I have SpoolData = yes in job definitions (and that automatically enables SpoolAttributes = yes, btw), and I get messages like this: 15-dic 21:47 serverlinux-dir JobId 7965: Start Backup JobId 7965, Job=FileServerTape.2011-12-15_21.15.00_18 15-dic 21:47 serverlinux-dir JobId 7965: Using Device TapeStorage 15-dic 21:47 serverlinux-dir JobId 7965: FD compression disabled for this Job because AllowCompress=No in Storage resource. 15-dic 21:48 serverlinux-sd JobId 7965: Recycled volume ThursdayTape on device TapeStorage (/dev/nst0), all previous data lost. 15-dic 21:48 serverlinux-sd JobId 7965: Spooling data ... 15-dic 23:10 serverlinux-sd JobId 7965: Job write elapsed time = 01:22:17, Transfer rate = 8.879 M Bytes/second 15-dic 23:10 serverlinux-sd JobId 7965: Committing spooled data to Volume ThursdayTape. Despooling 43,882,656,406 bytes ... 15-dic 23:52 serverlinux-sd JobId 7965: Despooling elapsed time = 00:42:04, Transfer rate = 17.38 M Bytes/second 15-dic 23:54 serverlinux-sd JobId 7965: Sending spooled attrs to the Director. Despooling 31,284,446 bytes ... 15-dic 23:55 serverlinux-dir JobId 7965: Bacula serverlinux-dir 5.0.2 (28Apr10): 15-dic-2011 23:55:20 Build OS: i486-pc-linux-gnu debian 5.0.4 JobId: 7965 Job: FileServerTape.2011-12-15_21.15.00_18 Backup Level: Full Client: fileserver-fd 2.4.4 (28Dec08) x86_64-pc-linux-gnu,debian,lenny/sid FileSet: LinuxDefaultSet 2011-09-15 09:11:26 Pool: Tape (From Job resource) Catalog: MyCatalog (From Client resource) Storage: Tape (From Job resource) Scheduled time: 15-dic-2011 21:15:00 Start time: 15-dic-2011 21:47:57 End time: 15-dic-2011 23:55:20 Elapsed time: 2 hours 7 mins 23 secs Priority: 11 FD Files Written: 86,344 SD Files Written: 86,344 FD Bytes Written: 43,822,576,114 (43.82 GB) SD Bytes Written: 43,839,416,416 (43.83 GB) Rate: 5733.7 KB/s Software Compression: None VSS: no Encryption: no Accurate: no Volume name(s): ThursdayTape Volume
