Ulrich,No, I am not using spooling, as I understood that this is only of benefit when multiple simultaneous jobs are being written to a single volume.
I am doing one job per volume which means that I need to have multiple volumes from the same pool mounted at the same time in order to do concurrent jobs. To this end I have multiple devices "pointing" at the same disk based pool. This works except for the intermittent problem with allocating a volume as indicated in my original post.
I have attached the configuration from my test system. This a totally contrived configuration that runs 6 jobs every 10 minutes, but I have two production systems configured along the same lines which have this issue. Concurrency is limited to 4 by the number of devices.
Regards Mike Quoting Ulrich Leodolter <ulrich.leodol...@obvsg.at>:
Hello, Have u enabled Spooling? We use the following settings in our FileStorage Maximum Spool Size = 450G Maximum Job Spool Size = 15G Spool Directory = /opt/bacula/spool You need a fast Spool area, maybe dedicated filesystem on SSD, to get good performance. You also need to set concurrency in different places (Storage, Director), see Bacula manual. Maximum Concurrent Jobs = XX This works for us since years and we run up to 60 parallel job into single File storage. Best regards Ulrich On Tue, 2013-12-17 at 09:37 +1300, Mike Brady wrote:I asked this question a few weeks ago on the users list but didn't get a response, so thought that I should try here. I am really not sure if I am seeing a bug or that this is something that is not supposed to work. I have a disk based pool and want to run concurrent backups to this pool. I am currently running backups one job at a time to this pool, but doing the backups this way is starting to take too long. A number of the jobs have runscripts that take a while (a couple of hours in one case) to run. During the time that these scripts are running the Bacula server is doing nothing. I realize that I could configure a separate pool/device for some or all of these jobs and get concurrency that way, but this would complicate copy jobs that run later, hence my desire to do concurrent backups to the same pool. I found this examplehttp://toshine.org/etc/bacula-concurrent-jobs-multiple-storage-devices-client-labeled-pools-debian-installation-configuration/ where multiple devices are configured that use the same diskbased pool. This does seem to work in that I do get the desired number of concurrent jobs running, but I get varying numbers of the following messages each time the schedule is run. 20-Nov 00:05 bacula03-sd JobId 9569: Job pfsense03.2013-11-20_00.05.00_31 is waiting. Cannot find any appendable volumes. Please use the "label" command to create a new Volume for: Storage: "FileDevice04" (/bacula_storage/FileDevice) Pool: IncPool Media type: File01 The jobs that I get the messages for vary each time as does the device. The job does retry after 5 minutes and normally runs then. Occasionally I will get a second message for a job, but it always retries and I can not recall ever having a job that didn't run successfully eventually. There are always volumes available. Either existing appendable volumes or capacity with in the pool to create more volumes. I am using the bacula 5.2.13 packages from http://repos.fedorapeople.org/repos/slaanesh/bacula/epel-6/x86_64/ on Centos 6.4 x86_64 with a Postgresql 8.4 database. Is this approach of having multiple devices utilising the same disk based pool a valid approach to doing concurrent backups or is it not supposed to work? I am happy to provide the full configuration files or any other information that may be required. Thanks Mike ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into yourJava,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk _______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
bacula_config.tar.gz
Description: application/gzip
------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
_______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
