[Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Robert Heinzmann
Hello, we have a rather large Bacula setup - ~600 Clients, database for catalog is 19GB large. File table is ~65 million records. Right now, bacula director can not run backups as scheduled and delays the jobs for up to 2 hours, as it seems the catalog is not keeping up. CPU usage on SD is:

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread John Drescher
we have a rather large Bacula setup - ~600 Clients, database for catalog is 19GB large. File table is ~65 million records. Right now, bacula director can not run backups as scheduled and delays the jobs for up to 2 hours, as it seems the catalog is not keeping up. CPU usage on SD is: 25%

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Josh Fisher
On 3/24/2015 12:57 PM, Robert Heinzmann wrote: One more question for clarification: Attribute spooling only solves insert and update issues and not select issues right ? Our monitoring shows that we only have 10 -20 inserts/s for the DB but the selects are capped at ~370 selects/second

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Heitor Faria
IMHO I know that there are several MySQL tunings that can be made, but one that I tested that really improves the writing times in a factor of more than 1000 is the enabling of synchronous mode transactions: innodb_flush_log_at_trx_commit = 0 innodb_flush_method = O_DIRECT Regards,

Re: [Bacula-users] Volumes purged but not recycled

2015-03-24 Thread Michael Schwager
On Mon, Mar 23, 2015 at 10:43 AM, Ana Emília M. Arruda emiliaarr...@gmail.com wrote: When the volumes 16 to 26 were created, do you had Recycle = yes configured in this pool? It seems that these volumes were created without this option configured in your pool. Every change you made in your

Re: [Bacula-users] Volumes purged but not recycled

2015-03-24 Thread Ana Emília M . Arruda
Hi Michael, Bacula will only recycle a volume when there is no appendable volume in the pool. If automatic volume labeling is configured, it will try to label a new one. If none of this occurs, then it will try to recycle one. And when Bacula recycles a volume it overwrites the contents of that

Re: [Bacula-users] Volumes purged but not recycled

2015-03-24 Thread Michael Schwager
On Tue, Mar 24, 2015 at 1:04 PM, Michael Schwager mschwa...@mochotrading.com wrote: The question then is: How do I get a Purged, Recycle-able tape to get written to starting at the beginning? Do I need to delete it and re-add it? ​Ooops- I figured it out. The order of operations that was

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Robert Heinzmann
One more question for clarification: Attribute spooling only solves insert and update issues and not select issues right ? Our monitoring shows that we only have 10 -20 inserts/s for the DB but the selects are capped at ~370 selects/second during peak times. Regards, Robert

[Bacula-users] storeage authentication for new client / job

2015-03-24 Thread Gary Stainburn
Hi folks. I've set no a new server 'eddienew' which is going to replace 'eddie' I've copied /etc/bacula/clients/eddie.conf to eddienew.conf and edited accordingly. The results are below. All I have done is change every instance of 'eddie' to 'eddienew' and for completeness changed the

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Robert Heinzmann
Hello, If you do not have attribute spooling enabled enable that. Also tune your mysql database. The defaults in a lot of systems assume you have only 64MB of ram or similar. Database already is on innodb and fast BBU supported storage and has innodb_buffer_size dataset size, so

Re: [Bacula-users] storeage authentication for new client / job

2015-03-24 Thread Ana Emília M . Arruda
Hi Gary, You have a Bacula´s storage version older than your new client´s version: storage: zeppo-sd Version: 5.0.0 (26 January 2010) x86_64-redhat-linux-gnu redhat client: eddienew-fd Version: 7.0.5 (28 July 2014) x86_64-redhat-linux-gnu redhat One) It is not recommended to have a client

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread John Drescher
One more question for clarification: Attribute spooling only solves insert and update issues and not select issues right ? Correct. Our monitoring shows that we only have 10 -20 inserts/s for the DB but the selects are capped at ~370 selects/second during peak times. I would expect

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread John Drescher
How much space do I need in the working directory of the SD to do attribute spooling ? I expect for your dataset less than 1GB. John -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored

Re: [Bacula-users] Bacula 5.2.13 ClientRunAfterJob

2015-03-24 Thread Peter Wood
Thank you for the replies. Seems that external script is the way to go. Thank you, On Sat, Mar 21, 2015 at 10:22 PM, Davide Franco bacula-...@dflc.ch wrote: Hi Peter, As Kern mentioned, I'd mention a shell script instead of the whole command in the Job definition. I do this on my jobs and

Re: [Bacula-users] Bacula Catalog Server - MySQL - 1 Core Used Max ?

2015-03-24 Thread Phil Stracchino
On 03/24/15 11:47, Robert Heinzmann wrote: Hello, we have a rather large Bacula setup - ~600 Clients, database for catalog is 19GB large. File table is ~65 million records. Right now, bacula director can not run backups as scheduled and delays the jobs for up to 2 hours, as it seems the