Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-06-10 Thread Kern Sibbald
On Friday 10 June 2005 12:46, Ronan Eckelberry wrote: > Hey Kern, > > Just giving an update on this. I added your other suggested indexes, I > also upgraded to MySQL 4.1. That with the changes to my.cnf seem to > have sped up my backups quite a bit. I think a big thing was increasing > the

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-06-10 Thread Ronan Eckelberry
Hey Kern, Just giving an update on this. I added your other suggested indexes, I also upgraded to MySQL 4.1. That with the changes to my.cnf seem to have sped up my backups quite a bit. I think a big thing was increasing the memory for the keys. My top reports a 99.7% key efficiency no

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-24 Thread Kern Sibbald
The most important index is: INDEX (JobId, PathId, FilenameId) The others probably won't help in your case. This is different for PostgreSQL, where you will probably need an index on each of the above Ids by by themselves. The very first time you run Bacula, it will be a bit slower, but should

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-23 Thread Ronan Eckelberry
Thanks a lot Kern. I've got all indexes atm except for "INDEX (FilenameId, PathId)". I'll add that and see what kind of effect it has. I'll reply back to the list with the results. I think my problem may be the amount of small files. Most of the backups are web servers containing a lot of imag

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-20 Thread Kern Sibbald
Hello, Check to make sure you have all the recommended indexes on the File table: # FIXME make FileId BIGINT someday when MySQL works * CREATE TABLE File ( FileId INTEGER UNSIGNED NOT NULL AUTO_INCREMENT, FileIndex INTEGER UNSIGNED NOT NULL DEFAULT 0, JobId INTEGER UNSIGNED N

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-13 Thread Ronan Eckelberry
I am running the backports pkg for MySQL 4. I'm backup up somewhere around 70-80 servers. Most all with web content. Some servers have anywhere from 100G to 500G of content on them. Not exactly sure what it causing the slow down, but it is a pain when full backups come around. -Ronan On Fri,

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-13 Thread Simon Weller
On Fri, 2005-05-13 at 08:03 -0400, Ronan Eckelberry wrote: > Does anyone have experience with large backups off of many servers > (specifically web servers)? I'm trying to see why it is that backups > slow down significantly after running for awhile. This is eventually > leading to bacula hanging

Re: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-13 Thread Ronan Eckelberry
Does anyone have experience with large backups off of many servers (specifically web servers)? I'm trying to see why it is that backups slow down significantly after running for awhile. This is eventually leading to bacula hanging. Should I switch databases? Not quite sure where the bottleneck

Re: AW: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-12 Thread Ronan Eckelberry
t; Gesendet: Donnerstag, 12. Mai 2005 07:43 > An: Bacula List > Betreff: [Bacula-users] Question Bacula/MySQL/Large backups > > Hi all, > > I run rather large backups, about 70+ servers, 1 Full a month, rest > daily incrementals. All disk -> disk backups. At the time of

Re: AW: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-12 Thread Peter Eriksson
er table Path add Index (Path(255)); > > Please report back if this solved your problems. > > Bye > Roland > > > > -Ursprüngliche Nachricht- > Von: Ronan Eckelberry [mailto:[EMAIL PROTECTED] > Gesendet: Donnerstag, 12. Mai 2005 07:43 > An: Bacula List >

AW: [Bacula-users] Question Bacula/MySQL/Large backups

2005-05-12 Thread Roland Arendes
richt- Von: Ronan Eckelberry [mailto:[EMAIL PROTECTED] Gesendet: Donnerstag, 12. Mai 2005 07:43 An: Bacula List Betreff: [Bacula-users] Question Bacula/MySQL/Large backups Hi all, I run rather large backups, about 70+ servers, 1 Full a month, rest daily incrementals. All disk -> disk

[Bacula-users] Question Bacula/MySQL/Large backups

2005-05-11 Thread Ronan Eckelberry
Hi all, I run rather large backups, about 70+ servers, 1 Full a month, rest daily incrementals. All disk -> disk backups. At the time of full backups I can be pulling anywhere from 1.5-3TB of total data from the servers. Backups start out great, pulling a few megs a piece from a