Peter Sjoberg wrote:
> I wonder if it's anything I can do to improve the performance when
> inserting the attributes.
> 
> I'm backing up several servers but one specifically is about 86Gb data
> and 1.6Million files. The data backup finish after a few hours (<6) but
> then it (I assume) updates the database with all the attributes and that
> takes >18h!
> 
> Sysinfo:
> The server is a Dual PIII 800MHz with 2G memory
> The db is around 500mb
> The spooled attributes file (I'm spooling attributes and data) is abotu
> 480Mb.
> mysql version: 4.0.18
> 
> During the db update the mysqld proces is using 100% of one cpu.
> I did change /etc/my.cnf to the "large" template and made sure it has
> thread_concurrency=4 but I guess the inserts are single threaded so it
> still ends up running on one cpu.
> 
> I looked a little on variables etc and it seems like the pounding is
> SELECT and INSERT statments.
> 
> Short of getting faster CPU or be more patient, what can I look
> at/change to get it finished a little faster?
> 

Just to insert my 2 pence. Here is the hardware I am running on:
Dual Athlon MP 2400+
512Mb RAM
DB Is around 8Gb
IDE HDDs (RAID1)
JobFiles is: 52991981

I haven't done much in the way of MySQL tuning (yet), but I don't see
many problems with the db when bacula is using it. (3rd Party recover
clients are another story with that many files (50mil of which are one
client).

Most of the problems I see from bacula updates is IO related rather than
CPU related.

I'm not spooling attributes for full backups any longer but don't
remember any such performance problems when I was during testing.

-- 
James Ray
System Administrator.
Computing Services, Queen Mary, Uni. of London

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Reply via email to