[Bacula-users] speed up my backups

2011-04-19 Thread hymie!
So one of my machines has a few zillion tiny little files. My full backup took 44 hours. I can deal with that if I have to. My incremental backup has been running for 10 hours now. Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0 Files Examined=14,675,372 I know that bacula has

Re: [Bacula-users] speed up my backups

2011-04-19 Thread Marcello Romani
Il 19/04/2011 15:37, hymie! ha scritto: So one of my machines has a few zillion tiny little files. My full backup took 44 hours. I can deal with that if I have to. My incremental backup has been running for 10 hours now. Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0

Re: [Bacula-users] speed up my backups

2011-04-19 Thread Christian Manal
Am 19.04.2011 15:37, schrieb hymie!: So one of my machines has a few zillion tiny little files. My full backup took 44 hours. I can deal with that if I have to. My incremental backup has been running for 10 hours now. Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0 Files

Re: [Bacula-users] speed up my backups

2011-04-19 Thread hymie!
Maybe I can answer to follow-ups at once. Easy one first: Il 19/04/2011 15:37, hymie! ha scritto: So one of my machines has a few zillion tiny little files. My full backup took 44 hours. I can deal with that if I have to. My incremental backup has been running for 10 hours now.

Re: [Bacula-users] speed up my backups

2011-04-19 Thread John Drescher
So one of my machines has a few zillion tiny little files. My full backup took 44 hours.  I can deal with that if I have to. My incremental backup has been running for 10 hours now.    Files=71,560 Bytes=273,397,510 Bytes/sec=7,666 Errors=0    Files Examined=14,675,372 I know that bacula

Re: [Bacula-users] speed up my backups

2011-04-19 Thread Josh Fisher
On 4/19/2011 10:21 AM, hymie! wrote: Marcello Romani writes: Maybe it's not relevant to your case, but have you tried to enable spooling ? I don't think spooling will solve my problem. First off, I'm using disks as my storage, not tapes; spooling is not recommended. Second, the bottleneck

Re: [Bacula-users] speed up my backups

2011-04-19 Thread John Stoffel
hymie! So one of my machines has a few zillion tiny little files. Here's your problem right there. Reading all the metadata for those files is the killer. If the client is beefy enough, you can try splitting it up so there are multiple readers all hitting the disk at once. This will