Re: [Bacula-users] Job transfer rate

2014-10-31 Thread Jeff MacDonald
Its def disk IO on the client OR disk/database io on the bacula director. Its all a symptom of too much VM on not enough hardware. Jeff. On Oct 30, 2014, at 2:26 PM, John Lockard jlock...@umich.edu wrote: Yes, but which IO? Disk IO on the client? Network IO from the client to the

[Bacula-users] Job transfer rate

2014-10-30 Thread Jeff MacDonald
Hi, I have some backups going at 2MB/s which for a 380gig backup is just too slow. I’m trying to find my bottleneck. Some questions: - Is the rate of the backup only shown in “messages” or is it stored in the db anywhere. Or could I just do jobbytes / endtime-starttime in the jobs table? -

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread John Drescher
On Thu, Oct 30, 2014 at 9:27 AM, Jeff MacDonald j...@terida.com wrote: Hi, I have some backups going at 2MB/s which for a 380gig backup is just too slow. I’m trying to find my bottleneck. Some questions: - Is the rate of the backup only shown in “messages” or is it stored in the db

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 06:27 AM, Jeff MacDonald wrote: Hi, I have some backups going at 2MB/s which for a 380gig backup is just too slow. I’m trying to find my bottleneck. Some questions: - Is the rate of the backup only shown in “messages” or is it stored in the db anywhere. Or could I just do

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Jeff MacDonald
Tips/Suggestions? Jeff. What is the content of your backups? Some things (ie thousands of tiny files) will cause a lot of seeks on the machine to be backed up. If you aren't using attribute spooling then each backed up file also causes a record to be inserted in to the database,

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 07:50 AM, Jeff MacDonald wrote: Tips/Suggestions? Jeff. What is the content of your backups? Some things (ie thousands of tiny files) will cause a lot of seeks on the machine to be backed up. If you aren't using attribute spooling then each backed up file also causes a record

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Jeff MacDonald
On Oct 30, 2014, at 12:17 PM, Bryn Hughes li...@nashira.ca wrote: The job report rate will be the final average rate of the job, it doesn't know/specify the difference between the 'input' rate and the 'output' rate. Yep, you're going to need to do some investigation on the storage side of

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread John Drescher
Making a stronger and stronger arguement for me to recommend dedicated bacula appliance. 16 gigs of ram, 4 cores. 1tb of 7200 for postgres and a tape drive :) Maybe an enterprise ssd for postgres. John --

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Jeff MacDonald
On Oct 30, 2014, at 12:36 PM, John Drescher dresche...@gmail.com wrote: Making a stronger and stronger arguement for me to recommend dedicated bacula appliance. 16 gigs of ram, 4 cores. 1tb of 7200 for postgres and a tape drive :) Maybe an enterprise ssd for postgres. John Agreed,

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Bryn Hughes
On 14-10-30 08:27 AM, Jeff MacDonald wrote: On Oct 30, 2014, at 12:17 PM, Bryn Hughes li...@nashira.ca wrote: The job report rate will be the final average rate of the job, it doesn't know/specify the difference between the 'input' rate and the 'output' rate. Yep, you're going to need to do

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread Jeff MacDonald
Just be aware that you might not see a dramatic increase in speed just moving Bacula itself! If you are using VMWare with VMDK files on a VMFS volume you need to be aware that any IO by a guest requires a reservation of the entire VMFS volume. Locking is happening at the SCSI layer -

Re: [Bacula-users] Job transfer rate

2014-10-30 Thread John Lockard
Yes, but which IO? Disk IO on the client? Network IO from the client to the network? Network IO from the network to the Bacula Director? Network IO from the Bacula Director to the Bacula SD? Disk IO on the Bacula SD? Database IO on the Bacula Director? Seems like you have more work to do than