Re: [Bacula-users] Network transfer Speed [SOLVED]

2009-12-14 Thread Hayden Katzenellenbogen
. The slower speed is due the sheer number of files being backed up (2.1M files in 1.7TB) Thanks again. -H -Original Message- From: Steve Ellis [mailto:el...@brouhaha.com] Sent: Thursday, December 10, 2009 10:21 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network

Re: [Bacula-users] Network transfer Speed

2009-12-10 Thread Hayden Katzenellenbogen
- From: Steve Polyack [mailto:kor...@comcast.net] Sent: Wednesday, December 09, 2009 10:37 AM To: Hayden Katzenellenbogen Cc: mehma sarja; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed Hayden Katzenellenbogen wrote: Everyone, Here is a little update. I

Re: [Bacula-users] Network transfer Speed

2009-12-10 Thread Steve Ellis
On 12/10/2009 9:33 AM, Hayden Katzenellenbogen wrote: Steve, Here is a quick snap of my top during a full backup. top - 09:32:35 up 1 day, 18:38, 1 user, load average: 11.41, 11.60, 10.75 Tasks: 161 total, 1 running, 160 sleeping, 0 stopped, 0 zombie Cpu0 : 0.3%us, 0.3%sy,

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Dan Langille
mehma sarja wrote: PLEASE BE CAREFUL: a. I do know I re-init-ed the indexes - I had to dump and reload the database and I re-init-ed it in the process. b. This is a delicate process and I played with it for many weeks. This can be achieved without dropping the database. Indexes can be

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Dan Langille
Hayden Katzenellenbogen wrote: TiN, The write-cache is already enabled. Just checked. I have turned all the settings onto performance just in case. But looking at iostat it does not seem to have made any difference. Write cache should only be enabled if the card has a BBU (battery backup

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
Drescher [mailto:dresche...@gmail.com] Sent: Tuesday, December 08, 2009 2:30 PM To: Timo Neuvonen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 5:13 PM, Timo Neuvonentimo-n...@tee-en.net wrote: John Drescherdresche...@gmail.com kirjoitti

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
Yup got one of those. It has saved my bacon once already. -H -Original Message- From: Dan Langille [mailto:d...@langille.org] Sent: Wednesday, December 09, 2009 4:03 AM To: Hayden Katzenellenbogen Cc: Timo Neuvonen; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
: Re: [Bacula-users] Network transfer Speed Ah HAH! The old I just upgraded to bacula 3.03 this morning mistake. The problem here could be what happened to me. The database needs to be bounced. Yes, indexes dropped and re-init-ed. It was a few moons ago and I forget what exactly I did. Horribly slow

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
8:35 AM To: mehma sarja; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed Mehma, Sorry man wish that was the case. It was doing this on 3.0.1 and then I decided that maybe an upgrade would help. It was doing this when the database was on the local machine

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Steve Polyack
Hayden Katzenellenbogen wrote: Everyone, Here is a little update. I finally after many months have been able to run my first restore. I started an 800G restore. Which is half of my 1.7TB backup. I ran iostat while it was restoring and was getting between 50 and 140 Meg/s. I would

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
- From: Steve Polyack [mailto:kor...@comcast.net] Sent: Wednesday, December 09, 2009 10:37 AM To: Hayden Katzenellenbogen Cc: mehma sarja; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed Hayden Katzenellenbogen wrote: Everyone, Here is a little update. I

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Gavin McCullagh
On Wed, 09 Dec 2009, Hayden Katzenellenbogen wrote: I started an 800G restore. Which is half of my 1.7TB backup. I ran iostat while it was restoring and was getting between 50 and 140 Meg/s. I would say the average is around 85Meg/s. Is that 85MByte/sec across the network or from local

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
think the raid array would be able to read faster than it can write. -H -Original Message- From: Gavin McCullagh [mailto:gavin.mccull...@gcd.ie] Sent: Wednesday, December 09, 2009 11:38 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed On Wed

Re: [Bacula-users] Network transfer Speed

2009-12-09 Thread Hayden Katzenellenbogen
AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed On Wed, 09 Dec 2009, Hayden Katzenellenbogen wrote: I started an 800G restore. Which is half of my 1.7TB backup. I ran iostat while it was restoring and was getting between 50 and 140 Meg/s. I would

[Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
Everyone, I currently have a single server with 2.5TB of local data that I need to back up. The problem I am running into is that the server only has a 100Mb/s network card so I am limited to 12MB/s of data transfer. I thought using the loopback interface would give better speed but it seems that

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Timo Neuvonen
Hayden Katzenellenbogen hay...@nextlevelinternet.com kirjoitti viestissä news:88bc6885d33a9d42a1ccb45e8749525ed15...@pigeon.sandiego.nextlevelinternet.com... Everyone, I currently have a single server with 2.5TB of local data that I need to back up. The problem I am running into is that the

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread John Drescher
On Tue, Dec 8, 2009 at 3:45 PM, Timo Neuvonen timo-n...@tee-en.net wrote: Hayden Katzenellenbogen hay...@nextlevelinternet.com kirjoitti viestissä news:88bc6885d33a9d42a1ccb45e8749525ed15...@pigeon.sandiego.nextlevelinternet.com... Everyone, I currently have a single server with 2.5TB of

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
. Again any help is greatly appreciated. -H -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Tuesday, December 08, 2009 1:02 PM To: Timo Neuvonen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 3:45 PM, Timo Neuvonen timo-n

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread John Drescher
On Tue, Dec 8, 2009 at 4:12 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: John, I have moved the database onto a dedicated server. I also added a SATA drive on a different controller for spooling the data. While the data is spooling I am seeing 9.5MB/s for writing to the

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread John Drescher
On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Yes it is a raid-6 configuration running on a 3ware 9690SA-8I. Do you have attribute spooling on? John -- Return on

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
...@gmail.com] Sent: Tuesday, December 08, 2009 1:30 PM To: Hayden Katzenellenbogen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Yes it is a raid-6 configuration running on a 3ware

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
[mailto:dresche...@gmail.com] Sent: Tuesday, December 08, 2009 1:30 PM To: Hayden Katzenellenbogen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Yes it is a raid-6 configuration running

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Timo Neuvonen
John Drescher dresche...@gmail.com kirjoitti viestissä news:387ee2020912081330v6e8fa197s5009971859acb...@mail.gmail.com... On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Yes it is a raid-6 configuration running on a 3ware 9690SA-8I. I've never had

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread John Drescher
On Tue, Dec 8, 2009 at 5:00 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Should it be set to no? Also can you have spool data on and spool attributes off? Yes. But I was asking because the job will backup the data faster if the attributes are spooled. The reason is without

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
, 2009 2:14 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Network transfer Speed John Drescher dresche...@gmail.com kirjoitti viestissä news:387ee2020912081330v6e8fa197s5009971859acb...@mail.gmail.com... On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread John Drescher
On Tue, Dec 8, 2009 at 5:13 PM, Timo Neuvonen timo-n...@tee-en.net wrote: John Drescher dresche...@gmail.com kirjoitti viestissä news:387ee2020912081330v6e8fa197s5009971859acb...@mail.gmail.com... On Tue, Dec 8, 2009 at 4:16 PM, Hayden Katzenellenbogen hay...@nextlevelinternet.com wrote: Yes

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Hayden Katzenellenbogen
. I must say I am at a total loss. -H -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Tuesday, December 08, 2009 2:30 PM To: Timo Neuvonen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 5:13 PM, Timo Neuvonen timo-n

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread Steve Ellis
[mailto:dresche...@gmail.com] Sent: Tuesday, December 08, 2009 2:30 PM To: Timo Neuvonen; bacula-users Subject: Re: [Bacula-users] Network transfer Speed On Tue, Dec 8, 2009 at 5:13 PM, Timo Neuvonentimo-n...@tee-en.net wrote: John Drescherdresche...@gmail.com kirjoitti viestissä news

Re: [Bacula-users] Network transfer Speed

2009-12-08 Thread mehma sarja
Ah HAH! The old I just upgraded to bacula 3.03 this morning mistake. The problem here could be what happened to me. The database needs to be bounced. Yes, indexes dropped and re-init-ed. It was a few moons ago and I forget what exactly I did. Horribly slow backups and they NEVER finished and