Tunning for performance (was: tar's default block size & shoe-shinning)

2006-06-29 Thread Cyrille Bollu
Hi all, I haven't yet solved my performance problem but I wanted to share the following URL with anybody who is experiencing the same problem as me:         http://www.redhat.com/magazine/001nov04/features/vm/ It introduces a lot of Linux's virtual memory configuration parameters (/proc/sys/vm/

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Joshua Baker-LePain
On Tue, 20 Jun 2006 at 5:54pm, Cyrille Bollu wrote There are ext3 mount options you can play with, as well as options in the RAID controller. All of that can be non-destructive. There are also some mke2fs options one can play with. You're thinking about "noatime", aren't you? noatime c

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Cyrille Bollu
[EMAIL PROTECTED] a écrit sur 20/06/2006 15:39:01 : > > There are ext3 mount options you can play with, as well as options in the > RAID controller.  All of that can be non-destructive.  There are also some > mke2fs options one can play with. You're thinking about "noatime", aren't you? What

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Joshua Baker-LePain
On Tue, 20 Jun 2006 at 2:59pm, Cyrille Bollu wrote Joshua Baker-LePain <[EMAIL PROTECTED]> a écrit sur 20/06/2006 14:07:58 : How much benchmarking/optimization have you done with the array? Almost none... That's the first time I'm working with such a big filesystem. I ran "hdparm -t -T" wh

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Cyrille Bollu
Joshua Baker-LePain <[EMAIL PROTECTED]> a écrit sur 20/06/2006 14:07:58 : > On Tue, 20 Jun 2006 at 9:47am, Cyrille Bollu wrote > > > The server is a Dell PowerEdge 2850 with 2 Intel Xeon 3GHz processors and > > 8GB RAM. > > > > I have one big RAID5 array made of 6 Seagate Cheetah ST337LC 10K

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Joshua Baker-LePain
On Tue, 20 Jun 2006 at 9:47am, Cyrille Bollu wrote The server is a Dell PowerEdge 2850 with 2 Intel Xeon 3GHz processors and 8GB RAM. I have one big RAID5 array made of 6 Seagate Cheetah ST337LC 10Krpm 300GB (http://support.euro.dell.com/support/edocs/storage/p76311sc/intro.htm). All connec

Re: tar's default block size & shoe-shinning

2006-06-20 Thread Cyrille Bollu
Joshua Baker-LePain <[EMAIL PROTECTED]> a écrit sur 19/06/2006 16:59:58 : > On Mon, 19 Jun 2006 at 4:31pm, Cyrille Bollu wrote > > > But, when we purchased the backup server I agreed to follow my boss' > > solution (it's always him you known ;-p) to buy that cheaper server with > > maximum 1,5TB

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
[EMAIL PROTECTED] a écrit sur 19/06/2006 18:09:58 : > > > > Actually with AMANDA it might be a really good idea esp. with the faster > > drives because there's no way you can keep them streaming over the network. > > Erm, I think you missed the bit where he said he's only backing up disks > l

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Michael Loftis
--On June 19, 2006 12:09:58 PM -0400 Joshua Baker-LePain <[EMAIL PROTECTED]> wrote: Erm, I think you missed the bit where he said he's only backing up disks local to the backup server (and thus the tape drive). No network involved. You're right, I did, my bad! :D Going back to my hole n

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 10:06am, Michael Loftis wrote --On June 19, 2006 10:59:58 AM -0400 Joshua Baker-LePain <[EMAIL PROTECTED]> wrote: On Mon, 19 Jun 2006 at 4:31pm, Cyrille Bollu wrote In a configuration where amanda only backup local (SCSI) drives, are there any benefits from using a ho

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Michael Loftis
--On June 19, 2006 10:59:58 AM -0400 Joshua Baker-LePain <[EMAIL PROTECTED]> wrote: On Mon, 19 Jun 2006 at 4:31pm, Cyrille Bollu wrote But, when we purchased the backup server I agreed to follow my boss' solution (it's always him you known ;-p) to buy that cheaper server with maximum 1,5TB

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 4:31pm, Cyrille Bollu wrote But, when we purchased the backup server I agreed to follow my boss' solution (it's always him you known ;-p) to buy that cheaper server with maximum 1,5TB RAID5 (6*300GB) instead of that nice DAS with up to 3,9TB RAID5. So, to save space I crea

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
> > > > What a poor hardware configuration I have here > > Indeed.  What *is* your SCSI config.  In general, you probably want the > tape drive at least on its own channel, if not its own card. > It is BAD! OK at least my tape drive is on its own card. But, when we purchased the backup s

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Jon LaBadie
On Mon, Jun 19, 2006 at 08:43:04AM -0400, Joshua Baker-LePain wrote: > On Mon, 19 Jun 2006 at 2:40pm, Cyrille Bollu wrote > > >Does anybody knows about the --with-maxtapeblocksize used by RedHat ES > >3.3? > > I doubt it's used, but it's easy enough to find out -- download the SRPM > and look in

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 10:03am, Jon LaBadie wrote I used stinit to specify block sizes for my "new to me" LTO-1. Some of the resulting devices at 32K, others at 128., or 256K. Surprise to me, when I ran amtapetype, specifying a matching blocksize, the transfer rate was slower than at 32K. About

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 3:59pm, Cyrille Bollu wrote Wow...That's better: [EMAIL PROTECTED] cron.d]# time dd if=/dev/zero of=/dev/nst0 bs=2048k ^^^ Great idea! ;) (cf my previous email) count=1024 1024+0 records in 1024+0 records out real0m27

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 3:56pm, Cyrille Bollu wrote ouch I just ran the test and the speed sank to about 6MB/s... I guess I'm stretching another component... What SCSI card do you have the drive hooked to? Is (are) your hard drive(s) on the same card and/or the same chain? You may want to t

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
out 6MB/s... I guess I'm stretching another component... grrr... Cyrille Bollu <[EMAIL PROTECTED]> Envoyé par : [EMAIL PROTECTED] 19/06/2006 14:59 A Joshua Baker-LePain <[EMAIL PROTECTED]> cc amanda-users@amanda.org Objet Re: tar's default block size & sho

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
ain <[EMAIL PROTECTED]> 19/06/2006 14:43 A Cyrille Bollu <[EMAIL PROTECTED]> cc amanda-users@amanda.org Objet Re: tar's default block size & shoe-shinning On Mon, 19 Jun 2006 at 2:40pm, Cyrille Bollu wrote > Does anybody knows about the --with-maxta

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Matt Hyclak
On Mon, Jun 19, 2006 at 02:59:16PM +0200, Cyrille Bollu enlightened us: > indeed... > > Thank you for your answers Joshua, I will try a "dd" with bs=2048k. Then > probably I will compile amanda... > > Bouh I don't like to do that in a production environment > Understandable. I have some ti

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
llu <[EMAIL PROTECTED]> cc amanda-users@amanda.org Objet Re: tar's default block size & shoe-shinning On Mon, 19 Jun 2006 at 2:40pm, Cyrille Bollu wrote > Does anybody knows about the --with-maxtapeblocksize used by RedHat ES > 3.3? I doubt it's used, but it'

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Paul Bijnens
On 2006-06-19 14:43, Joshua Baker-LePain wrote: On Mon, 19 Jun 2006 at 2:40pm, Cyrille Bollu wrote Does anybody knows about the --with-maxtapeblocksize used by RedHat ES 3.3? I doubt it's used, but it's easy enough to find out -- download the SRPM and look in the spec file. or: $ amadmi

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 2:40pm, Cyrille Bollu wrote Does anybody knows about the --with-maxtapeblocksize used by RedHat ES 3.3? I doubt it's used, but it's easy enough to find out -- download the SRPM and look in the spec file. -- Joshua Baker-LePain Department of Biomedical Engineering Duke

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
Does anybody knows about the --with-maxtapeblocksize used by RedHat ES 3.3? Cyrille Joshua Baker-LePain <[EMAIL PROTECTED]> Envoyé par : [EMAIL PROTECTED] 19/06/2006 11:02 A Cyrille Bollu <[EMAIL PROTECTED]> cc amanda-users@amanda.org Objet Re: tar's default

Re: tar's default block size & shoe-shinning

2006-06-19 Thread Joshua Baker-LePain
On Mon, 19 Jun 2006 at 10:05am, Cyrille Bollu wrote Could someone tell me if there are any possibilities to change the block size tar is using when backuping with amanda? I'm asking this because we have recently bought an IBM ULTRIUM-TD3 LTO3 drive here and Amanda reports an average write rate

tar's default block size & shoe-shinning

2006-06-19 Thread Cyrille Bollu
Hi all, Could someone tell me if there are any possibilities to change the block size tar is using when backuping with amanda? I'm asking this because we have recently bought an IBM ULTRIUM-TD3 LTO3 drive here and Amanda reports an average write rate of only 17MB/s (when the maximum speed should