Re: [BackupPC-users] speed up backups

2010-06-06 Thread Ralf Gross
Les Mikesell schrieb: Ralf Gross wrote: the RsyncP man page tells me this: http://search.cpan.org/~cbarratt/File-RsyncP-0.68/lib/File/RsyncP.pm File::RsyncP does not compute file deltas (ie: it behaves as though --whole-file is specified) or implement exclude or include options

Re: [BackupPC-users] speed up backups

2010-06-01 Thread Carl Wilhelm Soderstrom
On 05/30 04:12 , Michael Stowe wrote: It's generally slower, so I'm going to go with no on this one. From the tests I've seen, ext2 is notably faster than ext3. Not doing journaling does make a difference. If you wanted to speed up ext3; you can put the journal on a separate device (even an

Re: [BackupPC-users] speed up backups

2010-06-01 Thread Les Mikesell
Carl Wilhelm Soderstrom wrote: On 05/30 04:12 , Michael Stowe wrote: It's generally slower, so I'm going to go with no on this one. From the tests I've seen, ext2 is notably faster than ext3. Not doing journaling does make a difference. If you wanted to speed up ext3; you can put the

Re: [BackupPC-users] speed up backups

2010-06-01 Thread Chris Dennis
On 01/06/10 14:41, Les Mikesell wrote: Carl Wilhelm Soderstrom wrote: On 05/30 04:12 , Michael Stowe wrote: It's generally slower, so I'm going to go with no on this one. From the tests I've seen, ext2 is notably faster than ext3. Not doing journaling does make a difference. If you wanted

Re: [BackupPC-users] speed up backups

2010-05-31 Thread Ralf Gross
Les Mikesell schrieb: Ralf Gross wrote: Ok, the first rsync full backup (488) completed. It took 500min. longer than the last tar full backup (482). Backup TypeFilled Level Start Date Duration/mins Age/days 482 fullyes 0 5/19 02:05 3223.2

Re: [BackupPC-users] speed up backups

2010-05-31 Thread Les Mikesell
Ralf Gross wrote: What I not quite understand is that inc. backup also take much longer than before. A tar incremental looks only at the timestamps on the target directory (and will miss new or moved files with old timestamps). Rsync compares directory entries with the last full run to

Re: [BackupPC-users] speed up backups

2010-05-31 Thread Les Mikesell
Ralf Gross wrote: the RsyncP man page tells me this: http://search.cpan.org/~cbarratt/File-RsyncP-0.68/lib/File/RsyncP.pm File::RsyncP does not compute file deltas (ie: it behaves as though --whole-file is specified) or implement exclude or include options when sending file.

Re: [BackupPC-users] speed up backups

2010-05-30 Thread Ralf Gross
Ralf Gross schrieb: Les Mikesell schrieb: On 5/26/2010 3:41 PM, Ralf Gross wrote: Ralf Gross schrieb: write(1, N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)

Re: [BackupPC-users] speed up backups

2010-05-30 Thread Les Mikesell
Ralf Gross wrote: Ralf Gross schrieb: Les Mikesell schrieb: On 5/26/2010 3:41 PM, Ralf Gross wrote: Ralf Gross schrieb: write(1, N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0

Re: [BackupPC-users] speed up backups

2010-05-30 Thread Chris Dennis
On 27/05/10 12:17, Sorin Srbu wrote: -Original Message- From: Tyler J. Wagner [mailto:ty...@tolaris.com] Sent: Thursday, May 27, 2010 1:00 PM To: backuppc-users@lists.sourceforge.net; sorin.s...@orgfarm.uu.se Subject: Re: [BackupPC-users] speed up backups On Thursday 27 May 2010 11

Re: [BackupPC-users] speed up backups

2010-05-30 Thread Michael Stowe
It's generally slower, so I'm going to go with no on this one. If filesystem is a bottleneck, you'd be better off with xfs or jfs. Will using ext2 instead of ext3 speed up backuppc? cheers Chris -- Chris Dennis cgden...@btinternet.com Fordingbridge,

Re: [BackupPC-users] speed up backups

2010-05-28 Thread Ralf Gross
Les Mikesell schrieb: On 5/26/2010 3:41 PM, Ralf Gross wrote: Ralf Gross schrieb: write(1, N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL,

Re: [BackupPC-users] speed up backups

2010-05-27 Thread Sorin Srbu
-Original Message- From: Steve [mailto:lepe...@gmail.com] Sent: Wednesday, May 26, 2010 5:33 PM To: sorin.s...@orgfarm.uu.se; General list for user discussion, questions and support Subject: Re: [BackupPC-users] speed up backups it's in the documentation - click on documentation over

Re: [BackupPC-users] speed up backups

2010-05-27 Thread Tyler J. Wagner
On Thursday 27 May 2010 11:13:29 Sorin Srbu wrote: Looked into file system optimization again, while waiting for a backup to finish. Seems like noatime is a recommended setting in /etc/fstab. If I already have defaults set for the backup-array mount, and add noatime, should I still keep

Re: [BackupPC-users] speed up backups

2010-05-27 Thread Sorin Srbu
-Original Message- From: Tyler J. Wagner [mailto:ty...@tolaris.com] Sent: Thursday, May 27, 2010 1:00 PM To: backuppc-users@lists.sourceforge.net; sorin.s...@orgfarm.uu.se Subject: Re: [BackupPC-users] speed up backups On Thursday 27 May 2010 11:13:29 Sorin Srbu wrote: Looked into file

Re: [BackupPC-users] speed up backups

2010-05-27 Thread Leen Besselink
On Thu, May 27, 2010 at 01:17:49PM +0200, Sorin Srbu wrote: -Original Message- From: Tyler J. Wagner [mailto:ty...@tolaris.com] Sent: Thursday, May 27, 2010 1:00 PM To: backuppc-users@lists.sourceforge.net; sorin.s...@orgfarm.uu.se Subject: Re: [BackupPC-users] speed up backups

Re: [BackupPC-users] speed up backups

2010-05-27 Thread Tyler J. Wagner
On Thursday 27 May 2010 16:25:23 Leen Besselink wrote: It was for me to, but I see the following mentioned in several places: noatime is a superset of nodiratime That would imply, setting nodiratime with noatime doesn't add anything. You are right! Thanks for that.

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Pedro M. S. Oliveira
Hello, Have you tried the rsync method, it should be way faster than tar. Cheers, Pedro On Wednesday 26 May 2010 08:27:04 Ralf Gross wrote: Hi, I'm using BackupPC without major problems since a few years now. Our main fileserver has now reached 3,3 TB and it takes 2 days (18 MB/s) to do a

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Ralf Gross
Pedro M. S. Oliveira schrieb: Have you tried the rsync method, it should be way faster than tar. I think rsync is most useful with servers that have a slow network connection. But the network speed is not the problem, more precisely I don't exactly know what the real bottlenck is. Ralf

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Les Mikesell
Ralf Gross wrote: After all I've read, switching to rsync instead of tar doesn't seem to be a better choice. After the 1st 2 fulls, rsync should be better if you have enabled checksum caching. You do need plenty of RAM to hold the directory listing if you have a large number of files.

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Sorin Srbu
-Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: Wednesday, May 26, 2010 2:55 PM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] speed up backups After the 1st 2 fulls, rsync should be better if you have enabled checksum

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Tyler J. Wagner
On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote: -Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: Wednesday, May 26, 2010 2:55 PM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] speed up backups After the 1st

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Sorin Srbu
-Original Message- From: Tyler J. Wagner [mailto:ty...@tolaris.com] Sent: Wednesday, May 26, 2010 4:19 PM To: backuppc-users@lists.sourceforge.net; sorin.s...@orgfarm.uu.se Subject: Re: [BackupPC-users] speed up backups On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote: -Original

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Ralf Gross
Tyler J. Wagner schrieb: On Wednesday 26 May 2010 14:34:40 Sorin Srbu wrote: -Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: Wednesday, May 26, 2010 2:55 PM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Steve
...@gmail.com] Sent: Wednesday, May 26, 2010 2:55 PM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] speed up backups After the 1st 2 fulls, rsync should be better if you have enabled checksum caching.  You do need plenty of RAM to hold the directory listing

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Les Mikesell
and support Subject: Re: [BackupPC-users] speed up backups After the 1st 2 fulls, rsync should be better if you have enabled checksum caching. You do need plenty of RAM to hold the directory listing if you have a large number of files. That was the checksum= 31thousandsomething to be added

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Ralf Gross
, questions and support Subject: Re: [BackupPC-users] speed up backups After the 1st 2 fulls, rsync should be better if you have enabled checksum caching. You do need plenty of RAM to hold the directory listing if you have a large number of files

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Ralf Gross
Ralf Gross schrieb: write(1, N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0})

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Les Mikesell
On 5/26/2010 3:12 PM, Ralf Gross wrote: smells like a time out, but I don't know where. I found a couple of messages with similar output in the list archives, but none of them had a solution yet. If it is repeatable, you might try to start the strace sooner so you can see what happens

Re: [BackupPC-users] speed up backups

2010-05-26 Thread Les Mikesell
On 5/26/2010 3:41 PM, Ralf Gross wrote: Ralf Gross schrieb: write(1, N\2\0\7\5\3lvs\r\0\0\0\r\0\0\0lvmiopversion8\5..., 594) = 594 select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout) select(1, [0], [], NULL, {60, 0}) = 0 (Timeout)