Re: [BackupPC-users] incremental backups taking longer than full
Mark Maciolek escribió: > hi, > > Using rsync between two linux servers, the full took 2.5 hours, the > incremental backups are taking longer each day. > > 2008-10-21 23:00:01 full backup started for directory / > 2008-10-22 02:32:55 full backup 0 complete, 294903 files, 203401100538 > bytes, 28 xferErrs (0 bad files, 0 bad shares, 28 other) > 2008-10-22 23:00:00 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-23 04:59:40 incr backup 1 complete, 541 files, 170443233887 > bytes, 11 xferErrs (0 bad files, 0 bad shares, 11 other) > 2008-10-23 23:00:00 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-24 06:41:00 incr backup 2 complete, 889 files, 169752997145 > bytes, 10 xferErrs (0 bad files, 0 bad shares, 10 other) > 2008-10-24 23:00:00 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-25 06:41:42 incr backup 3 complete, 1190 files, 170136700321 > bytes, 1 xferErrs (0 bad files, 0 bad shares, 1 other) > 2008-10-25 23:00:01 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-26 06:28:34 incr backup 4 complete, 1491 files, 170214964434 > bytes, 13 xferErrs (0 bad files, 0 bad shares, 13 other) > 2008-10-26 23:00:01 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-27 06:54:31 incr backup 5 complete, 1826 files, 170294261665 > bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) > 2008-10-27 23:00:01 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-28 07:01:38 incr backup 6 complete, 2174 files, 170711300863 > bytes, 14 xferErrs (0 bad files, 0 bad shares, 14 other) > 2008-10-28 23:12:21 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-29 08:27:44 incr backup 7 complete, 2481 files, 171012691775 > bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) > 2008-10-29 23:18:49 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > > > The command that is running: > > incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / > Running: /usr/bin/ssh -q -x -l root stella /usr/bin/rsync --server > --sender --numeric-ids --perms --owner --group -D --links --hard-links > --times --block-size=2048 --recursive . / > Xfer PIDs are now 1783 > Got remote protocol 28 > Negotiated protocol version 28 > Sent exclude: /tmp > Sent exclude: /net > Sent exclude: /sys > Sent exclude: /proc > Sent exclude: /dev > Xfer PIDs are now 1783,1792 > > > Any suggestions on what to look for as too why the incremental backups > take so much longer than the full? > > Mark > Do you have any virtual machine? If you have anyone, the vm ocuped 4gb for example and if you modificated anything in the vm , when you make an incremental backup , BackupPc copy again the vm's image. This isn't only for image i referer any file so big , that is modify and the backuppc think, it's a new file !!! ooohhh i have to copy!! jeje. Omar Llorens Crespo Domínguez JPL TSOLUCIO, S.L Informatic solutions www.tsolucio.com 902 886 938 Spain - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] incremental backups taking longer than full
Mark writes: > Using rsync between two linux servers, the full took 2.5 hours, the > incremental backups are taking longer each day. > > 2008-10-21 23:00:01 full backup started for directory / > 2008-10-22 02:32:55 full backup 0 complete, 294903 files, 203401100538 > bytes, 28 xferErrs (0 bad files, 0 bad shares, 28 other) > 2008-10-22 23:00:00 incr backup started back to 2008-10-21 23:00:01 > (backup #0) for directory / > 2008-10-23 04:59:40 incr backup 1 complete, 541 files, 170443233887 > bytes, 11 xferErrs (0 bad files, 0 bad shares, 11 other) Each incremental is transferring 170GB. The full is 203GB. Do you have, eg, a large sparse file below /var/log that you should exclude from the backup? Les Mikesell notes that: In particular, many 64-bit linux versions have a /var/log/lastlog file that appears to be 1.2 terabytes in size as an artifact of indexing it by uid numbers and using -1 for the nfsnobody id. It's generally not important to back this file up, so if that is the problem you can just exclude If there is a small change to such a file it is quite likely to be more expensive than the original complete transfer. (It won't matter whether it is a full or incr.) Craig - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] incremental backups taking longer than full
hi, Using rsync between two linux servers, the full took 2.5 hours, the incremental backups are taking longer each day. 2008-10-21 23:00:01 full backup started for directory / 2008-10-22 02:32:55 full backup 0 complete, 294903 files, 203401100538 bytes, 28 xferErrs (0 bad files, 0 bad shares, 28 other) 2008-10-22 23:00:00 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-23 04:59:40 incr backup 1 complete, 541 files, 170443233887 bytes, 11 xferErrs (0 bad files, 0 bad shares, 11 other) 2008-10-23 23:00:00 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-24 06:41:00 incr backup 2 complete, 889 files, 169752997145 bytes, 10 xferErrs (0 bad files, 0 bad shares, 10 other) 2008-10-24 23:00:00 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-25 06:41:42 incr backup 3 complete, 1190 files, 170136700321 bytes, 1 xferErrs (0 bad files, 0 bad shares, 1 other) 2008-10-25 23:00:01 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-26 06:28:34 incr backup 4 complete, 1491 files, 170214964434 bytes, 13 xferErrs (0 bad files, 0 bad shares, 13 other) 2008-10-26 23:00:01 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-27 06:54:31 incr backup 5 complete, 1826 files, 170294261665 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) 2008-10-27 23:00:01 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-28 07:01:38 incr backup 6 complete, 2174 files, 170711300863 bytes, 14 xferErrs (0 bad files, 0 bad shares, 14 other) 2008-10-28 23:12:21 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / 2008-10-29 08:27:44 incr backup 7 complete, 2481 files, 171012691775 bytes, 2 xferErrs (0 bad files, 0 bad shares, 2 other) 2008-10-29 23:18:49 incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / The command that is running: incr backup started back to 2008-10-21 23:00:01 (backup #0) for directory / Running: /usr/bin/ssh -q -x -l root stella /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive . / Xfer PIDs are now 1783 Got remote protocol 28 Negotiated protocol version 28 Sent exclude: /tmp Sent exclude: /net Sent exclude: /sys Sent exclude: /proc Sent exclude: /dev Xfer PIDs are now 1783,1792 Any suggestions on what to look for as too why the incremental backups take so much longer than the full? Mark -- Mark Maciolek Network Administrator Morse Hall 339 862-3050 [EMAIL PROTECTED] https://www.sr.unh.edu - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
