[BackupPC-users] Need to speed up tar method

error403 Wed, 01 Jul 2009 08:53:55 -0700

Yeah I figured out in the web gui that the empty backups were "there", but 
simply unbrowsable. That kind of reassures me.


I found this in my logs that might be a cause of the reason why everything 
downloads from the host for incremental backups:

incr backup started back to 2009-06-26 22&#58;53&#58;27 &#40;backup #0&#41; for 
directory /var/lib/backuppc/sshfsuser/
Xfer PIDs are now 30107,30106
/bin/tar&#58; Substituting 1901-12-13 15&#58;45 for unknown date format 
`2009-06-26\\ 22&#58;53&#58;27'


And then I have this for all my files (this is only an example I fetched from 
the logs):
./User/Mes documents/Mes images/Photo1 014.jpg
./User/Mes documents/Mes images/Photo1 015.jpg
./User/Mes documents/Mes images/Photo1 016.jpg
./User/Mes documents/Mes images/Photo1 017.jpg
./User/Mes documents/Mes images/Photo1 018.jpg
./User/Mes documents/Mes images/Photo1 019.jpg
./User/Mes documents/Mes images/Photo1 020.jpg
./User/Mes documents/Mes images/Photo1 021.jpg
./User/Mes documents/Mes images/Photo1 022.jpg
./User/Mes documents/Mes images/Photo1 023.jpg
./User/Mes documents/Mes images/Photo1 024.jpg
./User/Mes documents/Mes images/Photo1 025.jpg
./User/Mes documents/Mes images/Photo1 026.jpg
./User/Mes documents/Mes images/Photo1 027.jpg
./User/Mes documents/Mes images/Photo1 028.jpg
./User/Mes documents/Mes images/Photo1 029.jpg
./User/Mes documents/Mes images/Photo1 030.jpg


Then, a little further:
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 013.jpg', mode 
0777, size 497282, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 497282 User/Mes documents/Mes images/Photo1 013.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 014.jpg', mode 
0777, size 474470, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 474470 User/Mes documents/Mes images/Photo1 014.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 015.jpg', mode 
0777, size 478307, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 478307 User/Mes documents/Mes images/Photo1 015.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 016.jpg', mode 
0777, size 479849, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 479849 User/Mes documents/Mes images/Photo1 016.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 017.jpg', mode 
0777, size 485525, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 485525 User/Mes documents/Mes images/Photo1 017.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 018.jpg', mode 
0777, size 835908, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 835908 User/Mes documents/Mes images/Photo1 018.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 019.jpg', mode 
0777, size 836822, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 836822 User/Mes documents/Mes images/Photo1 019.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 020.jpg', mode 
0777, size 839821, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 839821 User/Mes documents/Mes images/Photo1 020.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 021.jpg', mode 
0777, size 894598, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 894598 User/Mes documents/Mes images/Photo1 021.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 022.jpg', mode 
0777, size 867214, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 867214 User/Mes documents/Mes images/Photo1 022.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 023.jpg', mode 
0777, size 823254, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 823254 User/Mes documents/Mes images/Photo1 023.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 024.jpg', mode 
0777, size 837296, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 837296 User/Mes documents/Mes images/Photo1 024.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 025.jpg', mode 
0777, size 844581, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 844581 User/Mes documents/Mes images/Photo1 025.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 026.jpg', mode 
0777, size 881598, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 881598 User/Mes documents/Mes images/Photo1 026.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 027.jpg', mode 
0777, size 845938, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 845938 User/Mes documents/Mes images/Photo1 027.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 028.jpg', mode 
0777, size 477763, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 477763 User/Mes documents/Mes images/Photo1 028.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 029.jpg', mode 
0777, size 478966, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 478966 User/Mes documents/Mes images/Photo1 029.jpg
tarExtract&#58; Got file './User/Mes documents/Mes images/Photo1 030.jpg', mode 
0777, size 467877, type 0
&nbsp; pool&nbsp; &nbsp; &nbsp;777&nbsp; &nbsp; &nbsp; &nbsp;0/0&nbsp; &nbsp; 
&nbsp; 467877 User/Mes documents/Mes images/Photo1 030.jpg


Any ideas?


Adam Goryachev wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> error403 wrote:
> 
> > However, using this method, I also found out that backuppc was
> > copying EVERY files from the host, even on incremental backups,
> > because (I assume) it needed to compare locally the files before
> > updating the ones in the last backup.
> > 
> > So, my 2 questions are, is there a way to script a way to compare the
> > files before the copy, to make a way to skip files that are not
> > needed in the tar method, 
> > 
> 
> I would have thought the default config for a tar backup would be to use
> the date/time of a file to decide whether or not to include it in the
> backup... but I don't use this, perhaps you should check what flags you
> are giving to tar for full/incremental...
> 
> 
> > and is there a way to tell backuppc to NOT
> > start if the mounted directory is empty to prevent empty backups?
> > 
> 
> - From the config.pl file:
> # A backup of a share that has zero files is considered fatal. This is
> # used to catch miscellaneous Xfer errors that result in no files being
> # backed up.  If you have shares that might be empty (and therefore an
> # empty backup is valid) you should set this flag to 0.
> #
> $Conf{BackupZeroFilesIsFatal} = 1;
> 
> This will mark the backup as failed, and so will retry as per your
> configuration until it is successful.
> 
> Regards,
> Adam
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
> 
> iEYEARECAAYFAkpLdAQACgkQGyoxogrTyiWxDgCbBAXPWLOujg7ssXS3ywBht9EZ
> Y7EAoMFXGvyZh6Wx97OYSwl6vTwxe0lj
> =NWxo
> -----END PGP SIGNATURE-----
> 
> ------------------------------------------------------------------------------
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users < at > lists.sourceforge.net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/


+----------------------------------------------------------------------
|This was sent by krunchyf...@videotron.ca via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+----------------------------------------------------------------------



------------------------------------------------------------------------------
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Need to speed up tar method

Reply via email to