Hi All,
Running backuppc 4.2.1 that's pulling a dataset using rsyncd over
openvpn from an ADSL tail (the connection uploads at around 50kb/s).
The problem I'm having is when there was a large change in delta
(currently rsync shows 34gb~that's going to take about 9 days to
transfer) the backups never complete.
Due to circumstances, possible isp or line noise the connection has been
resetting and interrupting the transfer resulting in the logs showing:
2018-08-31 04:18:01 incr backup started for directory backup
2018-09-03 05:36:47 Got fatal error during xfer (rsync error: error in
rsync protocol data stream (code 12) at io.c(629) [generator=3.0.9.11])
2018-09-03 05:36:53 Backup aborted (rsync error: error in rsync protocol
data stream (code 12) at io.c(629) [generator=3.0.9.11])
This has been happening for weeks resulting in many partial backups but
no completed backups.
Have investigated / attempted the following:
* Although the partial backups are used by the next backup when
attempted, due to the interruptions no two backups in a row are covering
the whole delta.
* Have confirmed from the logs that rsyncd ends up sending the same
files over and over (what files change each attempt depending on what
the previous partial backup contains).
* Have attempted to resolve the connection stability, but due to
circumstances there inevitably will be interruptions of connectivity
between sites.
* The rsyncd connection is using a timeout of 10800 (3 hours) and have
validated there are no files large enough to trigger the timeout (~1/2
gig). The files themselves are mostly images that are about ~5mb in size
a piece.
* Have resolved this previously by taking a copy of the data offsite and
pointing backuppc to it and "seeding" the backup. Then incremental's
occur organically.
However this is getting old, especially when it's often triggered by a
reorganize of existing files (folders renamed) due to temporary data
then being sorted.
Backuppc doesn't seem to handle this circumstance well, it transfers the
file it already has then deduplicates it when saving into the pool (from
what I can see, when the files at a new path).
The partial backups are working, but no two partials cover the total
dataset needing to be transferred.
Is it possible to get backuppc to handle this use case/circumstance better ?
Am I missing something or possibly backuppc is miss configured ?
Any help or advice is appreciated.
Regards
Jonathan
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
