I was using backuppc to backup a directory off a linux box in Toronto - to my
backuppc server in Philadelphia.
This was running fine since Aug 2014.
The directory on the linux box was actually rsync'd off a windows desktop.
Then the Toronto linux box crashed the OS disk. We replaced the disk and
installed a new OS.
Again I rsync'd the directory off the windows desktop.
Then I reran the backup from Philadelphia. I thought things looked good
because most of the entries in the Xferlog said pool. And since neither
the Philadelphia box, nor the windows box crashed - that was what I
expected.
<snip>
create d 777 991/988 4096 menses
create d 777 991/988 26 menses/SAS Configuration Information
pool 666 991/988 980 menses/SAS Configuration
Information/SASSETUP.LOG
create d 777 991/988 50 menses/huyt
create d 777 991/988 6 menses/huyt/receive
create d 777 991/988 6 menses/huyt/shared
create d 777 991/988 19 menses/huyt/splus6w
create d 777 991/988 20 menses/huyt/splus6w/.Data
create d 777 991/988 22 menses/huyt/splus6w/.Data/__Meta
create 666 991/988 0 menses/huyt/splus6w/.Data/__Meta/___nonfi
create d 777 991/988 4096 menses/zasweca
pool 666 991/988 1539 menses/zasweca/01readme send .txt
pool 666 991/988 1942 menses/zasweca/02me_mary increase in rate
and timeline.txt
pool 666 991/988 590 menses/zasweca/03a invoice01.txt
pool 666 991/988 1579 menses/zasweca/03b send invoices to mary
brady.txt
pool 666 991/988 5512 menses/zasweca/03c invoice01 CA_EFT.pdf
pool 666 991/988 1508 menses/zasweca/04a invoice02.txt
pool 666 991/988 5481 menses/zasweca/04b invoice02 CA_EFT.pdf
pool 666 991/988 2168 menses/zasweca/05contact Kathy Hughes from
now on.txt
pool 666 991/988 579 menses/zasweca/06a invoice03 sent.txt
pool 666 991/988 5479 menses/zasweca/06b invoice03 CA_EFT-1.pdf
pool 666 991/988 439 menses/zasweca/07a invoice04 sent.txt
<snip>
The issue came in duration. I had to leave town after the rebuild and
while I was out of town, it was discovered that the backup was running +5hours.
By the time I could look at backuppc - all the pre-crash backups had
rolled off. So I have little information about how the backup ran before the
crash.
What I could find was old LOG files. For example
LOG.102015.z says
<snip>
2015-10-23 20:02:29 removing incr backup 410
2015-10-24 20:00:03 incr backup started back to 2015-10-19 20:00:03 (backup
#413) for directory /data1/toronto/ZX
2015-10-24 20:02:57 incr backup 418 complete, 450 files, 62355998 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-24 20:02:57 removing incr backup 411
2015-10-25 20:00:03 incr backup started back to 2015-10-19 20:00:03 (backup
#413) for directory /data1/toronto/ZX
2015-10-25 20:02:42 incr backup 419 complete, 498 files, 62957102 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-25 20:02:42 removing incr backup 412
2015-10-25 20:02:42 removing full backup 406
2015-10-26 20:00:04 full backup started for directory /data1/toronto/ZX
(baseline backup #419)
2015-10-26 20:08:28 full backup 420 complete, 40619 files, 5465051229 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-27 20:00:03 incr backup started back to 2015-10-26 20:00:04 (backup
#420) for directory /data1/toronto/ZX
2015-10-27 20:01:00 incr backup 421 complete, 110 files, 33990498 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-27 20:01:00 removing incr backup 414
2015-10-28 20:00:04 incr backup started back to 2015-10-26 20:00:04 (backup
#420) for directory /data1/toronto/ZX
2015-10-28 20:01:10 incr backup 422 complete, 173 files, 40689968 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-28 20:01:10 removing incr backup 415
2015-10-29 20:00:03 incr backup started back to 2015-10-26 20:00:04 (backup
#420) for directory /data1/toronto/ZX
2015-10-29 20:05:18 incr backup 423 complete, 710 files, 107920389 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-29 20:05:18 removing incr backup 416
2015-10-30 20:00:04 incr backup started back to 2015-10-26 20:00:04 (backup
#420) for directory /data1/toronto/ZX
2015-10-30 20:05:33 incr backup 424 complete, 774 files, 111721738 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-30 20:05:33 removing incr backup 417
2015-10-31 20:00:03 incr backup started back to 2015-10-26 20:00:04 (backup
#420) for directory /data1/toronto/ZX
2015-10-31 20:05:49 incr backup 425 complete, 822 files, 113679512 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-10-31 20:05:49 removing incr backup 418
<snip>
which seems to show that a full backup ran in 8 minutes, pre crash.
My interpretation - because most files where in the pool and very little had to
be transferred.
Here is what the LOG looks like post-crash
based on file count and bytes it seems to be doing a full every time, yet the
Xfer file says pool
<snip>
2015-11-27 02:59:08 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /home/toronto/data/ZX
2015-11-27 08:41:44 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /etc/KeepConfig
2015-11-27 08:41:46 incr backup 440 complete, 40921 files, 5537487784 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-11-27 08:41:46 removing incr backup 432
2015-11-28 03:00:02 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /home/toronto/data/ZX
2015-11-28 09:07:48 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /etc/KeepConfig
2015-11-28 09:07:51 incr backup 441 complete, 40921 files, 5537487784 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-11-28 09:07:51 removing incr backup 433
2015-11-28 09:07:51 removing full backup 427
2015-11-29 03:00:02 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /home/toronto/data/ZX
2015-11-29 09:24:04 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /etc/KeepConfig
2015-11-29 09:24:06 incr backup 442 complete, 40921 files, 5537487784 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-11-29 09:24:06 removing incr backup 435
2015-11-29 13:10:40 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /home/toronto/data/ZX
2015-11-29 19:22:24 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /etc/KeepConfig
2015-11-29 19:22:26 incr backup 443 complete, 41074 files, 5543827385 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-11-29 19:22:26 removing incr backup 436
2015-11-30 20:00:02 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /home/toronto/data/ZX
2015-12-01 01:44:10 incr backup started back to 2015-11-27 00:35:40 (backup
#439) for directory /etc/KeepConfig
2015-12-01 01:44:12 incr backup 444 complete, 41175 files, 5553240352 bytes, 0
xferErrs (0 bad files, 0 bad shares, 0 other)
2015-12-01 01:44:12 removing incr backup 437
<snip>
I have watched the rsync on the toronto box during a backup and it seems fine.
It steps through the files as expected.
I can not run an rsync outside of backuppc (to debug), because I only have
the files inside of backuppc on the philly server.
Clearly the path where I rsynced the windows directory is different, but
that should cause 1 long running backup. Not every one after that as
well. And if it finds it in the pool, why take any time at all?
Can anybody suggest anything! I am completely stymied.
Philadelphia backuppc version BackupPC-3.2.1-11.fc17.i686
Thanks
B
------------------------------------------------------------------------------
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
