Hi! I am very excited about the upcoming changes for v4, so I decided to clone an existing BackupPC v3 server and do the upgrade to see how things would go. While I had no issues in compiling the three packages or installing them, and while the web interface came up just fine after the upgrade, the backups are not working. I tried a linux rsync job, a Mac OS X rsync job, a linux tar job and a Windows SMB job, all seem to have failed in one way or another... :(
Please bear with my rambling before, I am continuing to try to nail down the issues that are happening, but thought I would throw out what I have so far to get suggestions if anyone had some to share. :) At first I noticed these errors when it attempted a backup.... *** rsync backup of a Linux host: Created directory /mnt/stage/BackupPC/pc/miscnet/refCnt full backup started for directory / Got fatal error during xfer (No files dumped for share /) Backup aborted (No files dumped for share /) I increased the logging level and I get this: incr backup started for directory / Got fatal error during xfer (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) Backup aborted (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) *** tar backup of Linux host Then I had a linux system with tar backup, and that also had some errors: . . . tarExtract: b7fa2000-b7fa5000 rw-p b7fa2000 00:00 0 tarExtract: b7fb5000-b7fb6000 rw-p b7fb5000 00:00 0 tarExtract: bff5f000-bffef000 rw-p bff6e000 00:00 0 [stack] BackupPC_tarExtract exited with fail status 6 Tar exited with error 36096 () status Xfer PIDs are now Got fatal error during xfer (BackupPC_tarExtract exited with fail status 6) Backup aborted (BackupPC_tarExtract exited with fail status 6) BackupFailCleanup: nFilesTotal = 0, type = full, BackupCase = 2, inPlace = 1, lastBkupNum = BackupFailCleanup: inPlace with no new files... no cleanup Running BackupPC_refCountUpdate -h backuppc -f on backuppc xferPids 15068 *** SMB backup of Windows host I have a Windows Server 2008 host that I backup using SMB, and that one actually seemed to start off very well. Very good transfer speed (monitoring via if top), but it after the transfer seems to have stopped (i.e. no more data flowing that I can see), it is sitting there with 100% CPU usage on this task: /usr/bin/perl /usr/local/BackupPC/bin/BackupPC_tarExtract -h win2k8vm -s C$ -f -p But I do still see this running as well even though I don't see data being transferred: /usr/bin/smbclient \\x.x.x.x\C$ -U backuppc -E -N -d 1 -c tarmode full -Tc - Also, iotop doesn't show this process as having any disk activity, the XferLOG file seems hung here: tarExtract: __bpc_progress_fileCnt__ 58640 pool 644 0/0 6391 Windows/winsxs/Manifests/x86_microsoft-windows-font-truetype-corbel_31bf3856ad364e35_6.0.6002.18208_none_d4980b9bfbd49bfd.manifest . . . I watched for a while and no further activity seems to be happening here and there isn't a timestamp to know when it updated the above lines in the file, but the top of the file shows: Contents of file /mnt/stage/BackupPC/pc/win2k8vm/XferLOG.1482.z, modified 2013-09-28 03:56:10 So I wonder if this job is hung. :( *************** *** Rsync for Linux host XferLOG file /mnt/stage/BackupPC/pc/miscnet/XferLOG.1004.z created 2013-09-27 21:38:41 Backup prep: type = full, case = 2, inPlace = 1, doDuplicate = 1, newBkupNum = 1004, newBkupIdx = 3, lastBkupNum = , lastBkupIdx = (FillCycle = 0, noFillCnt = 2) Executing /usr/local/BackupPC/bin/BackupPC_backupDuplicate -h miscnet Copying v3 backup #1003 to v4 #1004 BackupPC_backupDuplicate: got 0 errors and 0 file open errors Running: /usr/local/bin/rsync_bpc --bpc-top-dir /mnt/stage/BackupPC --bpc-host-name miscnet --bpc-share-name / --bpc-bkup-num 1004 --bpc-bkup-comp 1 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 48736 --bpc-log-level 1 -e /usr/bin/ssh -q -x -l backuppc --rsync-path=/usr/bin/rsync --super --recursive --protect-args --numeric-ids --perms --owner --group -D --times --links --hard-links --delete --partial --log-format=log: %o %i %B %8U,%8G %9l %f%L --stats --checksum --one-file-system --iconv=utf8,utf8 --exclude=/proc --exclude=/nfs miscnet.sga.org:/ / full backup started for directory / Xfer PIDs are now 14653 This is the rsync child about to exec /usr/local/bin/rsync_bpc rsync_bpc: connection unexpectedly closed (0 bytes received so far) [Receiver] Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 48736 inode rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2] rsync_bpc exited with fatal status 255 (65280) (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) Xfer PIDs are now Got fatal error during xfer (No files dumped for share /) Backup aborted (No files dumped for share /) BackupFailCleanup: nFilesTotal = 0, type = full, BackupCase = 2, inPlace = 1, lastBkupNum = BackupFailCleanup: inPlace with no new files... no cleanup Running BackupPC_refCountUpdate -h miscnet -f on miscnet xferPids 14657 BackupPC_refCountUpdate: host miscnet got 0 errors BackupPC_refCountPrint: total errors: 0 xferPids Finished BackupPC_refCountUpdate (running time: 2 sec) XferLOG file /mnt/stage/BackupPC/pc/miscnet/XferLOG.1004.z created 2013-09-27 22:23:17 Backup prep: type = incr, case = 6, inPlace = 1, doDuplicate = 0, newBkupNum = 1004, newBkupIdx = 3, lastBkupNum = , lastBkupIdx = (FillCycle = 0, noFillCnt = 2) Running: /usr/local/bin/rsync_bpc --bpc-top-dir /mnt/stage/BackupPC --bpc-host-name miscnet --bpc-share-name / --bpc-bkup-num 1004 --bpc-bkup-comp 1 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 48736 --bpc-log-level 9 -e /usr/bin/ssh -q -x -l backuppc --rsync-path=/usr/bin/rsync --super --recursive --protect-args --numeric-ids --perms --owner --group -D --times --links --hard-links --delete --partial --log-format=log: %o %i %B %8U,%8G %9l %f%L --stats --one-file-system --iconv=utf8,utf8 --exclude=/proc --exclude=/nfs miscnet.sga.org:/ / incr backup started for directory / Xfer PIDs are now 14689 This is the rsync child about to exec /usr/local/bin/rsync_bpc bpc_lib_conf_init: topDir = /mnt/stage/BackupPC, logLevel = 9 bpc_path_create(/mnt/stage/BackupPC/pc/miscnet/1004) rsync_bpc: connection unexpectedly closed (0 bytes received so far) [Receiver] bpc_sysCall_cleanup: doneInit = 1 Uncompressed HT: Compressed HT: Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 48736 inode Parsing done: nFilesTotal = 0 rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2] rsync_bpc exited with fatal status 255 (65280) (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) Xfer PIDs are now Got fatal error during xfer (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) Backup aborted (rsync error: unexplained error (code 255) at io.c(629) [Receiver=3.0.9.2]) BackupFailCleanup: nFilesTotal = 0, type = incr, BackupCase = 6, inPlace = 1, lastBkupNum = BackupFailCleanup: inPlace with no new files... no cleanup Running BackupPC_refCountUpdate -h miscnet -f on miscnet xferPids 14698 *** rsync for Mac OS X Host *** Note strange errors in here about odd client rsync args... ???? *** Seems some new arguments were added to the rsync set which aren't *** supported by the rsync on the Mac OS X system: *** New params had --log-format, whereas osx has --log-file-format= *** New params had --protect-args which is not supported on OSX? *** --- This last one is a problem, as the presence of spaces in the filenames *** seems to be causing lots of problems as they aren't escaped properly XferLOG file /mnt/stage/BackupPC/pc/xserve1/XferLOG.1362.z created 2013-09-27 23:44:32 Backup prep: type = incr, case = 6, inPlace = 1, doDuplicate = 0, newBkupNum = 1362, newBkupIdx = 3, lastBkupNum = , lastBkupIdx = (FillCycle = 0, noFillCnt = 0) Running: /usr/local/bin/rsync_bpc --bpc-top-dir /mnt/stage/BackupPC --bpc-host-name xserve1 --bpc-share-name /Shared Items/Net Programs --bpc-bkup-num 1362 --bpc-bkup-comp 1 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 1 --bpc-log-level 5 -e /usr/bin/ssh -q -x -l backuppc --rsync-path=/usr/bin/rsync --super --recursive --protect-args --numeric-ids --perms --owner --group -D --times --links --hard-links --delete --partial --log-format=log: %o %i %B %8U,%8G %9l %f%L --stats xserve1.sga.org:/Shared Items/Net Programs/ / incr backup started for directory /Shared Items/Net Programs Xfer PIDs are now 15131 This is the rsync child about to exec /usr/local/bin/rsync_bpc rsync: on remote machine: -slHogDtpre.iLsf: unknown option rsync error: syntax or usage error (code 1) at /SourceCache/rsync/rsync-40/rsync/main.c(1333) [server=2.6.9] rsync_bpc: connection unexpectedly closed (0 bytes received so far) [Receiver] bpc_sysCall_cleanup: doneInit = 1 Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 1 inode Parsing done: nFilesTotal = 0 rsync error: error in rsync protocol data stream (code 12) at io.c(629) [Receiver=3.0.9.2] rsync_bpc exited with fatal status 12 (3072) (rsync error: error in rsync protocol data stream (code 12) at io.c(629) [Receiver=3.0.9.2]) Xfer PIDs are now Got fatal error during xfer (rsync error: error in rsync protocol data stream (code 12) at io.c(629) [Receiver=3.0.9.2]) Backup aborted (rsync error: error in rsync protocol data stream (code 12) at io.c(629) [Receiver=3.0.9.2]) BackupFailCleanup: nFilesTotal = 0, type = incr, BackupCase = 6, inPlace = 1, lastBkupNum = BackupFailCleanup: inPlace with no new files... no cleanup Running BackupPC_refCountUpdate -h xserve1 -f on xserve1 xferPids 15135 I removed the unsupported arguments, added sudo in front of the rsync command, and I get this which shows the problem with the spaces in the path: Running: /usr/local/bin/rsync_bpc --bpc-top-dir /mnt/stage/BackupPC --bpc-host-name xserve1 --bpc-share-name /Library/FileMaker Server/ --bpc-bkup-num 1363 --bpc-bkup-comp 1 --bpc-bkup-prevnum 1362 --bpc-bkup-prevcomp 1 --bpc-bkup-inode0 1 --bpc-log-level 5 -e /usr/bin/ssh -q -x -l backuppc -c arcfour --rsync-path=/usr/bin/rsync --super --recursive --numeric-ids --perms --owner --group -D --times --links --hard-links --delete --partial --log-file-format=log: %o %i %B %8U,%8G %9l %f%L --stats xserve1.sga.org:/Library/FileMaker Server/ / incr backup started for directory /Library/FileMaker Server/ Xfer PIDs are now 15367 This is the rsync child about to exec /usr/local/bin/rsync_bpc rsync: link_stat "/Library/FileMaker" failed: No such file or directory (2) rsync: link_stat "/Users/backuppc/Server/." failed: No such file or directory (2) But one backup path that didn't have spaces seems to still be having errors: Running: /usr/local/bin/rsync_bpc --bpc-top-dir /mnt/stage/BackupPC --bpc-host-name xserve1 --bpc-share-name /var/spool/imap --bpc-bkup-num 1364 --bpc-bkup-comp 1 --bpc-bkup-prevnum 1363 --bpc-bkup-prevcomp 1 --bpc-bkup-inode0 1 --bpc-log-level 1 -e /usr/bin/ssh -q -x -l backuppc -c arcfour --rsync-path=/usr/bin/sudo /usr/bin/rsync --super --recursive --numeric-ids --perms --owner --group -D --times --links --hard-links --delete --partial --log-file-format=log: %o %i %B %8U,%8G %9l %f%L --stats xserve1.sga.org:/var/spool/imap/ / incr backup started for directory /var/spool/imap Xfer PIDs are now 17841 This is the rsync child about to exec /usr/local/bin/rsync_bpc Xfer PIDs are now 17841,17851 xferPids 17841,17851 rsync_bpc: writefd_unbuffered failed to write 310 bytes to message fd [receiver]: Broken pipe (32) rsync_bpc: writefd_unbuffered failed to write 310 bytes to message fd [receiver]: Broken pipe (32) Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 1561 filesNew, 238536901 sizeNew, 152177945 sizeNewComp, 3133 inode rsync error: error in rsync protocol data stream (code 12) at io.c(1556) [receiver=3.0.9.2] rsync_bpc exited with fatal status 0 (11) (rsync error: error in rsync protocol data stream (code 12) at io.c(1556) [receiver=3.0.9.2]) Xfer PIDs are now Got fatal error during xfer (rsync error: error in rsync protocol data stream (code 12) at io.c(1556) [receiver=3.0.9.2]) Backup aborted (rsync error: error in rsync protocol data stream (code 12) at io.c(1556) [receiver=3.0.9.2]) BackupFailCleanup: nFilesTotal = 0, type = incr, BackupCase = 4, inPlace = 0, lastBkupNum = 1363 Removing empty backup #1363 BackupPC_backupDelete: removing #1363 BackupPC_backupDelete: Merge into backup 1362 BackupPC_backupDelete: got 0 errors Running BackupPC_refCountUpdate -h xserve1 -f on xserve1 xferPids 17903 BackupPC_refCountUpdate: host xserve1 got 0 errors BackupPC_refCountPrint: total errors: 0 xferPids Finished BackupPC_refCountUpdate (running time: 219 sec) ------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60133471&iu=/4140/ostg.clktrk _______________________________________________ BackupPC-devel mailing list BackupPC-devel@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-devel Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
