You shouldn't need to do anything special. The rsyncTmp files should be removed after a backup completes (whether it succeeds or fails), although that won't happen if the backup or BackupPC is terminated abnormally. So just try to avoid situations where a backup is terminated abruptly (eg, reboot or stopping BackupPC).
I did push a change <https://github.com/backuppc/backuppc/commit/e1d6c2f1631a55939553bf4333b464bdc28e6a1d> that makes BackupPC_backupDuplicate ignore rsyncTmp files. It's a one-line change, so you could add that to your code if you want. It will be in the next release. Craig On Tue, Oct 6, 2020 at 12:53 PM McDonald, Peter George < pmcdon...@thorntontomasetti.com> wrote: > Craig, > > This worked a charm. > > I was able to launch a backup manually. And as of tonight, it's auto > launched an incremental and completed successfully. > > Is there anything I need to do / keep on top of, to prevent this from > occurring again ? Like periodically removing the rsyncTmp files ? Or is > this a hang over from the upgrade ? > > Thanks again! > > Peter > <https://bit.ly/tt_cr> > > ------------------------------ > *From:* Craig Barratt <cbarr...@users.sourceforge.net> > *Sent:* 04 October 2020 23:09 > *To:* McDonald, Peter George <pmcdon...@thorntontomasetti.com> > *Cc:* General list for user discussion, questions and support < > backuppc-users@lists.sourceforge.net> > *Subject:* Re: [BackupPC-users] backuppc v4 hanging when starting backup > > Ok, thanks. It should be safe to remove the extra directories, but you > should run BackupPC_refCountUpdate afterwards just to be sure the reference > counts are correct. > > Here are the steps: > > - su backuppc_user > - cd localhost > - rm -rf 9[4-8] > - rm -f 93/rsyncTmp* > - BackupPC_refCountUpdate -h localhost -f > > Craig > > On Sun, Oct 4, 2020 at 3:00 PM McDonald, Peter George < > pmcdon...@thorntontomasetti.com> wrote: > > Nothing past 93 appears in the cgi - they all got stuck at duplicate and I > had to restart the service. > > 93 is a full/filled and was done with v4. > > -Peter > > ------------------------------ > *From:* Craig Barratt <cbarr...@users.sourceforge.net> > *Sent:* Sunday, October 4, 2020 10:57 pm > *To:* General list for user discussion, questions and support > *Cc:* McDonald, Peter George > *Subject:* Re: [BackupPC-users] backuppc v4 hanging when starting backup > > Does the localhost/backups file contain entries (rows) for backups > #94-#98? Do those backups appear in the CGI summary for that host? > > Is #93 a full/filled backup done using V4? > > Craig > > On Sun, Oct 4, 2020 at 2:45 PM McDonald, Peter George via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: > > I believe the migration was done, the last good backup I have is a full at > number 93 (I'm at 98 now, after 5 failed attempts). In the 93 folder, the > rsyncTmp files (of which there are two) are 13Gb each. In these new > folders, rsyncTemp is zero size. > > What would you need to see - we could possibly arrange something. > > -Peter > > Peter G. McDonald, Ph.D. > Associate > Thornton Tomasetti Defence Ltd > 2 St David's Drive > St David's Business Park > Dalgety Bay > Fife, KY11 9PF > United Kingdom > T: +44 (0) 1383 828270 F: +44 (0) 1383 821682 > D: +44 (0) 1383 828978 M: +44 (0) 7868128152 > pmcdon...@thorntontomasetti.com > www.ThorntonTomasetti.com <http://www.thorntontomasetti.com/> > > *Visit our 2019/20 **Annual Report <https://bit.ly/tt_ingenuity> **and > **Corporate > Responsibility Report <https://bit.ly/tt_cr>* > <https://bit.ly/tt_cr> > > ------------------------------ > *From:* Craig Barratt <cbarr...@users.sourceforge.net> > *Sent:* 04 October 2020 22:32 > *To:* McDonald, Peter George <pmcdon...@thorntontomasetti.com> > *Cc:* General list for user discussion, questions and support < > backuppc-users@lists.sourceforge.net> > *Subject:* Re: [BackupPC-users] backuppc v4 hanging when starting backup > > That's an excellent clue. The rsyncTmp.* files could be very large. They > can be safely deleted. In fact, I should have BackupPC_backupDuplicate > ignore them. > > I can't answer your question about whether it's safe to delete the copies > without knowing more. Did you run bin/BackupPC_migrateV3toV4? What is the > last full/filled backup that you think is complete/correct? > > It would be helpful to see the backups file. > > Craig > > On Sun, Oct 4, 2020 at 1:32 PM McDonald, Peter George < > pmcdon...@thorntontomasetti.com> wrote: > > It seems to be getting stuck here - not sure if this is enlightening at > all ? > > > Creating directory > /tt-archive/backuppc/pc/localhost/96/./f%2fshare%2fhome%2fcfd/finstallation_packages > > Got path = > ./f%2fshare%2fhome%2fcfd/finstallation_packages/attrib_88b274e4b7832babbbe8f66bb4571c31, > name = attrib_88b274e4b7832babbbe8f66bb4571c31, e,d,f = 1,0,1 > Got path = > ./f%2fshare%2fhome%2fcfd/attrib_3b5fcb164e6ca5bf3afa64b234c6e072, name = > attrib_3b5fcb164e6ca5bf3afa64b234c6e072, e,d,f = 1,0,1 > Got path = ./backupInfo, name = backupInfo, e,d,f = 1,0,1 > Got path = ./rsyncTmp.9948.0.4, name = rsyncTmp.9948.0.4, e,d,f = 1,0,1 > > Is It safe to delete /tt-archive/backuppc/pc/localhost/96/ - and the > other ones that have started to duplicate and hung ? > > Cheers, > > Peter G. McDonald > ------------------------------ > *From:* Craig Barratt <cbarr...@users.sourceforge.net> > *Sent:* 03 October 2020 19:44 > *To:* General list for user discussion, questions and support < > backuppc-users@lists.sourceforge.net> > *Cc:* McDonald, Peter George <pmcdon...@thorntontomasetti.com> > *Subject:* Re: [BackupPC-users] backuppc v4 hanging when starting backup > > [External Sender] > > Not sure why this should happen. It's just copying a tree of directories > that contain one empty file, so that shouldn't be a problem. > > I'd recommend manually running BackupPC_backupDuplicate as the BackupPC > user with $Conf{XferLogLevel} set to 5. First make sure a backup isn't > running on localhost. Then: > > su backuppc_user > > /usr/local/bin/BackupPC_backupDuplicate -h localhost > > > You should see one line of output for each file/directory it encounters. > That should allow you to see where it stalls or fails. > > Craig > > On Sat, Oct 3, 2020 at 4:51 AM McDonald, Peter George via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: > > Hi, > > Apologies if this is not the correct place for this. > > We recently upgraded from v3 to v4 in order to try and get better > performance, v3 worked fine. Since upgrading to v4 whenever a new scheduled > backup starts > it sits at the 'copy' stage. For example : > > > Host <http://localhost:8881/backuppc?action=status#> Type > <http://localhost:8881/backuppc?action=status#> User > <http://localhost:8881/backuppc?action=status#> Start Time > <http://localhost:8881/backuppc?action=status#> Command > <http://localhost:8881/backuppc?action=status#> PID > <http://localhost:8881/backuppc?action=status#> Xfer PID > <http://localhost:8881/backuppc?action=status#> Status > <http://localhost:8881/backuppc?action=status#> Count > <http://localhost:8881/backuppc?action=status#> > localhost <http://localhost:8881/backuppc?host=localhost> backup backuppc 10/3 > 08:59 BackupPC_dump -i localhost 12647 12650 copy #93 -> #95 1008 dirs > > From here, it does not continue, and nothing is being written to the logs, > and the a top of the PID shows nothing happening.. > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 12647 backuppc 20 0 175228 15124 2708 S 0.0 0.0 0:00.07 > BackupPC_dump > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 12650 backuppc 20 0 164548 9572 2496 D 0.0 0.0 0:00.86 > BackupPC_backup > > Any suggestions where to look ? I attempted to launch a backup manually > from the command line with :- > > /usr/bin/perl /usr/share/BackupPC/bin/BackupPC_dump -i localhost > > Which worked, although seemed to overwrite my last previous backup. After > that I was able to launch jobs manually via the CGI interface, but after a > scheduled attempt everything gets stuck again. > > Any suggestions appreciated. > > Thanks, > > Peter G. McDonald, Ph.D. > > pmcdon...@thorntontomasetti.com > www.ThorntonTomasetti.com <http://www.thorntontomasetti.com/> > > <https://bit.ly/tt_cr> > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ > >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
