What versions are you running? Specifically, BackupPC, rsync-bpc and BackupPC::XS.
Craig On Tue, Oct 20, 2020 at 10:16 AM David Hoskinson < david.hoskin...@astroshapes.com> wrote: > I am having issues with a backup of a nethserver with a 2 TB directory > being backed up. The system being backed up is Centos 7.8 and my backuppc > server is at the latest version. I have backed this up over the last month > with no problems, but had to delete them as selinux was turned on and was > causing issues syncing through nfs to our offsite box. I deleted all the > backups for this server and am starting fresh. Config file for this backup > has not changed. The backuppc box has 64 GB of memory and 96 TB of space > and nethserver has plenty of memory and space as well so i am not sure whay > it is now saying out of memory. I keep restarting job about every hour and > it seems to pick up where it left off as rsync will do but can't always do > that > > Other large backups of comparable sizes are working fine > > following is snippets from xfer log > > Running BackupPC_refCountUpdate -h ad1 -f on ad1 > Xfer PIDs are now 2819737 > BackupPC_refCountUpdate: host ad1 got 0 errors (took 132 secs) > Xfer PIDs are now > Finished BackupPC_refCountUpdate (running time: 132 sec) > Xfer PIDs are now > XferLOG file /backup/astrobackup//pc/ad1/XferLOG.0.z created 2020-10-20 > 04:46:13 > Backup prep: type = full, case = 6, inPlace = 1, doDuplicate = 0, > newBkupNum = 0, newBkupIdx = 0, lastBkupNum = , lastBkupIdx = (FillCycle = > 0, noFillCnt = ) > Running: /usr/bin/rsync_bpc --bpc-top-dir /backup/astrobackup/ > --bpc-host-name ad1 --bpc-share-name /var/lib/nethserver/ --bpc-bkup-num 0 > --bpc-bkup-comp 3 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 > --bpc-bkup-inode0 8416746 --bpc-log-level 1 --bpc-attrib-new -e > /usr/bin/ssh\ -l\ root --rsync-path=/usr/bin/rsync --numeric-ids --perms > --owner --group -D --links --hard-links --times --block-size=2048 > --recursive --checksum --timeout=72000 ad1:/var/lib/nethserver/ / > full backup started for directory /var/lib/nethserver/ > Xfer PIDs are now 2819741 > This is the rsync child about to exec /usr/bin/rsync_bpc > Xfer PIDs are now 2819741,2819743 > xferPids 2819741,2819743 > R setVarInt botch: got negative argument -1; setting to 0 > ERROR: out of memory in receive_sums [sender] > rsync error: error allocating core memory buffers (code 22) at > util2.c(106) [sender=3.1.2] > Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, > 0 sizeTotal, 6 filesNew, 728183826 sizeNew, 44711371 sizeNewComp, 8416749 > inode > rsync_bpc: [generator] write error: Broken pipe (32) > DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 4006236 > filesTotal, 945858113364 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, > 8416750 inode > rsync_bpc exited with fatal status 22 (5632) (rsync_bpc: [generator] write > error: Broken pipe (32)) > Removing rsync temporary file > /backup/astrobackup//pc/ad1/0/rsyncTmp.2819741.1.2 > Xfer PIDs are now > Got fatal error during xfer (rsync_bpc: [generator] write error: Broken > pipe (32)) > Backup aborted (rsync_bpc: [generator] write error: Broken pipe (32)) > BackupFailCleanup: nFilesTotal = 4006236, type = full, BackupCase = 6, > inPlace = 1, lastBkupNum = > BackupFailCleanup: inPlace with some new files... no cleanup and marking > partial > Running BackupPC_refCountUpdate -h ad1 -f on ad1 > Xfer PIDs are now 2819865 > BackupPC_refCountUpdate: host ad1 got 0 errors (took 239 secs) > Xfer PIDs are now > > David Hoskinson > Systems Administrator > Ext 226 > > > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
