I am having issues with a backup of a nethserver with a 2 TB directory being backed up. The system being backed up is Centos 7.8 and my backuppc server is at the latest version. I have backed this up over the last month with no problems, but had to delete them as selinux was turned on and was causing issues syncing through nfs to our offsite box. I deleted all the backups for this server and am starting fresh. Config file for this backup has not changed. The backuppc box has 64 GB of memory and 96 TB of space and nethserver has plenty of memory and space as well so i am not sure whay it is now saying out of memory. I keep restarting job about every hour and it seems to pick up where it left off as rsync will do but can't always do that
Other large backups of comparable sizes are working fine following is snippets from xfer log Running BackupPC_refCountUpdate -h ad1 -f on ad1 Xfer PIDs are now 2819737 BackupPC_refCountUpdate: host ad1 got 0 errors (took 132 secs) Xfer PIDs are now Finished BackupPC_refCountUpdate (running time: 132 sec) Xfer PIDs are now XferLOG file /backup/astrobackup//pc/ad1/XferLOG.0.z created 2020-10-20 04:46:13 Backup prep: type = full, case = 6, inPlace = 1, doDuplicate = 0, newBkupNum = 0, newBkupIdx = 0, lastBkupNum = , lastBkupIdx = (FillCycle = 0, noFillCnt = ) Running: /usr/bin/rsync_bpc --bpc-top-dir /backup/astrobackup/ --bpc-host-name ad1 --bpc-share-name /var/lib/nethserver/ --bpc-bkup-num 0 --bpc-bkup-comp 3 --bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 8416746 --bpc-log-level 1 --bpc-attrib-new -e /usr/bin/ssh\ -l\ root --rsync-path=/usr/bin/rsync --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --checksum --timeout=72000 ad1:/var/lib/nethserver/ / full backup started for directory /var/lib/nethserver/ Xfer PIDs are now 2819741 This is the rsync child about to exec /usr/bin/rsync_bpc Xfer PIDs are now 2819741,2819743 xferPids 2819741,2819743 R setVarInt botch: got negative argument -1; setting to 0 ERROR: out of memory in receive_sums [sender] rsync error: error allocating core memory buffers (code 22) at util2.c(106) [sender=3.1.2] Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal, 6 filesNew, 728183826 sizeNew, 44711371 sizeNewComp, 8416749 inode rsync_bpc: [generator] write error: Broken pipe (32) DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 4006236 filesTotal, 945858113364 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp, 8416750 inode rsync_bpc exited with fatal status 22 (5632) (rsync_bpc: [generator] write error: Broken pipe (32)) Removing rsync temporary file /backup/astrobackup//pc/ad1/0/rsyncTmp.2819741.1.2 Xfer PIDs are now Got fatal error during xfer (rsync_bpc: [generator] write error: Broken pipe (32)) Backup aborted (rsync_bpc: [generator] write error: Broken pipe (32)) BackupFailCleanup: nFilesTotal = 4006236, type = full, BackupCase = 6, inPlace = 1, lastBkupNum = BackupFailCleanup: inPlace with some new files... no cleanup and marking partial Running BackupPC_refCountUpdate -h ad1 -f on ad1 Xfer PIDs are now 2819865 BackupPC_refCountUpdate: host ad1 got 0 errors (took 239 secs) Xfer PIDs are now David Hoskinson Systems Administrator Ext 226 _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/
