Sorry didn't realize that was a hyper link. Found it
From: "David Hoskinson" <david.hoskin...@astroshapes.com>
To: "backuppc-users" <backuppc-users@lists.sourceforge.net>
Sent: Tuesday, October 20, 2020 2:40:09 PM
Subject: Re: [BackupPC-users] Problems doing full backup resulting in out of
memory errors
Just to be clear, would that be rsync-bpc 3.1.2.2? Thats the way it sounds
this is the current path. Just want to be sure i don't break anything
$Conf{RsyncBackupPCPath} = '/usr/bin/rsync_bpc';
I will add more logging to the rsyncargsextra
From: "backuppc-users" <backuppc-users@lists.sourceforge.net>
To: "backuppc-users" <backuppc-users@lists.sourceforge.net>
Cc: "Craig Barratt" <cbarr...@users.sourceforge.net>
Sent: Tuesday, October 20, 2020 1:51:23 PM
Subject: Re: [BackupPC-users] Problems doing full backup resulting in out of
memory errors
CAUTION: This email originated from outside your organization. Exercise caution
when opening attachments or clicking links, especially from unknown senders.
This warning could be significant:
R setVarInt botch: got negative argument -1; setting to 0
Could you try [ https://github.com/backuppc/rsync-bpc/releases/tag/3.1.2.2 |
rsync 3.1.2.2 ] ? If you can't find a package for it you can build it from the
source tarball. There's no need to install it after you run "make"; you could
instead just point $Conf{RsyncBackupPCPath} to the rsync_bpc in the build
directory. (BTW, other than gcc and make, you will need to install libacl1-dev
to build successfully.)
If it still fails, the next step is to turn on more logging. A starting point
would be to add "-vvv" to $Conf{RsyncArgsExtra}.
Craig
On Tue, Oct 20, 2020 at 10:41 AM David Hoskinson < [
mailto:david.hoskin...@astroshapes.com | david.hoskin...@astroshapes.com ] >
wrote:
BQ_BEGIN
BackupPC-XS-0.62-1.el8.x86_64
BackupPC-4.4.0-1.el8.x86_64
rsync-bpc-3.1.2.0-3.el8.x86_64
From: "backuppc-users" < [ mailto:backuppc-users@lists.sourceforge.net |
backuppc-users@lists.sourceforge.net ] >
To: "backuppc-users" < [ mailto:backuppc-users@lists.sourceforge.net |
backuppc-users@lists.sourceforge.net ] >
Cc: "Craig Barratt" < [ mailto:cbarr...@users.sourceforge.net |
cbarr...@users.sourceforge.net ] >
Sent: Tuesday, October 20, 2020 1:17:58 PM
Subject: Re: [BackupPC-users] Problems doing full backup resulting in out of
memory errors
CAUTION: This email originated from outside your organization. Exercise caution
when opening attachments or clicking links, especially from unknown senders.
What versions are you running? Specifically, BackupPC, rsync-bpc and
BackupPC::XS.
Craig
On Tue, Oct 20, 2020 at 10:16 AM David Hoskinson < [
mailto:david.hoskin...@astroshapes.com | david.hoskin...@astroshapes.com ] >
wrote:
BQ_BEGIN
I am having issues with a backup of a nethserver with a 2 TB directory being
backed up. The system being backed up is Centos 7.8 and my backuppc server is
at the latest version. I have backed this up over the last month with no
problems, but had to delete them as selinux was turned on and was causing
issues syncing through nfs to our offsite box. I deleted all the backups for
this server and am starting fresh. Config file for this backup has not changed.
The backuppc box has 64 GB of memory and 96 TB of space and nethserver has
plenty of memory and space as well so i am not sure whay it is now saying out
of memory. I keep restarting job about every hour and it seems to pick up where
it left off as rsync will do but can't always do that
Other large backups of comparable sizes are working fine
following is snippets from xfer log
Running BackupPC_refCountUpdate -h ad1 -f on ad1
Xfer PIDs are now 2819737
BackupPC_refCountUpdate: host ad1 got 0 errors (took 132 secs)
Xfer PIDs are now
Finished BackupPC_refCountUpdate (running time: 132 sec)
Xfer PIDs are now
XferLOG file /backup/astrobackup//pc/ad1/XferLOG.0.z created 2020-10-20
04:46:13
Backup prep: type = full, case = 6, inPlace = 1, doDuplicate = 0, newBkupNum =
0, newBkupIdx = 0, lastBkupNum = , lastBkupIdx = (FillCycle = 0, noFillCnt = )
Running: /usr/bin/rsync_bpc --bpc-top-dir /backup/astrobackup/ --bpc-host-name
ad1 --bpc-share-name /var/lib/nethserver/ --bpc-bkup-num 0 --bpc-bkup-comp 3
--bpc-bkup-prevnum -1 --bpc-bkup-prevcomp -1 --bpc-bkup-inode0 8416746
--bpc-log-level 1 --bpc-attrib-new -e /usr/bin/ssh\ -l\ root
--rsync-path=/usr/bin/rsync --numeric-ids --perms --owner --group -D --links
--hard-links --times --block-size=2048 --recursive --checksum --timeout=72000
ad1:/var/lib/nethserver/ /
full backup started for directory /var/lib/nethserver/
Xfer PIDs are now 2819741
This is the rsync child about to exec /usr/bin/rsync_bpc
Xfer PIDs are now 2819741,2819743
xferPids 2819741,2819743
R setVarInt botch: got negative argument -1; setting to 0
ERROR: out of memory in receive_sums [sender]
rsync error: error allocating core memory buffers (code 22) at util2.c(106)
[sender=3.1.2]
Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0
sizeTotal, 6 filesNew, 728183826 sizeNew, 44711371 sizeNewComp, 8416749 inode
rsync_bpc: [generator] write error: Broken pipe (32)
DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 4006236
filesTotal, 945858113364 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp,
8416750 inode
rsync_bpc exited with fatal status 22 (5632) (rsync_bpc: [generator] write
error: Broken pipe (32))
Removing rsync temporary file
/backup/astrobackup//pc/ad1/0/rsyncTmp.2819741.1.2
Xfer PIDs are now
Got fatal error during xfer (rsync_bpc: [generator] write error: Broken pipe
(32))
Backup aborted (rsync_bpc: [generator] write error: Broken pipe (32))
BackupFailCleanup: nFilesTotal = 4006236, type = full, BackupCase = 6, inPlace
= 1, lastBkupNum =
BackupFailCleanup: inPlace with some new files... no cleanup and marking
partial
Running BackupPC_refCountUpdate -h ad1 -f on ad1
Xfer PIDs are now 2819865
BackupPC_refCountUpdate: host ad1 got 0 errors (took 239 secs)
Xfer PIDs are now
David Hoskinson
Systems Administrator
Ext 226
_______________________________________________
BackupPC-users mailing list
[ mailto:BackupPC-users@lists.sourceforge.net |
BackupPC-users@lists.sourceforge.net ]
List: [ https://lists.sourceforge.net/lists/listinfo/backuppc-users |
https://lists.sourceforge.net/lists/listinfo/backuppc-users ]
Wiki: [ https://github.com/backuppc/backuppc/wiki |
https://github.com/backuppc/backuppc/wiki ]
Project: [
https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,DH4p6aLX80kv807I-rwKqfGwhooDM-PH3l3QZ3J3-snGtk5fC3mqpAVzWbcB930v8YzFdq8KkD-ogifrZjfC4T0JTlMmad7Ocks8U5E1eAjPW__Cqg,,&typo=1
| https://backuppc.github.io/backuppc/ ]
BQ_END
_______________________________________________
BackupPC-users mailing list
[ mailto:BackupPC-users@lists.sourceforge.net |
BackupPC-users@lists.sourceforge.net ]
List: [ https://lists.sourceforge.net/lists/listinfo/backuppc-users |
https://lists.sourceforge.net/lists/listinfo/backuppc-users ]
Wiki: [ https://github.com/backuppc/backuppc/wiki |
https://github.com/backuppc/backuppc/wiki ]
Project: [
https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,6mQEW2WiU1g3fuYOJYN84au5Z0-Xt1KQcIil1KT3a59-ukqQEiydSNo68LL3otQsTaowu1zpyzPc5MBDNOVP5DJecaw2zbV8grHMJHEX4bdPbTSYa9VmbPup7A,,&typo=1
|
https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,6mQEW2WiU1g3fuYOJYN84au5Z0-Xt1KQcIil1KT3a59-ukqQEiydSNo68LL3otQsTaowu1zpyzPc5MBDNOVP5DJecaw2zbV8grHMJHEX4bdPbTSYa9VmbPup7A,,&typo=1
]
_______________________________________________
BackupPC-users mailing list
[ mailto:BackupPC-users@lists.sourceforge.net |
BackupPC-users@lists.sourceforge.net ]
List: [ https://lists.sourceforge.net/lists/listinfo/backuppc-users |
https://lists.sourceforge.net/lists/listinfo/backuppc-users ]
Wiki: [ https://github.com/backuppc/backuppc/wiki |
https://github.com/backuppc/backuppc/wiki ]
Project: [
https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,WB9nLeWR2Dg-ssb09n19G-GFHQ43sc2zHJ2Q6Ha7Ty7KA9zRQd5ASCXAdHBtkdJpyeUSaR0DcAo8g8jcPr8vPQ8VOL5jsc9p2EdBgupAAgYvSRtEdIYQjA,,&typo=1
| https://backuppc.github.io/backuppc/ ]
BQ_END
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project:
https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbackuppc.github.io%2fbackuppc%2f&c=E,1,HlIGfcaJfsocGUo0v0FEf-0yyXh9mbZ-131Tt12QdmWhGvgwuR2pxJbspC1eUM0H5WqB0schD1qOBCiBOYsdl2Uhd5lvOyDsvgkUox2AXJ1_Cjnp-10oX1EwXMfj&typo=1
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
