try adding more swap. It doesn't have to be real memory.
Also, make sure you're running into actual memory exhaustion, rather
than a limit. try "ulimit" as the user who runs rsync on the source
machine; assuming you're on linux, modify /etc/security/limits.conf as
necessary. other OSes will have similar mechanisms.
Laverne Schrock <mailto:[email protected]>
March 23, 2016 at 5:22 PM
Hi,
I have a file system that I am trying to backup with BackupPC using
the rsync Xfer method. We are running BackupPC version 3.2.1. File
server has rsync version 3.0.9. The logs show that the transfer uses
protocol 28.
When we tried to run the backup, it started successfully, and then
died after around 8 hours. The only error message that could be found
was one in /var/log/BackupPC/LOG that said "out of memory".
From what I've read this is most likely caused by rsync running out of
memory when it is building the in memory file list. Here are the stats
on the file system. It contains 924G of data as reported by `df`.
Running `find . | wc -l` reports 31983221 files. Some have suggested
breaking the backup down into several runs. This is a home folder
shared via NFS, so there is no easy division here.
Is there anything we can do to make this work with the rsync method,
or is this just too much? I'd really prefer it over tar.
Thanks,
L. Schrock
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
_______________________________________________
BackupPC-users mailing list
[email protected]
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Dan Pritts
ICPSR Computing & Network Services
University of Michigan
+1 (734) 615-9529
------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785351&iu=/4140
_______________________________________________
BackupPC-users mailing list
[email protected]
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
