I suggest you do use rsync -aH but break up the copy into some smaller
chunks. since you are just copying the pc directory and don't really need
to worry about the hardlinks in cpool/pool you can just break each rsync up
into smaller chunks.
something like
for transfer in `find /var/lib/backuppc/pc/ -maxdepth 1`;do rsync -aH
$transfer rsync://[EMAIL PROTECTED]/var/lib/backuppc/pc/; done
that will break up the rsync so that each host that is backed up will be
transfered seperately, which will cut down on the 35M files ram requierments
(3.35GB of ram or so!) to much more manageable chunks. plus you can re-run
the rsync if the network drops or something.
rebuilding all those hardlinks on the remote side will probably take a few
eons or so!
good luck
On Fri, Mar 28, 2008 at 2:09 PM, Jack <[EMAIL PROTECTED]> wrote:
> Personally I think building a qemu virtual machine with a LOT of swap
> is a 'best answer' of the options you outlined.
>
> Other options are to run a re-linking program (I had one at some time, but
> it was in Perl, but it worked. Ran slow, but
> did well at globally getting rid of all duplicate files and replacing them
> with hard links.) after other copy methods.
> If you would come up with a C version that did not trash virtual storage,
> and could use the parallel nature of some
> newer machines (threading) and not trash virtual memory like the current
> versions do, the community would be grateful.
>
> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
>
> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
> _______________________________________________
> BackupPC-users mailing list
> [email protected]
> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki: http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
>
-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
BackupPC-users mailing list
[email protected]
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
