Thanks for the suggestions...
The problem with transfering each host individually like that is that links
only pertain to that host. The cpool at that point becomes useless to
transfer over. I guess that's not terribly bad, but you'll still need to
wait for the cpool to rebuild itself. A problem I'll run into is that I have
like 3 or 4 hosts that don't exist anymore (were decommissioned), but I need
to keep the backups on them for the next year or so. That's only like 30GB
of my pool, so it should be good.
Thanks for all the suggestions...
On Fri, Mar 28, 2008 at 10:15 PM, dan <[EMAIL PROTECTED]> wrote:
> I suggest you do use rsync -aH but break up the copy into some smaller
> chunks. since you are just copying the pc directory and don't really need
> to worry about the hardlinks in cpool/pool you can just break each rsync up
> into smaller chunks.
>
> something like
>
> for transfer in `find /var/lib/backuppc/pc/ -maxdepth 1`;do rsync -aH
> $transfer rsync://[EMAIL PROTECTED]/var/lib/backuppc/pc/; done
>
> that will break up the rsync so that each host that is backed up will be
> transfered seperately, which will cut down on the 35M files ram requierments
> (3.35GB of ram or so!) to much more manageable chunks. plus you can
> re-run the rsync if the network drops or something.
>
> rebuilding all those hardlinks on the remote side will probably take a few
> eons or so!
>
> good luck
>
> On Fri, Mar 28, 2008 at 2:09 PM, Jack <[EMAIL PROTECTED]> wrote:
>
> > Personally I think building a qemu virtual machine with a LOT of swap
> > is a 'best answer' of the options you outlined.
> >
> > Other options are to run a re-linking program (I had one at some time,
> > but it was in Perl, but it worked. Ran slow, but
> > did well at globally getting rid of all duplicate files and replacing
> > them with hard links.) after other copy methods.
> > If you would come up with a C version that did not trash virtual
> > storage, and could use the parallel nature of some
> > newer machines (threading) and not trash virtual memory like the current
> > versions do, the community would be grateful.
> >
> >
> > -------------------------------------------------------------------------
> > Check out the new SourceForge.net Marketplace.
> > It's the best place to buy or sell services for
> > just about anything Open Source.
> >
> > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
> > _______________________________________________
> > BackupPC-users mailing list
> > [email protected]
> > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > Wiki: http://backuppc.wiki.sourceforge.net
> > Project: http://backuppc.sourceforge.net/
> >
> >
>
-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
BackupPC-users mailing list
[email protected]
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
