I have to agree with the suggestions to turn up the new server and let the
old one stay up for a while. at some point you can just pick some specific
full backups and do a tgz or zip dump to tape or DVD for long term storage
and flip the power off.
On Dec 28, 2007 7:39 PM, John Pettitt <[EMAIL PROTECTED]> wrote:
> Bryan Penney wrote:
> > The pool consists of about 3.8 million files, so there are a lot of
> > small files.
> >
>
> My experience when I had to do this on one of my servers was that it's
> not the pool itself that kills you it's linking all the directory trees
> from the pc directories. The box I was using could link 500 files a
> second but it still too five days to complete.
>
> Unless you need to take the old server out of service I'd suggest just
> making all the hosts backup disabled and then letting the new server
> build it's own history. Wait three months then take the old server down.
>
> John
> > On 12/28/2007 5:37 PM, dan wrote:
> >
> >> then you should be able to rsync that accross in 4 or 5 hours. is it
> >> mostly large files or small files? if it is large files then you
> >> should be fine, but a ton of small files might be rough. just give it
> >> a shot, only way to know for sure :)
> >>
> >> On Dec 28, 2007 4:29 PM, Bryan Penney <[EMAIL PROTECTED]
> >> <mailto:[EMAIL PROTECTED]>> wrote:
> >>
> >> Yeah we will have them plugged into the same gigabit switch.
> >>
> >> On 12/28/2007 5:17 PM, Daniel Denson wrote:
> >> > Bryan Penney wrote:
> >> >> The original document I quoted was for an older version, but I
> >> found
> >> >> one for 2.9.1 and is still says it doesn't understand hardlinks
> >> >>
> >> >>
> >>
> http://www.seas.upenn.edu/~bcpierce/unison//download/releases/unison-2.9.1/unison-manual.pdf<http://www.seas.upenn.edu/%7Ebcpierce/unison//download/releases/unison-2.9.1/unison-manual.pdf>
> >> <
> http://www.seas.upenn.edu/%7Ebcpierce/unison//download/releases/unison-2.9.1/unison-manual.pdf
> >
> >> >>
> >> >>
> >> >> I've copied a much smaller pool (150GB) using rsync when we
> first
> >> >> went to a production server.
> >> >>
> >> >> Both of the servers have 2GB of RAM.
> >> >> After I get the drives for the new server, I will try rsync.
> >> It will
> >> >> be interesting to see how long it takes to copy all of this
> >> data with
> >> >> all of those hardlinks.
> >> >>
> >> >> thanks for the help.
> >> >>
> >> >> Bryan
> >> >>
> >> >>
> >> >>
> >> >> On 12/28/2007 4:50 PM, dan wrote:
> >> >>> no it wouldnt, but i though it did. is that statement for an
> >> older
> >> >>> version? it may just not handle it. rsync should work if you
> >> have
> >> >>> enough RAM
> >> >>>
> >> >>> On Dec 28, 2007 3:10 PM, Bryan Penney < [EMAIL PROTECTED]
> >> <mailto:[EMAIL PROTECTED]>
> >> >>> <mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>> wrote:
> >> >>>
> >> >>> In reading about Unison I found a statement in the Caveats
> and
> >> >>> Shortcomings section that said "Unison does not understand
> >> hard
> >> >>> links"
> >> >>>
> >> >>> If this is true, would Unison work in this situation?
> >> >>>
> >> >>> On 12/28/2007 2:28 PM, dan wrote:
> >> >>> > no, you will have to copy the entire 'pool' or 'cpool'
> >> over. you
> >> >>> > could copy individual pc backups, BUT when backuppc
> nightly
> >> >>> runs it
> >> >>> > will remove any hardlinks from the pool that are not
> needed
> >> >>> > elsewhere. when you copy over pc backups after that,
> >> the will
> >> >>> not use
> >> >>> > hardlinks and so your filesystem usage will go up a lot.
> i
> >> >>> would very
> >> >>> > much suggest you do it all in one shot.
> >> >>> >
> >> >>> > i know that time is against you on this and that 2TB
> >> even over
> >> >>> gigabit
> >> >>> > is 5 hours so i would suggest that you rsync the files
> over
> >> >>> once and
> >> >>> > leave your other machine up running backups, then once
> >> it has
> >> >>> > finished, turn backups off and rsync the source to the
> >> target
> >> >>> again.
> >> >>> > then you will have the bulk of the data over and only
> >> have to
> >> >>> pull
> >> >>> > changes. i worry about the file count for 2TB being
> >> too much
> >> >>> for
> >> >>> > rsync so consider Unison for the transfers. In my
> >> reading i have
> >> >>> > found that though unison has the same issue as rsync(same
> >> >>> algorythms)
> >> >>> > for a high number for files, it can handle more files in
> >> less
> >> >>> memory.
> >> >>> >
> >> >>> > I have done this method to push about 800GB over and it
> >> worked
> >> >>> well,
> >> >>> > but my backup server has 2GB of RAM and runs gigabit.
> >> >>> >
> >> >>> > maybe consider adding some network interfaces and
> >> channel bonding
> >> >>> > them. i dont know if you have parts lying around but
> >> channel
> >> >>> bonding
> >> >>> > in linux is pretty easy and you have agrigate each NICs
> >> >>> bandwidth to
> >> >>> > reduce that transfer time though i suspect that your
> drives
> >> >>> are not
> >> >>> > much faster than 1 gigabit NIC so you might not get much
> >> >>> benefit on
> >> >>> > gigabit.
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>> > On Dec 28, 2007 10:17 AM, Bryan Penney <
> >> [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
> >> >>> <mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> >> >>> > <mailto: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
> >> <mailto:[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>>> wrote:
> >> >>> >
> >> >>> > We have a server running BackupPC that has filled up
> >> it's 2TB
> >> >>> > partition
> >> >>> > (96% full anyway). We are planning on moving
> >> BackupPC to
> >> >>> another
> >> >>> > server
> >> >>> > but would like bring the history of backups over
> >> without
> >> >>> waiting the
> >> >>> > extended period of time (days?) for the entire pool
> >> to copy.
> >> >>> Is there
> >> >>> > any way to copy "pieces" of the pool, maybe per PC,
> >> at a
> >> >>> time? This
> >> >>> > would allow us to migrate over the course of a few
> weeks
> >> >>> without
> >> >>> > having
> >> >>> > days at a time with no backups.
> >> >>> >
> >> >>> >
> >> >>> >
> >> >>>
> >>
> -------------------------------------------------------------------------
> >> >>>
> >> >>>
> >> >>> > This SF.net email is sponsored by: Microsoft
> >> >>> > Defy all challenges. Microsoft(R) Visual Studio 2005.
> >> >>> >
> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> >> >>> <http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> >> <http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/>>
> >> >>> > _______________________________________________
> >> >>> > BackupPC-users mailing list
> >> >>> > [email protected]
> >> <mailto:[email protected]>
> >> >>> <mailto:[email protected]
> >> <mailto:[email protected]>>
> >> >>> > <mailto: [email protected]
> >> <mailto:[email protected]>
> >> >>> <mailto:[email protected]
> >> <mailto:[email protected]>>>
> >> >>> > List:
> >> >>> >
> >> https://lists.sourceforge.net/lists/listinfo/backuppc-users
> >> >>> > <
> >> https://lists.sourceforge.net/lists/listinfo/backuppc-users
> >> >>>
> >> <https://lists.sourceforge.net/lists/listinfo/backuppc-users
> >> <https://lists.sourceforge.net/lists/listinfo/backuppc-users>>>
> >> >>> > Wiki: http://backuppc.wiki.sourceforge.net
> >> >>> > Project: http://backuppc.sourceforge.net/
> >> >>> <http://backuppc.sourceforge.net/>
> >> >>> > < http://backuppc.sourceforge.net/>
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>
> >> > a long time. you got gigabit?
> >> >
> >> >
> >> >
> >>
> >>
> >>
> >
> >
> >
> -------------------------------------------------------------------------
> > This SF.net email is sponsored by: Microsoft
> > Defy all challenges. Microsoft(R) Visual Studio 2005.
> > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
> > _______________________________________________
> > BackupPC-users mailing list
> > [email protected]
> > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > Wiki: http://backuppc.wiki.sourceforge.net
> > Project: http://backuppc.sourceforge.net/
> >
> >
>
>
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
BackupPC-users mailing list
[email protected]
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
