A couple of suggestions:
1. Continue to use reiserfs.
reiserfs is far superior to ext3 when you have many thousands of files.
ext3 has that hard link limit for a reason. If you convert your massive pool to
ext3, I have a hunch that you will experience serious performance issues with
BackupPC.
2. Patch ext3 source.
A quick google found this ext3 patch to extend hard links to 65000:
http://marc.theaimsgroup.com/?l=linux-ext4&m=114376674910528&w=2
2. Use rsync instead of tar.
rsync has no problem with special files and should be much faster for you.
'rsync -axv -e ssh [EMAIL PROTECTED]:/source/ /dest/' will do the trick.
________________________________
From: [EMAIL PROTECTED] on behalf of Hamish Guthrie
Sent: Mon 3/12/2007 2:32 AM
To: backuppc-users@lists.sourceforge.net
Subject: [BackupPC-users] Transferring pool data from Reiser to ext3
Hi,
I am upgrading my BackupPC server. My old server was running SuSE 9.2
with ReiserFS and BackupPC 2.1.1, the new server is running SuSE10.2
with ext3. (I have not yet installed BackupPC on this server but intend
installing 3.0).
Some stats about my pool:
* 78 full backups of total size 2438.04GB (prior to pooling and
compression),
* 39 incr backups of total size 79.70GB (prior to pooling and
compression).
Pool is 394.80GB comprising 950631 files and 4369 directories (as of
3/11 02:20)
Which just goes to show how efficient BackupPC really is.
In order to copy the pool from the one server to the other, I used the
following command on the old server:
tar cf - backuppc | ssh [EMAIL PROTECTED] tar xf - -C /public/
This preserves hard links and does not overly load either system (as
would be the case when attempting to use rsync for the same operation).
I have one problem, and that is, it appears as though possibly in
ReiserFS, the limit as to the number of hard links for a single file is
a lot higher than the hard link limit on ext3. I have one file in the
entire (ReiserFS) pool which has 50270 hard links. With ext3 this limit
on the hard links is 32000. This is indeed the case because on my new
server, the number of hard links for this file is set 32000 and during
the copy procedure, I received a *LOT* of errors like the error message
below:
tar: backuppc/cpool/3/6/1/361ebfd223c9523c7d3837842c701813: Cannot hard
link to
`backuppc/pc/w2kguth.prodigi.biz/157/fcDrive/ftes/fcms/fhelp/fcss/findex.html':
Too many links
In the config file on the old server I do have $Conf{HardLinkMax} = 31999;
I have read the mail archives and note that BackupPC 3.0 'should' be
catering for this limit if I read the post correctly.
What I now need to do is to be able to fix my backup pool so that this
particular file's link count does not exceed 32000, and then I will have
to get the pool data across again.
Would anyone be able to make a recommendation as to how to fix this issue?
Any assistance would be greatly appreciated.
Thanks in advance
Hamish
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
The information in this electronic mail message is sender's
business Confidential and may be legally privileged. It is
intended solely for the addressee(s). Access to this Internet
electronic mail message by anyone else is unauthorized. If
you are not the intended recipient, any disclosure, copying,
distribution or any action taken or omitted to be taken in
reliance on it is prohibited and may be unlawful. The sender
believes that this E-mail and any attachments were free of
any virus, worm, Trojan horse, and/or malicious code when
sent. This message and its attachments could have been
infected during transmission. By reading the message and
opening any attachments, the recipient accepts full
responsibility for taking protective and remedial action about
viruses and other defects. Travelport Inc. is not liable for any loss
or damage arising in any way from this message or its
attachments.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
