Les Mikesell wrote: > Chris Robertson wrote: > >>>> I've heard about hardlinks which can be a problem if theire are millions of >>>> it. Is that true? >>>> >>> The file system can become... interesting to fix or backup when you get >>> a few million hard links, especially if you're using XFS. >>> >> Amen to that... >> > > But note that normal operation of backuppc is fairly efficient, doing > name lookups within a reasonable tree structure even in the common pool. > Only the nightly cleanup has to walk the whole directory, and if that is > a problem you can divide it up so it only does a portion each night. > > >> For comparison, I have a Xeon X3320, 8GB RAM and 16 Seagate ES.2 1 TB >> drives (ST31000340NS) on a Adaptec 51645 using a RAID6 setup >> (effectively 13 data drives, 2 parity, 1 hot spare). Fulls every 7 >> days, incremental every day. I Started off keeping 4 weeks of fulls and >> two weeks of incrementals, and cleaning the whole pool nightly. All >> (~125) backups completed within the 20:00-07:00 time frame and >> BackupPC_nightly finished in under 5 hours (with a concurrence of 8). >> Then I doubled retention on both fulls and incrementals and have been >> fighting steadily worsening performance problems since. Dropping the >> retention back to initial levels is taking a while (BackupPC_trashClean >> seems to finally be gaining some ground). >> > > Since the files are created in one place, then linked to another > directory there isn't much the filesystem can do to optimize access > access and you end up seeking all over the place. >
Hopefully my original message didn't come across as negative of either XFS or BackupPC. Due to how well BackupPC and XFS handled the load I threw at it initially, I expanded the retention policy of my backups without thought, planning or proper research and testing. As a result of this rash behavior, I'm experiencing some teething problems. Chris ------------------------------------------------------------------------------ Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/