On Wed, 17 Jan 2007, Larry Stone wrote: > This seems like a problem that is better addressed by the filesystem and > backup software, rather than DSpace. On Unix systems, both "dump" > and GNU Tar (http://www.gnu.org/software/tar/) are capable of incremental > backups, copying only the files that have changed since the last backup. > Or rsync, as you've found.
rsync, or indeed anything that needs to traverse a filesystem in order to find out which files have changed, quickly bogs down when the number of files gets too large. Currently we've got 586731 files and directories in our assetstore, and it takes O(hours) just to build the filesystem tree. Dump isn't always an option - not every filesystem has dump, and we run different filesystems on backup and live servers anyway. -- Tom De Mulder <[EMAIL PROTECTED]> - Cambridge University Computing Service +44 1223 3 31843 - New Museums Site, Pembroke Street, Cambridge CB2 3QH -> 22/01/2007 : The Moon is Waxing Crescent (22% of Full) ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ DSpace-tech mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspace-tech
