From: Benjamin Smith <li...@benjamindsmith.com> > Thanks for your feedback - it's advice I would have given myself just a > few years ago. We have *literally* in the range of one hundred million > small PDF documents. The simple command > > find /path/to/data > /dev/null > > takes between 1 and 2 days, system load depending. We had to give up on > rsync for backups in this context a while ago - we just couldn't get a > "daily" backup more often then about 2x per week.
What about: 1. Setup inotify (no idea how it would behave with your millions of files) 2. One big rsync 3. Bring it down and copy the few modified files reported by inotify. Or lsyncd? JD _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
