If it worked well for a while and is now seemingly taking
exponentially long to finish, I'd make sure you're not swapping
excessively.  A directory of mail probably has a much larger ratio of
files to bytes than other places in your filesystem, so just saying
"there's not much data there" may misdiagnose the problem.

Since you're (presumably) asking rsync to transfer a large number of
files, rsync must hold information about all of them in its address
space while it runs, and it's possible that you've crossed some magic
threshold (as the number of users has grown) that is causing rsync not
to fit in physical memory after it's built that data structure.  If
that's true, you're going to run very, very slowly as all those pages
get thrashed onto and off of the disk again.

[And if you have dirvish passing -H to rsync, this is even more likely
(especially with older rsync versions)---and isn't fully fixed even in
the most-recent rsync release (since -H makes it hard for rsync to
know when it can forget about already-transferred directories if
there's a possibility of a hardlink in there somewhere).]
_______________________________________________
Dirvish mailing list
Dirvish@dirvish.org
http://www.dirvish.org/mailman/listinfo/dirvish

Reply via email to