On Fri, Jan 29, 2010 at 09:23:16AM -0800, Ski Kacoroski spake thusly: > I tried once using rsync and after several days gave up because of so > may files. Perhaps I should try a block level initial replication, then > write some sort of parallel rsync that will do small directories at a > time.
Make sure you use rsync 3. If you have rsync 2 I would download and compile your own latest rsync 3. I had a similar situation (1T of gazillions of tiny files of GIS data) and rsync 2 would choke on it because of so many files. But my new rsync 3 sliced right through it with no problem. -- Tracy Reed http://tracyreed.org
pgpdVrITC8zIf.pgp
Description: PGP signature
_______________________________________________ Tech mailing list [email protected] http://lopsa.org/cgi-bin/mailman/listinfo/tech This list provided by the League of Professional System Administrators http://lopsa.org/
