Fwd: rsync ingest to new storage environment

2017-10-18 Thread Herb Burnswell via rsync
> If rsync isn't doing the networking you are better off with cp -au > instead of rsync. It should be significantly faster and you can do a > final pass with rsync to get any files that got truncated by a ^C (cp > can only skip files that are newer not files that are not different and > a

Re: rsync ingest to new storage environment

2017-10-18 Thread Kevin Korb via rsync
If rsync isn't doing the networking you are better off with cp -au instead of rsync. It should be significantly faster and you can do a final pass with rsync to get any files that got truncated by a ^C (cp can only skip files that are newer not files that are not different and a truncated file

rsync ingest to new storage environment

2017-10-18 Thread Herb Burnswell via rsync
All, I am seeding a new storage environment (Glusterfs on XFS) and would like to gather advise on best practices. This data is primarily all media data, so not good with compression. I currently have made one pass on at 20TB directory tree into the environment as: - nfs mount from old storage