All, I am in the same boat. I'd like to copy ~500 TB from one filesystem to another. Both are being served by the same NSD servers.
We've done the multiple rsync script method in the past (and yes it's a bit of a pain). Would love to have an easier utility. Best, Brian Marshall On Mon, Dec 5, 2016 at 5:26 AM, Heiner Billich <[email protected]> wrote: > Hello, > > I heard about some gpfs optimized bulk(?) copy command named 'mmcp' or > 'mmcopy' but couldn't find it in either /user/lpp/mmfs/samples/ or by > asking google. Can please somebody point me to the source? I wonder whether > it allows incremental copies as rsync does. > > We need to copy a few 100TB of data and simple rsync provides just about > 100MB/s. I know about the possible workarounds - write a wrapper script, > run several rsyncs in parallel, distribute the rsync jobs on several nodes, > use a special rsync versions that knows about gpfs ACLs, ... or try mmfind, > which requires me to write a custom wrapper for cp .... > > I really would prefer some ready-to-use script or program. > > Thank you and kind regards, > Heiner Billich > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss >
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
