Re: [gpfsug-discuss] migrating data from GPFS3.5 to ESS appliance (GPFS4.1)

2016-02-01 Thread Wahl, Edward
ug-discuss@spectrumscale.org Subject: Re: [gpfsug-discuss] migrating data from GPFS3.5 to ESS appliance (GPFS4.1) For what it's worth - there's a patch for rsync which IBM provided a while back that will copy NFSv4 ACLs (maybe other stuff?). I put it up on the gpfsug github here: https://github.

Re: [gpfsug-discuss] migrating data from GPFS3.5 to ESS appliance(GPFS4.1)

2016-01-30 Thread Marc A Kaplan
You may also want to use and/or adapt samples/ilm/tspcp which uses mmapplypolicy to drive parallel cp commands. The script was written by my colleague and manager, but I'm willing to entertain questions and suggestions... Here are some of the comments: # Run "cp" in parallel over a list of

Re: [gpfsug-discuss] migrating data from GPFS3.5 to ESS appliance(GPFS4.1)

2016-01-29 Thread Stijn De Weirdt
we wrapped something base on zookeeper around rsync to be able to use rsync in parallel by splitting the path in subdirectories, and distribute those https://github.com/hpcugent/vsc-zk works really well if the number of files in directories is somewhat balanced. we use it to rsync some gpfs