So at my last job we used to rsync data between isilons across campus, and 
isilon to Windows File Cluster (and back).

I recommend using dry run to generate a list of files and then use this to run 
with rysnc.

This allows you also to be able to break up the transfer into batches, and 
check if files have changed before sync (say if your isilon files are not RO.

Also ensure you have a recent version of rsync that preserves extended 
attributes and check your ACLS.

 

A dry run example:

https://unix.stackexchange.com/a/261372

 

I always felt more comfortable having a list of files before a sync….

 

 

 

Regards,

Chris Schlipalius

 

Team Lead, Data Storage Infrastructure, Supercomputing Platforms, Pawsey 
Supercomputing Centre (CSIRO)

1 Bryce Avenue

Kensington  WA  6151

Australia

 

Tel  +61 8 6436 8815 

Email  [email protected]

Web  www.pawsey.org.au

 

 

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Reply via email to