Re: [gpfsug-discuss] Exporting remote GPFS mounts on a non-ces SMB share

2019-03-08 Thread Christof Schmitt
Hi,   a few comments from my side:   The Samba build that we ship with CES basically has the same capabilities as another Samba. The authentication options exposed through the CLI are limited as those as the configurations we explicitly test and support and that cover the usual usecases. The main

Re: [gpfsug-discuss] Follow-up: migrating billions of files

2019-03-08 Thread valleru
Thank you Marc. I was just trying to suggest another approach to this email thread. However i believe, we cannot run mmfind/mmapplypolicy with remote filesystems and can only be run on the owning cluster? In our clusters - All the gpfs clients are generally in there own compute clusters and

Re: [gpfsug-discuss] Exporting remote GPFS mounts on a non-ces SMB share

2019-03-08 Thread valleru
Well, reading the user-defined authentication documentation again. It is basically left to sysadmins to deal with authentication and it looks like it would not be so much of a hack, to customize smb on CES nodes according to our needs. I will see if i could do this without much trouble.

Re: [gpfsug-discuss] suggestions for copying one GPFS file system into another

2019-03-08 Thread Jez Tucker
Hi   I feel as an 'other products do exist' I should also mention Ngenea and APSync which could meet the technical requirements of these use cases. Ngenea allows you to bring data in from 'cloud' and also of interest in this specific use case, POSIX filesystems or filer islands.  You can

Re: [gpfsug-discuss] Follow-up: migrating billions of files

2019-03-08 Thread valleru
I had to do this twice too. Once i had to copy a 4 PB filesystem as fast as possible when NSD disk descriptors were corrupted and shutting down GPFS would have led to me loosing those files forever, and the other was a regular maintenance but had to copy similar data in less time. In both the

Re: [gpfsug-discuss] Follow-up: migrating billions of files

2019-03-08 Thread William Abbott
We had a similar situation and ended up using parsyncfp, which generates multiple parallel rsyncs based on file lists. If they're on the same IB fabric (as ours were) you can use that instead of ethernet, and it worked pretty well. One caveat is that you need to follow the parallel transfers

[gpfsug-discuss] US Spring User Group Meeting update - April 16-17th, NCAR Boulder Co

2019-03-08 Thread Oesterlin, Robert
Less than 6 weeks until the US Spring user group meeting! Thanks to the team at NCAR and IBM, we have an excellent facility and we’ll be able to offer breakfast, lunch, and evening social event on site. All at no charge to attendees. Detailed agenda coming soon. Register here: