We do run Singularity + GPFS, on our production HPC clusters.
Most of the time things are fine without any issues.

However, i do see a significant performance loss when running some applications 
on singularity containers with GPFS.

As of now, the applications that have severe performance issues with 
singularity on GPFS - seem to be because of “mmap io”. (Deep learning 
applications)
When i run the same application on bare metal, they seem to have a huge 
difference in GPFS IO when compared to running on singularity containers.
I am yet to raise a PMR about this with IBM.
I have not seen performance degradation for any other kind of IO, but i am not 
sure.

Regards,
Lohit

On Apr 26, 2018, 10:35 AM -0400, Nathan Harper <[email protected]>, 
wrote:
> We are running on a test system at the moment, and haven't run into any 
> issues yet, but so far it's only been 'hello world' and running FIO.
>
> I'm interested to hear about experience with MPI-IO within Singularity.
>
> > On 26 April 2018 at 15:20, Oesterlin, Robert <[email protected]> 
> > wrote:
> > > Anyone (including IBM) doing any work in this area? I would appreciate 
> > > hearing from you.
> > >
> > > Bob Oesterlin
> > > Sr Principal Storage Engineer, Nuance
> > >
> > >
> > > _______________________________________________
> > > gpfsug-discuss mailing list
> > > gpfsug-discuss at spectrumscale.org
> > > http://gpfsug.org/mailman/listinfo/gpfsug-discuss
> > >
>
>
>
> --
> Nathan Harper // IT Systems Lead
>
>
> e: [email protected]   t: 0117 906 1104  m:  0787 551 0891  w: 
> www.cfms.org.uk
> CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent // 
> Emersons Green // Bristol // BS16 7FR
>
> CFMS Services Ltd is registered in England and Wales No 05742022 - a 
> subsidiary of CFMS Ltd
> CFMS Services Ltd registered office // 43 Queens Square // Bristol // BS1 4QP
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Reply via email to