Re: [gpfsug-discuss] cpu shielding

2016-03-02 Thread Simon Thompson (Research Computing - IT Services)
Vaguely related, we used to see the out of memory killer regularly go for mmfsd, which should kill user process and pbs_mom which ran from gpfs. We modified the gpfs init script to set the score for mmfsd for oom to help prevent this. (we also modified it to wait for ib to come up as well,

Re: [gpfsug-discuss] cpu shielding

2016-03-02 Thread Bryan Banister
We do use cgroups to isolate user applications into a separate cgroup which provides some headroom of CPU and memory resources for the rest of the system services including GPFS and its required components such SSH, etc. -B -Original Message- From:

Re: [gpfsug-discuss] AFM over NFS vs GPFS

2016-03-02 Thread Dean Hildebrand
Hi Luke, Assuming the network between your clusters is reliable, using GPFS with SW-mode (also assuming you aren't ever modifying the data on the home cluster) should work well for you I think. New files can continue to be created in the cache even in unmounted state Dean IBM Almaden

Re: [gpfsug-discuss] AFM over NFS vs GPFS

2016-03-02 Thread Dean Hildebrand
Hi Luke, Assuming the network between your clusters is reliable, using GPFS with SW-mode (also assuming you aren't ever modifying the data on the home cluster) should work well for you I think. New files can continue to be created in the cache even in unmounted state Dean IBM Almaden

Re: [gpfsug-discuss] AFM over NFS vs GPFS

2016-03-02 Thread Luke Raimbach
Anybody know the answer? > HI All, > > We have two clusters and are using AFM between them to compartmentalise > performance. We have the opportunity to run AFM over GPFS protocol (over IB > verbs), which I would imagine gives much greater performance than trying to > push it over NFS over

Re: [gpfsug-discuss] IBM-Sandisk Announcement

2016-03-02 Thread Sven Oehme
its direct SAS attached . -- Sven Oehme Scalable Storage Research email: oeh...@us.ibm.com Phone: +1 (408) 824-8904 IBM Almaden Research Lab -- From: "Simon Thompson (Research Computing - IT Services)"

[gpfsug-discuss] GPFS vs Spectrum Scale

2016-03-02 Thread Simon Thompson (Research Computing - IT Services)
I had a slightly strange discussion with IBM this morning... We typically buy OEM GPFS with out tin. The discussion went along the lines that spectrum scale is different somehow from gpfs via the oem route. Is this just a marketing thing? Red herring? Or is there something more to this? Thanks

Re: [gpfsug-discuss] IBM-Sandisk Announcement

2016-03-02 Thread Simon Thompson (Research Computing - IT Services)
There's a bit more at: http://www.theregister.co.uk/2016/03/02/ibm_adds_sandisk_flash_colour_to_its_storage_spectrum/ When I looks as infiniflash briefly it appeared to be ip presented, so guess something like and Linux based system in the "controller". So I guess they have installed gpfs in

[gpfsug-discuss] IBM-Sandisk Announcement

2016-03-02 Thread Oesterlin, Robert
Anyone from the IBM side that can comment on this in more detail? (OK if you email me directly) Article is thin on exactly what’s being announced. SanDisk Corporation, a global leader in flash storage solutions, and IBM today announced a collaboration to bring out a unique class of