Re: [slurm-users] Heterogeneous HPC

On Thursday, 19 September 2019, at 19:27:38 (-0400), Fulcomer, Samuel wrote: > I obviously haven't been keeping up with any security concerns over the use > of Singularity. In a 2-3 sentence nutshell, what are they? So before I do that, if you have a few minutes, I do think you'll find it worth

Re: [slurm-users] Heterogeneous HPC

Hey Michael, I obviously haven't been keeping up with any security concerns over the use of Singularity. In a 2-3 sentence nutshell, what are they? I've been annoyed by NVIDIA's docker distribution for DGX-1 & friends. We've been setting up an ersatz-secure SIngularity environment for use of

Re: [slurm-users] Heterogeneous HPC

On Thursday, 19 September 2019, at 20:00:40 (+), Goetz, Patrick G wrote: > On 9/19/19 8:22 AM, Thomas M. Payerle wrote: > > one of our clusters > > is still running RHEL6, and while containers based on Ubuntu 16, > > Debian 8, or RHEL7 all appear to work properly, > > containers based on

Re: [slurm-users] Heterogeneous HPC

On Friday, 20 September 2019, at 00:03:28 (+0430), Mahmood Naderan wrote: > For the replies. Matlab was an example. I would also like to create > to containers for OpenFoam with different versions. Then a user can > choose what he actually wants. All modern container runtimes support the OCI

Re: [slurm-users] Heterogeneous HPC

On 9/19/19 8:22 AM, Thomas M. Payerle wrote: > one of our clusters > is still running RHEL6, and while containers based on Ubuntu 16, > Debian 8, or RHEL7 all appear to work properly, > containers based on Ubuntu 18 or Debian 9 will die with "Kernel too > old" errors. I think the idea generally

Re: [slurm-users] Heterogeneous HPC

Never used Rocks, but as far as Slurm or anything else is concerned, Singularity is just another program. It will need to be accessible from any compute nodes you want to use it on (whether that’s from OS-installed packages, from a shared NFS area, or whatever shouldn’t matter). So your user

Re: [slurm-users] Heterogeneous HPC

For the replies. Matlab was an example. I would also like to create to containers for OpenFoam with different versions. Then a user can choose what he actually wants. I would also like to know, if the technologies you mentioned can be deployed in multinode clusters. Currently, we use Rocks 7.

Re: [slurm-users] Sharing a single machine between two groups; What's the best way define this in slurm config?

Probably your best bet is to use QoS's to accomplish this.  Be advised that suspending jobs still leaves them in memory space. -Paul Edmon- On 9/18/19 9:16 PM, Benjamin Wong wrote: Hello, I plan to purchase a GPU machine with 8 GPUs which will be shared between group A and group B.  Group A

Re: [slurm-users] Heterogeneous HPC

MATLAB container at NVIDIA’s NGC: https://ngc.nvidia.com/catalog/containers/partners:matlab Should be compatible with Docker and Singularity, but read the fine print on licensing. > On Sep 19, 2019, at 8:22 AM, Thomas M. Payerle wrote: > > While I agree containers can be quite useful in HPC

Re: [slurm-users] Heterogeneous HPC

While I agree containers can be quite useful in HPC environments for dealing with applications requiring different library versions, there are limitations. In particular, the kernel inside the container is the same as running outside the container. Where this seems to be most problematic is when

[slurm-users] slurm config :: set up a workdir for each job

Hi! Is there a method for setting up a work directory unique for each job from a system setting? and than clean that up? can i use somehow the prologue and epilogue sections? Thank you! Adrian -- -- Adrian Sevcenco, Ph.D. |

Re: [slurm-users] Heterogeneous HPC

Thanks. Singularity seems to be interesting. I will try it. Regards, Mahmood On Thu, Sep 19, 2019 at 2:49 PM Christoph Brüning < christoph.bruen...@uni-wuerzburg.de> wrote: > Dear Mahmood, > > Docker is somewhat tricky, because it needs a daemon running and there > is no fine grained control

Re: [slurm-users] Heterogeneous HPC

Dear Mahmood, Docker is somewhat tricky, because it needs a daemon running and there is no fine grained control over who is allowed to start and stop containers. Also getting the container on the node can be unpleasant (docker hub? private registry? build docker containers on the node before

Re: [slurm-users] Heterogeneous HPC

Hallo Mahmood, in our current system (which does not run with Slurm) we have deployed the community edition of Singularity as a software module. https://sylabs.io/singularity/ I have no practical experience yet but from what I've read so far, Singularity is also supposed to work quite well

[slurm-users] Heterogeneous HPC

Hi The question is not directly related to Slurm, but is actually related to the people in this community. For heterogeneous environments, where different operating systems, application and library versions are needed for HPC users, I would like to know it using docker/containers is better than