[slurm-dev] Re: Per-job tmp directories and namespaces

We don’t use cgroups with our SLURM at this time, though we have some ongoing investigations in that direction. There’s probably a way to get both plugins to cooperate. Best, Bill. -- Bill Barth, Ph.D., Director, HPC bba...@tacc.utexas.edu| Phone: (512) 232-7069 Office: ROC 1.435

[slurm-dev] Re: Per-job tmp directories and namespaces

On Thu, Aug 10, 2017 at 10:31 AM, Kilian Cavalotti wrote: > Do you use cgroups in your Slurm setup with pam_systemd on nodes? And > if so, did you notice any issue with cgroups? For what it's worth, I just checked again with Slurm 17.02 and CentOS 7.3, and can

[slurm-dev] Re: Per-job tmp directories and namespaces

Hi Bill, On Thu, Aug 10, 2017 at 5:33 AM, Bill Barth wrote: > If you add the same line from /etc/pam.d/system-auth (or your OS’s > equivalent) to /etc/pam.d/slurm, then srun- and sbatch-initiated shells and > processes will also have the directory properly set up.

[slurm-dev] Re: Per-job tmp directories and namespaces

Fortunately, once we figured out what systemd was doing, we didn’t need to interact with it besides adding its PAM module configuration line to slurm’s PAM config file. Best, Bill. -- Bill Barth, Ph.D., Director, HPC bba...@tacc.utexas.edu| Phone: (512) 232-7069 Office: ROC 1.435

[slurm-dev] Re: Per-job tmp directories and namespaces

Bill, thankyou very much for that. I guess I have to get my systemd hat on. A hat which is very large and composed of many parts, and indeed functions as a pair of pants too. On 10 August 2017 at 14:33, Bill Barth wrote: > If you use a modern enough OS (RHEL/CentOS 7,

[slurm-dev] Re: Per-job tmp directories and namespaces

If you use a modern enough OS (RHEL/CentOS 7, etc), XDG_RUNTIME_DIR will probably be set and mounted (it’s a tmpfs with a limited max size mounted, per-session, under /run/user/) on your login nodes, any node that environment propagates to (like the first compute node of a job), and anywhere

[slurm-dev] Re: Per-job tmp directories and namespaces

Fokke, thankyou very much for the response. On 10 August 2017 at 10:07, Fokke Dijkstra wrote: > We use the spank-private-tmp plugin developed at HPC2N in Sweden: > https://github.com/hpc2n/spank-private-tmp > > See also: https://slurm.schedmd.com/SUG14/private_tmp.pdf > for

[slurm-dev] Re: Per-job tmp directories and namespaces

We use the spank-private-tmp plugin developed at HPC2N in Sweden: https://github.com/hpc2n/spank-private-tmp See also: https://slurm.schedmd.com/SUG14/private_tmp.pdf for a presentation about the plugin. 2017-08-10 9:31 GMT+02:00 John Hearns : > I am sure someone