Re: [slurm-users] Python and R installation in a SLURM cluster

Just for completion. I can recommend using singularity /docker containers. You can copy them to the worker nodes during sbatch. In the long run it eases up a lot. Viele Grüße / kind regards Georg 2018-05-10 17:48 GMT+02:00 Simon Flood : >

Re: [slurm-users] Python and R installation in a SLURM cluster

Completely as an aside, the next question then is 'Aha - but what happens when you have new users on the cluster' I am currently working with sssd authentication and with the pam_mkhomedir plugin. I guess if an MPI job is launched using ssh then pam_mkhomedir would automatically create the home

Re: [slurm-users] Python and R installation in a SLURM cluster

Well I DID say that you need 'what looks like a home directory'. So yes indeed you prove, correctly, that this works just fine! On 12 May 2018 at 20:17, Eric F. Alemany wrote: > > Hi John, > > No worries at all. I take all ideas, comments and advice with the greatest >

Re: [slurm-users] Python and R installation in a SLURM cluster

Hi, Home directory are also shared among all nodes (and head one as well). The base system (that is, local drive, including os, system files, etc) are identical and cloned based among all the hosts. If I need to install some light package (dev version of a library for example or similar) I

Re: [slurm-users] Python and R installation in a SLURM cluster

._ Eric F. Alemany System Administrator for Research Division of Radiation & Cancer Biology Department of Radiation Oncology Stanford University School of Medicine Stanford, California 94305

Re: [slurm-users] Python and R installation in a SLURM cluster

Eric, I'm sorry to be a little prickly here. Each node has an independent home directory for the user? How then do applications update dot files? How then would as a for instance do the users edit the .bashrc file to bring Anaconda into their paths? Beofre anyone says it, a proper Modules system

Re: [slurm-users] Python and R installation in a SLURM cluster

HI Miguel, Thank you for your comment. That sounds pretty straight forward. you never had issues with programs relying on the system files or relying on the home directory location? Thanks Eric _

Re: [slurm-users] Python and R installation in a SLURM cluster

Thank you Thomas for your suggestion. I take note of all the people’s comment and hope to come with a good solution. _ Eric F. Alemany System Administrator for Research Division of Radiation &

Re: [slurm-users] Python and R installation in a SLURM cluster

On 11 May 2018 at 01:35, Eric F. Alemany wrote: > Hi All, > > I know this might sounds as a very basic question: where in the cluster > should I install Python and R? > Headnode? > Execute nodes ? > > And is there a particular directory (path) I need to install Python and

Re: [slurm-users] Python and R installation in a SLURM cluster

Hi Eric, On 10/05/18 23:35, Eric F. Alemany wrote: > I know this might sounds as a very basic question: where in > the cluster should I install Python and R? > Headnode? > Execute nodes ? I don't think there is a fixed rule for a question like this and it depends on the compromise between

[slurm-users] Python and R installation in a SLURM cluster

Hi All, I know this might sounds as a very basic question: where in the cluster should I install Python and R? Headnode? Execute nodes ? And is there a particular directory (path) I need to install Python and R. Background: SLURM on Ubuntu 18.04 1 headnode 4 execute nodes NFS shared drive