[slurm-dev] Re: RLIMIT_DATA effectively a no-op on Linux

2013-07-23 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 22/07/13 18:34, Janne Blomqvist wrote: From a recent message by yours truly to a slurm-dev thread about slurmctld memory consumption: Ahh, thanks! Of course the reason we've not run into that yet is that our existing (Torque) x86 clusters

[slurm-dev] Re: Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-07-23 Thread Ralph Castain
On Jul 23, 2013, at 9:59 AM, Tim Wickberg wickb...@gwu.edu wrote: I'm assuming the jobs are running across multiple nodes, using MPI for communication? I'm guessing that srun is resulting in communication going across a GigE fabric rather than IB, where mpirun directly is using the IB. A

[slurm-dev] SLURM 2.5.7 + GPUs

2013-07-23 Thread Taras Shapovalov
Hi all, We have a SLURM cluster with 2 gpus per node. There are two quite interesting issues. I am sending the both issues in a single email, because I guess they are linked somehow. ISSUE 1: When CR_CORE_DEFAULT_DIST_BLOCK is set and gres:gpu=1 is requested by user, then slurmctld dies with

[slurm-dev] Re: running slurm simulator

2013-07-23 Thread Akhil langer
I followed all the instructions of getting started with the slurm simulator on a new Ubuntu VM. Everytihng seems fine. But when I run ./exec_sim.pl SIM_DIR 100, I get the following errors in the slurmctld.log file: slurmctld: error: unable to open pidfile /var/run/slurmctld.pid: Permission denied

[slurm-dev] Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-07-23 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/07/13 19:34, Joshua Ladd wrote: Hi, Chris Hi Joshua, I've quoted you in full as I don't think your message made it through to the slurm-dev list (at least I've not received it from there yet). Funny you should mention this now. We