On 18/06/15 00:38, Wiegand, Paul wrote:
> We have just started experimenting with Slurm, and I'm having trouble
> running OpenMPI jobs over Slurm.
In case it helps Slurm here is configured with:
./configure --prefix=/usr/local/slurm/${slurm_ver}
--sysconfdir=/usr/local/slurm/etc
Open-MPI (1.6.x) is configured with:
./configure --prefix=/usr/local/${BASE} --with-slurm --with-openib
--enable-static --enable-shared
Our test build of 1.8.4 (using a different build strategy
to separate out GCC and Intel builds to avoid the annoying
incompatibility of Fortran MOD files for our one user who
ran into it) is configured with:
configure --prefix=/usr/local/openmpi-${COMPILER}/${VERSION} --with-slurm
--with-verbs --enable-static --enable-shared --without-scif
--with-pmi=/usr/local/slurm/latest
Note that /usr/local/slurm/latest is a symlink to whatever
/usr/local/slurm/${slurm_ver} is the current version we're
running (currently 14.03.11).
You will need to fix up your resource limit settings for
maximum lockable memory too, but that shouldn't cause the
issue you're seeing.
Best of luck!
Chris
--
Christopher Samuel Senior Systems Administrator
VLSCI - Victorian Life Sciences Computation Initiative
Email: [email protected] Phone: +61 (0)3 903 55545
http://www.vlsci.org.au/ http://twitter.com/vlsci
