Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-11 Thread Ross, Daniel B. via users
Taylor Sent: Wednesday, October 10, 2018 6:02 PM To: Open MPI Users Cc: Ross, Daniel B. Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm In our config the "--with-pmi" points to the slurm “prefix” dir not the slurm libdir. The options below work for us with SLURM

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Gilles Gouaillardet
I digged a bit the configury logic and found ./configure --prefix=/usr/local/ --with-cuda --with-slurm --with-pmi=/usr/local/slurm should do the trick, if not ./configure --prefix=/usr/local/ --with-cuda --with-slurm --with-pmi=/usr/local/slurm --with-pmi-libdir=/usr/local/slurm/lib64

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Charles A Taylor
In our config the "--with-pmi" points to the slurm “prefix” dir not the slurm libdir. The options below work for us with SLURM installed in “/opt/slurm”. I’ll note that after sharing this config with regard to another issue, it was recommended to drop the “/usr” in the “—with-foo=/usr” options

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ross, Daniel B. via users
find /usr/local/slurm/ -name pmi.h /usr/local/slurm/include/slurm/pmi.h From: users On Behalf Of Bennet Fauber Sent: Wednesday, October 10, 2018 2:19 PM To: users@lists.open-mpi.org Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm Yes, I was just wondering about the

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Bennet Fauber
point it to the slurm pmi directories. > > > -- > *From:* users on behalf of Bennet > Fauber > *Sent:* Wednesday, October 10, 2018 1:14 PM > *To:* users@lists.open-mpi.org > *Subject:* Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ross, Daniel B. via users
This is a slurm build and you point it to the slurm pmi directories. From: users on behalf of Bennet Fauber Sent: Wednesday, October 10, 2018 1:14 PM To: users@lists.open-mpi.org Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm I

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Bennet Fauber
I thought the --with-pmi=/the/dir was meant to point to the top of a traditional FHS installation of PMI; e.g., /opt/pmi with subdirectories for bin, lib, include, man, etc. It looks like this is pointing only to the header file, based on the name. On Wed, Oct 10, 2018 at 11:27 AM Ralph H Castai

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ralph H Castain
mca/ess/hnp mca/ess/pmi > mca/ess/singleton mca/ess/tool mca/ess/slurm' > OPAL_CONFIGURE_CLI=' \'\''--prefix=/usr/local/\'\'' \'\''--with-cuda\'\'' > \'\''--with-slurm\'\'' \'\''-

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ross, Daniel B. via users
LAGS='' opal_pmi1_LIBS='-lpmi' opal_pmi1_rpath='' opal_pmi2_CPPFLAGS='' opal_pmi2_LDFLAGS='' opal_pmi2_LIBS='-lpmi2' opal_pmi2_rpath='' opal_pmix_ext1x_CPPFLAGS='' opal_pmix_ext1x_LDFLAGS='' opal_pmix_ext1x_LIBS='

Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ralph H Castain
It appears that the CPPFLAGS isn’t getting set correctly as the component didn’t find the Slurm PMI-1 header file. Perhaps it would help if we saw the config.log output so we can see where OMPI thought the file was located. > On Oct 10, 2018, at 6:44 AM, Ross, Daniel B. via users > wrote: >

[OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm

2018-10-10 Thread Ross, Daniel B. via users
I have been able to configure without issue using the following options: ./configure --prefix=/usr/local/ --with-cuda --with-slurm --with-pmi=/usr/local/slurm/include/slurm --with-pmi-libdir=/usr/local/slurm/lib64 Everything compiles just fine until I get this error: make[3]: Leaving directory