Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-12-11 Thread r...@open-mpi.org
As you note, there is no correlation between release number and libtool versioning. The comment in VERSION explains the libtool rules and you can see why the two values differ. The PMIx master is at release version 3.0 as it includes new APIs that have not yet been released. The configure

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-12-11 Thread Bennet Fauber
I made a good deal of progress, and I now have OpenMPI 3.0.0 capable of being run. I do have one final point of confusion, however. It appears that --with-pmi= fails because configure is testing for a non-existent major version of PMIx, 3. Perhaps that is the major version of the OMPI

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-29 Thread r...@open-mpi.org
Hi Bennet I suspect the problem here lies in the slurm PMIx plugin. Slurm 17.11 supports PMIx v2.0 as well as (I believe) PMIx v1.2. I’m not sure if slurm is somehow finding one of those on your system and building the plugin or not, but it looks like OMPI is picking up signs of PMIx being

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-18 Thread dani
I might be offbase here, but I think what was implied is that you've built openmpi with --with-pmi without supplying the path that holds pmi2 libs. First build slurm with pmi, then build openmpi with path to pmi so in slurm. That might not provide pmix, but it

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-18 Thread Bennet Fauber
Howard, Thanks for the reply. I think, based on a previous reply, that we may not have the right combinations of pmi and slurm lined up. I will have to coordinate with our admin who compiles and installs slurm, and once we think we have slurm with pmix, I'll try again and post the

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-17 Thread Howard Pritchard
Hello Bennet, What you are trying to do using srun as the job launcher should work. Could you post the contents of /etc/slurm/slurm.conf for your system? Could you also post the output of the following command: ompi_info --all | grep pmix to the mail list. the config.log from your build would

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-16 Thread r...@open-mpi.org
What Charles said was true but not quite complete. We still support the older PMI libraries but you likely have to point us to wherever slurm put them. However,we definitely recommend using PMIx as you will get a faster launch Sent from my iPad > On Nov 16, 2017, at 9:11 AM, Bennet Fauber

Re: [OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-16 Thread Bennet Fauber
Charlie, Thanks a ton! Yes, we are missing two of the three steps. Will report back after we get pmix installed and after we rebuild Slurm. We do have a new enough version of it, at least, so we might have missed the target, but we did at least hit the barn. ;-) On Thu, Nov 16, 2017 at

[OMPI users] OMPI 2.1.2 and SLURM compatibility

2017-11-16 Thread Bennet Fauber
I think that OpenMPI is supposed to support SLURM integration such that srun ./hello-mpi should work? I built OMPI 2.1.2 with export CONFIGURE_FLAGS='--disable-dlopen --enable-shared' export COMPILERS='CC=gcc CXX=g++ FC=gfortran F77=gfortran' CMD="./configure \ --prefix=${PREFIX} \