Re: [OMPI users] PMIx + OpenMPI

2017-08-07 Thread Charles A Taylor
Many thanks to all who replied and especially to Artem Polyakov of Mellanox who provided a slurm-15.08.13 specific pmix patch. That patch applied and built cleanly against the 15.08.13 tarball and better yet, it works. Regards, Charles A. Taylor UF Research Computing > On Aug 6, 2017, at

Re: [OMPI users] PMIx + OpenMPI

2017-08-06 Thread dani
This is just a guess but - is it possible after building slurm against PMIx, you should build openmpi against SLURM's PMIx instead of directly using external? I would assume slurm's PMI server now "knows" PMIx. On 06/08//2017 16:14, Charles A Taylor

Re: [OMPI users] PMIx + OpenMPI

2017-08-06 Thread Charles A Taylor
HI Gilles, I tried both “—with-pmix=/opt/pmix” and “—with-pmix=internal” and got the same “UNREACHABLE” error both ways. I tried the “external” first since that is what SLURM was built against. I’m missing something simple/basic - just not sure what it is. Thanks, Charlie > On Aug 6,

Re: [OMPI users] PMIx + OpenMPI

2017-08-06 Thread Gilles Gouaillardet
Charles, did you build Open MPI with the external PMIx ? iirc, Open MPI 2.0.x does not support cross version PMIx Cheers, Gilles On Sun, Aug 6, 2017 at 7:59 PM, Charles A Taylor wrote: > >> On Aug 6, 2017, at 6:53 AM, Charles A Taylor wrote: >> >> >> Anyone

Re: [OMPI users] PMIx + OpenMPI

2017-08-06 Thread Charles A Taylor
> On Aug 6, 2017, at 6:53 AM, Charles A Taylor wrote: > > > Anyone successfully using PMIx with OpenMPI and SLURM? I have, > > 1. Installed an “external” version (1.1.5) of PMIx. > 2. Patched SLURM 15.08.13 with the SchedMD-provided PMIx patch (results in an > mpi_pmix