Hello Gilles, Here are some details:
Slurm 18.08.4 PMIx 2.2.1 (as shown in /usr/include/pmix_version.h) Libevent 2.0.21 srun --mpi=list srun: MPI types are... srun: none srun: openmpi srun: pmi2 srun: pmix srun: pmix_v2 Open MPI versions tested: 4.0.0 and 3.1.2 For each installation to be mentioned a different MPI Hello World program was compiled. Jobs were submitted by sbatch, 2 node * 2 tasks per node then srun --mpi=pmix program File 400ext_2x2.out (attached) is for OMPI 4.0.0 installation with configure options: --with-slurm --with-pmix=/usr --with-pmi=/usr --with-libevent=/usr and configure log: Libevent support: external PMIx support: External (2x) File 400int_2x2.out (attached) is for OMPI 4.0.0 installation with configure options: --with-slurm --with-pmix and configure log: Libevent support: internal (external libevent version is less that internal version 2.0.22) PMIx support: Internal Tested also different installations for 3.1.2 and got errors similar to 400ext_2x2.out (NOT-SUPPORTED in file event/pmix_event_registration.c at line 101) All the best, -- Passant A. Hafez | HPC Applications Specialist KAUST Supercomputing Core Laboratory (KSL) King Abdullah University of Science and Technology Building 1, Al-Khawarizmi, Room 0123 Mobile : +966 (0) 55-247-9568 Mobile : +20 (0) 106-146-9644 Office : +966 (0) 12-808-0367 ________________________________________ From: users <users-boun...@lists.open-mpi.org> on behalf of Gilles Gouaillardet <gilles.gouaillar...@gmail.com> Sent: Saturday, February 23, 2019 5:17 PM To: Open MPI Users Subject: Re: [OMPI users] Building PMIx and Slurm support Hi, PMIx has cross-version compatibility, so as long as the PMIx library used by SLURM is compatible with the one (internal or external) used by Open MPI, you should be fine. If you want to minimize the risk of cross-version incompatibility, then I encourage you to use the same (and hence external) PMIx that was used to build SLURM with Open MPI. Can you tell a bit more than "it didn't work" ? (Open MPI version, PMIx version used by SLURM, PMIx version used by Open MPI, error message, ...) Cheers, Gilles On Sat, Feb 23, 2019 at 9:46 PM Passant A. Hafez <passant.ha...@kaust.edu.sa> wrote: > > > Good day everyone, > > I've trying to build and use the PMIx support for Open MPI but I tried many > things that I can list if needed, but with no luck. > I was able to test the PMIx client but when I used OMPI specifying srun > --mpi=pmix it didn't work. > > So if you please advise me with the versions of each PMIx and Open MPI that > should be working well with Slurm 18.08, it'd be great. > > Also, what is the difference between using internal vs external PMIx > installations? > > > > All the best, > > -- > > Passant A. Hafez | HPC Applications Specialist > KAUST Supercomputing Core Laboratory (KSL) > King Abdullah University of Science and Technology > Building 1, Al-Khawarizmi, Room 0123 > Mobile : +966 (0) 55-247-9568 > Mobile : +20 (0) 106-146-9644 > Office : +966 (0) 12-808-0367 > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users _______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
400ext_2x2.out
Description: 400ext_2x2.out
400int_2x2.out
Description: 400int_2x2.out
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
