Re: [OMPI users] Openmpi-3.1.0 + slurm (fixed)

2018-05-08 Thread r...@open-mpi.org
Good news - thanks! > On May 8, 2018, at 7:02 PM, Bill Broadley wrote: > > > Sorry all, > > Chris S over on the slurm list spotted it right away. I didn't have the > MpiDefault set to pmix_v2. > > I can confirm that Ubuntu 18.04, gcc-7.3, openmpi-3.1.0, pmix-2.1.1, and

Re: [OMPI users] Openmpi-3.1.0 + slurm (fixed)

2018-05-08 Thread Bill Broadley
Sorry all, Chris S over on the slurm list spotted it right away. I didn't have the MpiDefault set to pmix_v2. I can confirm that Ubuntu 18.04, gcc-7.3, openmpi-3.1.0, pmix-2.1.1, and slurm-17.11.5 seem to work well together. Sorry for the bother.

[OMPI users] Openmpi-3.1.0 + slurm?

2018-05-08 Thread Bill Broadley
I have openmpi-3.0.1, pmix-1.2.4, and slurm-17.11.5 working well on a few clusters. For things like: bill@headnode:~/src/relay$ srun -N 2 -n 2 -t 1 ./relay 1 c7-18 c7-19 size= 1, 16384 hops, 2 nodes in 0.03 sec ( 2.00 us/hop) 1953 KB/sec I've been having a tougher time trying to get

Re: [OMPI users] MPI-3 RMA on Cray XC40

2018-05-08 Thread Nathan Hjelm
Looks like it doesn't fail with master so at some point I fixed this bug. The current plan is to bring all the master changes into v3.1.1. This includes a number of bug fixes. -Nathan On May 08, 2018, at 08:25 AM, Joseph Schuchart wrote: Nathan, Thanks for looking into

Re: [OMPI users] MPI-3 RMA on Cray XC40

2018-05-08 Thread Joseph Schuchart
Nathan, Thanks for looking into that. My test program is attached. Best Joseph On 05/08/2018 02:56 PM, Nathan Hjelm wrote: I will take a look today. Can you send me your test program? -Nathan On May 8, 2018, at 2:49 AM, Joseph Schuchart wrote: All, I have been

Re: [OMPI users] MPI-3 RMA on Cray XC40

2018-05-08 Thread Nathan Hjelm
I will take a look today. Can you send me your test program? -Nathan > On May 8, 2018, at 2:49 AM, Joseph Schuchart wrote: > > All, > > I have been experimenting with using Open MPI 3.1.0 on our Cray XC40 > (Haswell-based nodes, Aries interconnect) for multi-threaded MPI