Re: [OMPI users] OpenMPI slowdown in latency bound application

Peter, It looks like: Node0: rank0, rank1, rank2, etc.. Node1: rank12, rank13, etc etc So the mapping looks good to me. Thanks, Cooper Cooper Burns Senior Research Engineer

Re: [OMPI users] OpenMPI slowdown in latency bound application

wrote: > On Tue, 27 Aug 2019 14:36:54 -0500 > Cooper Burns via users wrote: > > > Hello all, > > > > I have been doing some MPI benchmarking on an Infiniband cluster. > > > > Specs are: > > 12 cores/node > > 2.9ghz/core > > Infiniband i

Re: [OMPI users] OpenMPI slowdown in latency bound application

ture> On Wed, Aug 28, 2019 at 5:54 PM Nathan Hjelm wrote: > Is this overall runtime or solve time? The former is essentially > meaningless as it includes all the startup time (launch, connections, etc). > Especially since we are talking about seconds here. > > -Nathan >

[OMPI users] OpenMPI slowdown in latency bound application

Hello all, I have been doing some MPI benchmarking on an Infiniband cluster. Specs are: 12 cores/node 2.9ghz/core Infiniband interconnect (TCP also available) Some runtime numbers: 192 cores total: (16 nodes) IntelMPI: 0.4 seconds OpenMPI 3.1.3 (--mca btl ^tcp): 2.5 seconds OpenMPI 3.1.3 (--mca