Re: [OMPI users] Wrong distance calculations in multi-rail setup?

2015-08-28 Thread Rolf vandeVaart
, Rolf >-Original Message- >From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Marcin >Krotkiewski >Sent: Friday, August 28, 2015 12:13 PM >To: Open MPI Users >Subject: Re: [OMPI users] Wrong distance calculations in multi-rail setup? > > >Brilliant!

Re: [OMPI users] Wrong distance calculations in multi-rail setup?

2015-08-28 Thread Marcin Krotkiewski
[mailto:users-boun...@open-mpi.org] On Behalf Of marcin.krotkiewski Sent: Friday, August 28, 2015 10:49 AM To: us...@open-mpi.org Subject: [OMPI users] Wrong distance calculations in multi-rail setup? I have a 4-socket machine with two dual-port Infiniband cards (devices mlx4_0 and mlx4_1). The cards

Re: [OMPI users] Wrong distance calculations in multi-rail setup?

2015-08-28 Thread Rolf vandeVaart
;To: us...@open-mpi.org >Subject: [OMPI users] Wrong distance calculations in multi-rail setup? > >I have a 4-socket machine with two dual-port Infiniband cards (devices >mlx4_0 and mlx4_1). The cards are conneted to PCI slots of different CPUs (I >hope..), both ports are active on bo

[OMPI users] Wrong distance calculations in multi-rail setup?

2015-08-28 Thread marcin.krotkiewski
I have a 4-socket machine with two dual-port Infiniband cards (devices mlx4_0 and mlx4_1). The cards are conneted to PCI slots of different CPUs (I hope..), both ports are active on both cards, everything connected to the same physical network. I use openmpi-1.10.0 and run the IBM-MPI1