On Thu, 20 Sep 2018 14:18:35 +0200 Peter Kjellström <c...@nsc.liu.se> wrote:
> On Wed, 19 Sep 2018 16:24:53 +0000 > "Gabriel, Edgar" <egabr...@central.uh.edu> wrote: ... > > So bottom line, if I do > > > > mpirun –mca btl^openib –mca mtl^ofi …. > > > > my tests finish correctly, although mpirun will still return an > > error. > > I get some things to work with this approach (two ranks on two nodes > for example). But a lot of things crash rahter hard: > > $ mpirun -mca btl ^openib -mca mtl > ^ofi ./openmpi-4.0.0rc1/imb.openmpi-4.0.0rc1 Turns out I had an ofi BTL too.. Disabling this gets me stable imb at 128 ranks. That is this works for me: mpirun -mca btl ^openib,ofi -mca mtl ^ofi ./imb /Peter K _______________________________________________ devel mailing list devel@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/devel