Re: [OMPI users] Help Getting Started with Open MPI and PMIx and UCX

2019-01-22 Thread Matt Thompson
Well, By turning off UCX compilation per Howard, things get a bit better in that something happens! It's not a good something, as it seems to die with an infiniband error. As this is an Omnipath system, is OpenMPI perhaps seeing libverbs somewhere and compiling it in? To wit: (1006)(master) $

Re: [OMPI users] How to enable vprotocol + pessimistic message logging?

2019-01-22 Thread Aurelien Bouteiller
Hey Kiril, Indeed, the pessimist message logging does not support threaded accesses. That test is however overly cautious if you are initializing as multiple but then do not perform concurrent accesses. Please verify that he NBP3.3 do MPI_INIT_THREADS(MPI_THREAD_SINGLE), as doing other

[OMPI users] How to enable vprotocol + pessimistic message logging?

2019-01-22 Thread Kiril Dichev
Hi, I’m doing some research on message logging protocols. It seems that Vprotocol in Open MPI can wrap around communication calls and log messages, if enabled. Unfortunately, when I try to use it with Open MPI- 4.0.0, I get an error: mpirun --mca vprotocol pessimist-mca

Re: [OMPI users] Help Getting Started with Open MPI and PMIx and UCX

2019-01-22 Thread Cabral, Matias A
Hi Matt, There seem to be two different issues here: a) The warning message comes from the openib btl. Given that Omnipath has verbs API and you have the necessary libraries in your system, openib btl finds itself as a potential transport and prints the warning during its init (openib