Re: [OMPI users] segfault in libibverbs.so

2020-07-27 Thread Gilles Gouaillardet via users
Prentice, ibverbs might be used by UCX (either pml/ucx or btl/uct), so to be 100% sure, you should mpirun --mca pml ob1 --mca btl ^openib,uct ... in order to force btl/tcp, you need to ensure pml/ob1 is used, and then you always need the btl/self component mpirun --mca pml ob1 --mca btl

Re: [OMPI users] segfault in libibverbs.so

2020-07-27 Thread Reuti via users
Am 27.07.2020 um 21:18 schrieb Prentice Bisbal via users: > Can anyone explain why my job still calls libibverbs when I run it with '-mca > btl ^openib'? A similar behavior I observed too in a mixed cluster where some nodes have InfiniBand and others not. Even checking the node beforehand

Re: [OMPI users] segfault in libibverbs.so

2020-07-27 Thread Prentice Bisbal via users
Can anyone explain why my job still calls libibverbs when I run it with '-mca btl ^openib'? If I instead use '-mca btl tcp', my jobs don't segfault. I would assum 'mca btl ^openib' and '-mca btl tcp' to essentially be equivalent, but there's obviously a difference in the two. Prentice On

Re: [OMPI users] Moving an installation

2020-07-27 Thread Lana Deere via users
On Fri, Jul 24, 2020 at 2:00 PM Reuti wrote: > There is OPAL_PREFIX to be set: > https://www.open-mpi.org/faq/?category=building#installdirs > Thanks. I will experiment with the OPAL_PREFIX. .. Lana (lana.de...@gmail.com)