[OMPI users] openib and mpirun under flux

2022-08-24 Thread Nathan Hanford via users
Hello, I am having 2 (possibly unrelated) issues attempting to run Open MPI under the Flux scheduler. First, attempting to run the legacy launcher mpirun under a Flux allocation (flux mini alloc -N 1): the command mpirun -N 2 hostname returns mpirun: Error: unknown option "-N" in fact, just runn

[OMPI users] ucx problems

2022-08-24 Thread Bernstein, Noam CIV USN NRL (6393) Washington DC (USA) via users
Hi all - I'm trying to get openmpi with ucx working on a new Rocky Linux 8 + OpenHPC machine. I'm used to running with mpirun --mca pml ucx --mca osc ucx --mca btl ^vader,tcp,openib --bind-to core --map-by core --rank-by core However, now it complains that it can't start the pml, with the message

Re: [OMPI users] ucx problems

2022-08-24 Thread Bernstein, Noam CIV USN NRL (6393) Washington DC (USA) via users
Here is more information with higher verbosity: > mpirun -np 2 --mca pml ucx --mca osc ucx --bind-to core --map-by core > --rank-by core --mca pml_ucx_verbose 100 --mca osx_ucxv_erbose 100 --mca > bml_base_verbose 100 mpi_executable [tin2:1137672] mca: base: components_register: registering fram