We have a cluster which is a combination of Myrinet and Infiniband nodes.
We are using a common openmpi 1.8.4 software tree accessible to both set of
nodes.
Our Infiniband nodes do NOT have the libmyriexpress.so library installed (since
it is not needed).
Likewise the Myrinet nodes do not have the OFED libraries installed.
When running an MPI program on the Infiniband node, openmpi in trying to
determine what transport methods are available, tries to load the
libmyriexpress.so, and then complains that it is not found.
I would like to disable this behavior. I had hoped to use the OMPI_MCA_mtl
environment variable to do this.
But I unable to come up with a setting that accomplishes this. That is have
OMPI_MCA_btl set to 'self,sm,openib,tcp' and no MCA mtl checked or used.
For the equivalent problem on our Myrinet cluster I set OMPI_MCA_btl, to
'self,sm,tcp' and OMPI_MCA_mtl to 'mx'
Does anyone know how to disable the MCA mtl at run time, since it's not needed
on the Infiniband nodes?
Thanks in advance.
My apologies if this has been addressed before, I did not find it when
searching the list.
Avalon Johnson
ITS HPCC
USC
"It takes a village ..."