Hey,
We have a cluster with infiniband, and openmpi working happily.
We've just added some new nodes, with no ib. The scheduler has been told to
only schedule jobs onto those nodes, which don't span nodes. Easy.
Except that openmpi warns the user that no openib was found, and it's dropping
back to another transport (possibly at a penalty).
This is no problem to me, but it worries our users for no reason.
My plan was to put some local openmpi mca config files on those nodes that only
allow sm,self,tcp which (I'd hope) would eliminate the warning that it can't
use openib. However our openmpi installs are to a global fs.
Is it possible to put a line in the global
$SYSCONFDIR/etc/openmpi-mca-params.conf to tell it to also include a subsequent
/etc/openmpi-mca-params.conf
Any better ways of handling this would also be appreciated.
cheers,
/ Brett
--
Brett Pemberton - VPAC Senior Systems Administrator
http://www.vpac.org/ - (03) 9925 4899
