The permissions were incorrect! For our old installation of OMPI 1.10.6 it didn’t complain which is strange.
Thanks for the help. Dean > On 2 Jul 2020, at 11:01, Peter Kjellström <c...@nsc.liu.se> wrote: > > On Thu, 2 Jul 2020 08:38:51 +0000 > "CHESTER, DEAN \(PGR\) via users" <users@lists.open-mpi.org> wrote: > >> I tried this again and it resulted in the same error: >> nymph3.29935PSM can't open /dev/ipath for reading and writing (err=23) >> nymph3.29937PSM can't open /dev/ipath for reading and writing (err=23) >> nymph3.29936PSM can't open /dev/ipath for reading and writing (err=23) >> -------------------------------------------------------------------------- >> PSM was unable to open an endpoint. Please make sure that the network >> link is active on the node and the hardware is functioning. >> >> Error: Failure in initializing endpoint >> ————————————————————————————————————— >> >> The link is up according to ibstat: >> CA 'qib0' >> CA type: InfiniPath_QLE7340 > ... >> Port 1: >> State: Active >> Physical state: LinkUp >> Rate: 40 > ... >> >> Any other ideas? > > Does anything psm-related work? > > Do you have the correct permissions on /dev/ipath*? Here are mine: > > # ls -ltr /dev/ipath* > crw------- 1 root root 244, 128 Jun 4 12:20 /dev/ipath_diagpkt > crw------- 1 root root 244, 129 Jun 4 12:20 /dev/ipath_diag0 > crw-rw-rw- 1 root root 244, 1 Jun 4 12:20 /dev/ipath0 > crw-rw-rw- 1 root root 244, 0 Jun 4 12:20 /dev/ipath >
