Andrew, Thanks. We're using the RHEL version because it was less complicated for our environment in the past, but sounds like we might want to reconsider that decision.
Do you know why we don't see the message with lower node count allocations? It only seems to happen when the node count gets over a certain point? thanks On Wed, Nov 5, 2014 at 5:51 PM, Friedley, Andrew <andrew.fried...@intel.com> wrote: > Hi Michael, > > From what I understand, this is an issue with the qib driver and PSM from > RHEL 6.5 and 6.6, and will be fixed for 6.7. There is no functional change > between qib->PSM API versions 11 and 12, so the message is harmless. I > presume you're using the RHEL sourced package for a reason, but using an IFS > release would fix the problem until RHEL 6.7 is ready. > > Andrew > >> -----Original Message----- >> From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Michael Di >> Domenico >> Sent: Tuesday, November 4, 2014 8:35 AM >> To: Open MPI Users >> Subject: [OMPI users] ipath_userinit errors >> >> I'm getting the below message on my cluster(s). It seems to only happen >> when I try to use more then 64 nodes (16-cores each). The clusters are >> running RHEL 6.5 with Slurm and Openmpi-1.6.5 with PSM. >> I'm using the OFED versions included with RHEL for infiniband support. >> >> ipath_userinit: Mismatched user minor version (12) and driver minor version >> (11) while context sharing. Ensure that driver and library are from the same >> release >> >> I already realize this is a warning message and the jobs complete. >> Another user a little over a year ago had a similar issue that was tracked to >> mismatched ofed versions. Since i have a diskless cluster all my nodes are >> identical. >> >> I'm not adverse to thinking there might not be something unique about my >> machine, but since i have two separate machines doing it, I'm not really sure >> where to look to triage the issue and see what might be set incorrectly. >> >> Any thoughts on where to start checking would be helpful, thanks... >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: http://www.open- >> mpi.org/community/lists/users/2014/11/25667.php > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2014/11/25694.php
