So we downloaded and made openmpi 1.10.1 on this platform from scratch.
All seems fine and a simple test application runs fine. However, with the real application we are running into a hwloc problem. So we also downloaded and made the hwloc package 1.11.2. Now examining hardware locality we get the following error: hwloc-info -v --whole-io **************************************************************************** * hwloc 1.11.2 has encountered what looks like an error from the operating system. * * Core (P#0 cpuset 0x00001001) intersects with NUMANode (P#1 cpuset 0x0003c001) without inclusion! * Error occurred in topology.c line 1046 * * The following FAQ entry in the hwloc documentation may help: * What should I do when hwloc reports "operating system" warnings? * Otherwise please report this error message to the hwloc user's mailing list, * along with any relevant topology information from your platform. **************************************************************************** depth 0: 1 Machine (type #1) depth 1: 2 Package (type #3) depth 2: 2 NUMANode (type #2) depth 3: 1 Core (type #5) depth 4: 24 PU (type #6)Since I could not find the mentioned FAQ topic I'm asking the list for advice.
Our system is an Oracle/ Solaris 11.3 (latest patch level) on an Intel hardware platform from Sun.
output of uname -a -> SunOS sxaug28 5.11 11.3 i86pc i386 i86pc output of psrinfo -v -> Status of virtual processor 0 as of: 01/04/2016 17:10:17 on-line since 01/04/2016 14:44:28. The i386 processor operates at 1600 MHz, and has an i387 compatible floating point processor. Status of virtual processor 1 as of: 01/04/2016 17:10:17 on-line since 01/04/2016 14:45:10. The i386 processor operates at 1600 MHz, and has an i387 compatible floating point processor.. . (similar lines removed) . Status of virtual processor 23 as of: 01/04/2016 17:10:17
on-line since 01/04/2016 14:45:11. The i386 processor operates at 1600 MHz, and has an i387 compatible floating point processor.Following comes the script which was used to make hwloc: (used compiler: Sunstudio 12.4, see config.log as bz2 attachment)
setenv CFLAGS "-m64 -xtarget=generic -xarch=sse2 -xprefetch -xprefetch_level=2 -xvector=simd -xdepend=yes -xbuiltin=%all -xO5" setenv CXXFLAGS "$CFLAGS" setenv FCFLAGS "-m64 -xtarget=generic -xarch=sse2 -xprefetch -xprefetch_level=2 -xvector=simd -stackvar -xO5" setenv FFLAGS "$FCFLAGS" setenv PREFIX /usr/openmpi/hwloc-1.11.2 ./configure --prefix=$PREFIX --disable-debug dmake -j 12 # as root: make install # : cp -p config.status $PREFIX/config.status Any advice much appreciated. Karl
config.log.bz2
Description: Binary data