I found the problem - it is an error in hwloc. It's missing a required include <numaif.h>. I'll fix and push it upstream.
On Jan 25, 2013, at 4:59 PM, Ralph Castain <r...@open-mpi.org> wrote: > > On Jan 25, 2013, at 4:53 PM, Ralph Castain <r...@open-mpi.org> wrote: >> The repeated libs is something we obviously should fix, but all the libs are >> there - including lustre. I guess those were dropped due to the shared lib >> setting, so we probably should fix that in the platform file. >> >> Perhaps that is the cause of Nathan's issue? shrug...regardless, apps build >> and run just fine using mpicc for me. > > Correction - turns out I misspoke. I find apps *don't* build correctly with > this setup: > > mpicc -g hello_c.c -o hello_c > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_set_area_membind': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1116: > undefined reference to `mbind' > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1135: > undefined reference to `mbind' > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_get_area_membind': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1337: > undefined reference to `get_mempolicy' > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_find_kernel_max_numnodes': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1239: > undefined reference to `get_mempolicy' > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_set_thisthread_membind': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1183: > undefined reference to `set_mempolicy' > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1194: > undefined reference to `migrate_pages' > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1206: > undefined reference to `set_mempolicy' > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_get_thisthread_membind': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1284: > undefined reference to `get_mempolicy' > /usr/aprojects/hpctools/rhc/build/lib/libopen-pal.a(topology-linux.o): In > function `hwloc_linux_find_kernel_max_numnodes': > /lscratch1/rcastain/openmpi-1.9a1/opal/mca/hwloc/hwloc151/hwloc/src/topology-linux.c:1239: > undefined reference to `get_mempolicy' > collect2: ld returned 1 exit status > make: *** [hello_c] Error 1 > > So it looks like hwloc is borked when built static. > > Sigh > Ralph >
