Is there any chance that you can upgrade to the OFED IB stack? Cisco
is recommending OFED to all of its customers who are able to upgrade:
http://www.open-mpi.org/faq/?category=openfabrics#vapi-support
If you can't upgrade, we'll continue to diagnose (please see http://www.open-mpi.org/community/help/)
, but I thought I'd at least ask...
On Nov 5, 2007, at 5:39 PM, Mike Hanby wrote:
Howdy,
I'm attempting to compile OpenMPI using Intel compilers (9.1.047)
with Topspin Infiniband support (on CentOS 4.4 64bit).
Configuring:
./configure CC=icc CXX=icpc FC=ifort F77=ifort F90=ifort --with-
mvapi=/usr/local/topspin --with-mvapi-libdir=/usr/local/topspin/
lib64 --enable-static --prefix=/share/apps/openmpi/intel/
openmpi-1.2.4-64
make runs for 5 minutes or so and errors with:
IPO link: can not find -lvapi
icc: error: problem during multi-file optimization compilation (code
1)
make[2]: *** [libmpi.la] Error 1
make[2]: Leaving directory `/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/ompi'
make[1]: *** [install-recursive] Error 1
make[1]: Leaving directory `/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/ompi'
I used the same configuration for OpenMPI 1.1.2 and it compiled and
installed successfully.
Any suggestions?
The following are the last several lines in the make log file:
====================================================================
libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
finline-functions -fno-strict-aliasing -restrict -pthread -MT
runtime/ompi_mpi_params.lo -MD -MP -MF runtime/.deps/
ompi_mpi_params.Tpo -c runtime/ompi_mpi_params.c -o runtime/
ompi_mpi_params.o >/dev/null 2>&1
depbase=`echo runtime/ompi_mpi_preconnect.lo | sed 's|[^/]*$|.deps/
&|;s|\.lo$||'`;\
/bin/sh ../libtool --tag=CC --mode=compile /share/apps/intel/cce/
9.1.047/bin/icc -DHAVE_CONFIG_H -I. -I../opal/include -I../orte/
include -I../ompi/include -I.. -I/share/apps/intel/cce/9.1.047/
include -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -
restrict -pthread -MT runtime/ompi_mpi_preconnect.lo -MD -MP -MF
$depbase.Tpo -c -o runtime/ompi_mpi_preconnect.lo runtime/
ompi_mpi_preconnect.c &&\
mv -f $depbase.Tpo $depbase.Plo
libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
finline-functions -fno-strict-aliasing -restrict -pthread -MT
runtime/ompi_mpi_preconnect.lo -MD -MP -MF runtime/.deps/
ompi_mpi_preconnect.Tpo -c runtime/ompi_mpi_preconnect.c -fPIC -
DPIC -o runtime/.libs/ompi_mpi_preconnect.o
libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
finline-functions -fno-strict-aliasing -restrict -pthread -MT
runtime/ompi_mpi_preconnect.lo -MD -MP -MF runtime/.deps/
ompi_mpi_preconnect.Tpo -c runtime/ompi_mpi_preconnect.c -o runtime/
ompi_mpi_preconnect.o >/dev/null 2>&1
depbase=`echo win/win.lo | sed 's|[^/]*$|.deps/&|;s|\.lo$||'`;\
/bin/sh ../libtool --tag=CC --mode=compile /share/apps/intel/cce/
9.1.047/bin/icc -DHAVE_CONFIG_H -I. -I../opal/include -I../orte/
include -I../ompi/include -I.. -I/share/apps/intel/cce/9.1.047/
include -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -
restrict -pthread -MT win/win.lo -MD -MP -MF $depbase.Tpo -c -o win/
win.lo win/win.c &&\
mv -f $depbase.Tpo $depbase.Plo
libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
finline-functions -fno-strict-aliasing -restrict -pthread -MT win/
win.lo -MD -MP -MF win/.deps/win.Tpo -c win/win.c -fPIC -DPIC -o
win/.libs/win.o
libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
finline-functions -fno-strict-aliasing -restrict -pthread -MT win/
win.lo -MD -MP -MF win/.deps/win.Tpo -c win/win.c -o win/win.o >/dev/
null 2>&1
/bin/sh ../libtool --tag=CC --mode=link /share/apps/intel/cce/
9.1.047/bin/icc -O3 -DNDEBUG -finline-functions -fno-strict-
aliasing -restrict -pthread -export-dynamic -L/share/apps/intel/cce/
9.1.047/lib -o libmpi.la -rpath /share/apps/openmpi/intel/
openmpi-1.2.4-64/lib class/ompi_bitmap.lo class/ompi_free_list.lo
class/ompi_pointer_array.lo class/ompi_rb_tree.lo class/
ompi_seq_tracker.lo attribute/attribute.lo attribute/
attribute_predefined.lo communicator/comm_init.lo communicator/
comm.lo communicator/comm_cid.lo communicator/comm_dyn.lo
communicator/comm_publish.lo errhandler/errhandler.lo errhandler/
errhandler_invoke.lo errhandler/errhandler_predefined.lo errhandler/
errcode.lo errhandler/errcode-internal.lo file/file.lo group/
group.lo group/group_init.lo group/group_set_rank.lo info/info.lo op/
op.lo op/op_predefined.lo proc/proc.lo request/grequest.lo request/
request.lo request/req_test.lo request/req_wait.lo runtime/
ompi_mpi_abort.lo runtime/ompi_mpi_init.lo runtime/
ompi_mpi_finalize.lo runtime/ompi_mpi_params.lo runtime/
ompi_mpi_preconnect.lo win/win.lo datatype/libdatatype.la debuggers/
libdebuggers.la mpi/c/libmpi_c.la mpi/c/profile/libmpi_c_pmpi.la
mpi/f77/libmpi_f77_base.la mca/allocator/libmca_allocator.la mca/
allocator/bucket/libmca_allocator_bucket.la mca/allocator/basic/
libmca_allocator_basic.la mca/bml/libmca_bml.la mca/bml/r2/
libmca_bml_r2.la mca/btl/libmca_btl.la mca/btl/tcp/
libmca_btl_tcp.la mca/btl/mvapi/libmca_btl_mvapi.la mca/btl/sm/
libmca_btl_sm.la mca/btl/self/libmca_btl_self.la mca/coll/
libmca_coll.la mca/coll/tuned/libmca_coll_tuned.la mca/coll/sm/
libmca_coll_sm.la mca/coll/self/libmca_coll_self.la mca/coll/basic/
libmca_coll_basic.la mca/common/sm/libmca_common_sm.la mca/io/
libmca_io.la mca/io/romio/libmca_io_romio.la mca/mpool/
libmca_mpool.la mca/mpool/sm/libmca_mpool_sm.la mca/mpool/rdma/
libmca_mpool_rdma.la mca/mtl/libmca_mtl.la mca/osc/libmca_osc.la
mca/osc/pt2pt/libmca_osc_pt2pt.la mca/pml/libmca_pml.la mca/pml/ob1/
libmca_pml_ob1.la mca/pml/cm/libmca_pml_cm.la mca/rcache/
libmca_rcache.la mca/rcache/vma/libmca_rcache_vma.la mca/topo/
libmca_topo.la mca/topo/unity/libmca_topo_unity.la /home/makeuser/
tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/orte/libopen-rte.la -lnsl
-lutil
libtool: link: /share/apps/intel/cce/9.1.047/bin/icc -shared
class/.libs/ompi_bitmap.o class/.libs/ompi_free_list.o class/.libs/
ompi_pointer_array.o class/.libs/ompi_rb_tree.o class/.libs/
ompi_seq_tracker.o attribute/.libs/attribute.o attribute/.libs/
attribute_predefined.o communicator/.libs/comm_init.o
communicator/.libs/comm.o communicator/.libs/comm_cid.o
communicator/.libs/comm_dyn.o communicator/.libs/comm_publish.o
errhandler/.libs/errhandler.o errhandler/.libs/errhandler_invoke.o
errhandler/.libs/errhandler_predefined.o errhandler/.libs/errcode.o
errhandler/.libs/errcode-internal.o file/.libs/file.o group/.libs/
group.o group/.libs/group_init.o group/.libs/group_set_rank.o
info/.libs/info.o op/.libs/op.o op/.libs/op_predefined.o proc/.libs/
proc.o request/.libs/grequest.o request/.libs/request.o
request/.libs/req_test.o request/.libs/req_wait.o runtime/.libs/
ompi_mpi_abort.o runtime/.libs/ompi_mpi_init.o runtime/.libs/
ompi_mpi_finalize.o runtime/.libs/ompi_mpi_params.o runtime/.libs/
ompi_mpi_preconnect.o win/.libs/win.o -Wl,--whole-archive
datatype/.libs/libdatatype.a debuggers/.libs/libdebuggers.a mpi/
c/.libs/libmpi_c.a mpi/c/profile/.libs/libmpi_c_pmpi.a mpi/f77/.libs/
libmpi_f77_base.a mca/allocator/.libs/libmca_allocator.a mca/
allocator/bucket/.libs/libmca_allocator_bucket.a mca/allocator/
basic/.libs/libmca_allocator_basic.a mca/bml/.libs/libmca_bml.a mca/
bml/r2/.libs/libmca_bml_r2.a mca/btl/.libs/libmca_btl.a mca/btl/
tcp/.libs/libmca_btl_tcp.a mca/btl/mvapi/.libs/libmca_btl_mvapi.a
mca/btl/sm/.libs/libmca_btl_sm.a mca/btl/self/.libs/
libmca_btl_self.a mca/coll/.libs/libmca_coll.a mca/coll/tuned/.libs/
libmca_coll_tuned.a mca/coll/sm/.libs/libmca_coll_sm.a mca/coll/
self/.libs/libmca_coll_self.a mca/coll/basic/.libs/
libmca_coll_basic.a mca/common/sm/.libs/libmca_common_sm_noinst.a
mca/io/.libs/libmca_io.a mca/io/romio/.libs/libmca_io_romio.a mca/
mpool/.libs/libmca_mpool.a mca/mpool/sm/.libs/libmca_mpool_sm.a mca/
mpool/rdma/.libs/libmca_mpool_rdma.a mca/mtl/.libs/libmca_mtl.a mca/
osc/.libs/libmca_osc.a mca/osc/pt2pt/.libs/libmca_osc_pt2pt.a mca/
pml/.libs/libmca_pml.a mca/pml/ob1/.libs/libmca_pml_ob1.a mca/pml/
cm/.libs/libmca_pml_cm.a mca/rcache/.libs/libmca_rcache.a mca/rcache/
vma/.libs/libmca_rcache_vma.a mca/topo/.libs/libmca_topo.a mca/topo/
unity/.libs/libmca_topo_unity.a -Wl,--no-whole-archive -Wl,-rpath -
Wl,/home/makeuser/tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/
orte/.libs -Wl,-rpath -Wl,/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs -Wl,-rpath -Wl,/share/apps/
openmpi/intel/openmpi-1.2.4-64/lib -L/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs -L/share/apps/intel/cce/
9.1.047/lib -lvapi -lmosal -lrt /home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/orte/.libs/libopen-rte.so /home/
makeuser/tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs/
libopen-pal.so -lnuma -ldl -lnsl -lutil -pthread -pthread -Wl,-
soname -Wl,libmpi.so.0 -o .libs/libmpi.so.0.0.0
IPO link: can not find -lvapi
icc: error: problem during multi-file optimization compilation (code
1)
make[2]: *** [libmpi.la] Error 1
make[2]: Leaving directory `/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/ompi'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/makeuser/tmp/openmpi/
openmpi-1.2.4_64/openmpi-1.2.4/ompi'
make: *** [all-recursive] Error 1
-----
Mike Hanby
Information Systems Specialist II
School of Engineering Dean's Office
University of Alabama at Birmingham
_______________________________________________
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
--
Jeff Squyres
Cisco Systems
