Hi, I'm trying to compile the latest OpenMPI version with Infiniband support in our local cluster, but didn't get very far (since I'm installing this via Spack, I also asked in their support group).
I'm doing the installation via Spack, which is issuing the following .configure step (see the options given for --with-knem, --with-hcoll and --with-mxm): ,---- | configure' | '--prefix=/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-9.3.0/openmpi-4.1.1-jsvbusyjgthr2d6oyny5klt62gm6ma2u' | '--enable-shared' '--disable-silent-rules' '--disable-builtin-atomics' | '--enable-static' '--without-pmi' | '--with-zlib=/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-9.3.0/zlib-1.2.11-hrstx5ffrg4f4k3xc2anyxed3mmgdcoz' | '--enable-mpi1-compatibility' '--with-knem=/opt/knem-1.1.2.90mlnx2' | '--with-hcoll=/opt/mellanox/hcoll' '--without-psm' '--without-ofi' | '--without-cma' '--without-ucx' '--without-fca' | '--with-mxm=/opt/mellanox/mxm' '--without-verbs' '--without-xpmem' | '--without-psm2' '--without-alps' '--without-lsf' '--without-sge' | '--without-slurm' '--without-tm' '--without-loadleveler' | '--disable-memchecker' | '--with-libevent=/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-9.3.0/libevent-2.1.12-yd5l4tjmnigv6dqlv5afpn4zc6ekdchc' | '--with-hwloc=/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-9.3.0/hwloc-2.6.0-bfnt4g3givflydpe5d2iglyupgbzxbfn' | '--disable-java' '--disable-mpi-java' '--without-cuda' | '--enable-wrapper-rpath' '--disable-wrapper-runpath' '--disable-mpi-cxx' | '--disable-cxx-exceptions' | '--with-wrapper-ldflags=-Wl,-rpath,/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-7.2.0/gcc-9.3.0-ghr2jekwusoa4zip36xsa3okgp3bylqm/lib/gcc/x86_64-pc-linux-gnu/9.3.0 | -Wl,-rpath,/storage/projects/can30/angelv/spack/opt/spack/linux-sles12-sandybridge/gcc-7.2.0/gcc-9.3.0-ghr2jekwusoa4zip36xsa3okgp3bylqm/lib64' `---- Later on in the configuration phase I see: ,---- | --- MCA component btl:openib (m4 configuration macro) | checking for MCA component btl:openib compile mode... static | checking whether expanded verbs are available... yes | checking whether IBV_EXP_ATOMIC_HCA_REPLY_BE is declared... yes | checking whether IBV_EXP_QP_CREATE_ATOMIC_BE_REPLY is declared... yes | checking whether ibv_exp_create_qp is declared... yes | checking whether ibv_exp_query_device is declared... yes | checking whether IBV_EXP_QP_INIT_ATTR_ATOMICS_ARG is declared... yes | checking for struct ibv_exp_device_attr.ext_atom... yes | checking for struct ibv_exp_device_attr.exp_atomic_cap... yes | checking if MCA component btl:openib can compile... no `---- This is the first time I try to compile OpenMPI this way, and I get a bit confused with what each bit is doing, but it looks like it goes through the moves to get the btl:openib built, but then for some reason it cannot compile it. Any suggestions/pointers? Many thanks, -- Ángel de Vicente Tel.: +34 922 605 747 Web.: http://research.iac.es/proyecto/polmag/ --------------------------------------------------------------------------------------------- AVISO LEGAL: Este mensaje puede contener información confidencial y/o privilegiada. Si usted no es el destinatario final del mismo o lo ha recibido por error, por favor notifíquelo al remitente inmediatamente. Cualquier uso no autorizadas del contenido de este mensaje está estrictamente prohibida. Más información en: https://www.iac.es/es/responsabilidad-legal DISCLAIMER: This message may contain confidential and / or privileged information. If you are not the final recipient or have received it in error, please notify the sender immediately. Any unauthorized use of the content of this message is strictly prohibited. More information: https://www.iac.es/en/disclaimer
