Dear Kenneth, On 9/28/23 10:07, Kenneth Hoste wrote:
Unfortunately, building the foss-2022b toolchain exits during the testing phase of OpenMPI-4.1.4-GCC-12.2.0.eb as shown below. Does anyone have ideas about what might be wrong?
...
By default OpenMPI is being configured with "--with-verbs", you should see that popping up in the log file (or use "eb --trace" to get some more info during the installation).
Thanks, I sort of suspected that IB was somehow being assumed tacitly by EB :-)
If you don't have Infiniband, you should add --without-verbs via configopts in your OpenMPI easyconfig file (which should prevent the OpenMPI easyblock from adding --with-verbs), or using a hook (see for example https://docs.easybuild.io/hooks/#replace-with-verbs-with-without-verbs-in-openmpi-configure-options, although that exact example won't work, you should just hard inject --without-verbs in self.cfg['configopts'] instead in the pre_configure_hook).
We eventually will use our AMD Genoa EB modules on some nodes to be installed next month which will include Mellanox/Nvidia Infiniband.
Question: Would it help if I take an old (like 10 years old) Mellanox IB PCIe adapter lying around and mount it in my server? Or maybe a relatively new Omni-Path adapter?
Would that make the OpenMPI EB module happy, and would the module work with our future nodes?
Thanks, Ole -- Ole Holm Nielsen PhD, Senior HPC Officer Department of Physics, Technical University of Denmark,
