Yeah, the CPPFLAGS didn’t get set - I suspect because the location being pointed to starts with “/usr/local” and therefore looks like a standard one. What you might do is set CPPFLAGS yourself to be “/usr/local/slurm/include/slurm” before running configure - should fix the problem. Might also need to set LDFLAGS=“-L/usr/local/slurm/lib64”
> On Oct 10, 2018, at 9:38 AM, Ross, Daniel B. via users > <users@lists.open-mpi.org> wrote: > > Here is the best I can do. The config.log is too large to email. > grep pmi config.log > $ ./configure --prefix=/usr/local/ --with-cuda --with-slurm > --with-pmi=/usr/local/slurm/include/slurm --with > pmi-libdir=/usr/local/slurm/lib64 > configure:71744: result: '--prefix=/usr/local/' '--with-cuda' '--with-slurm' > '--with-pmi=/usr/local/slurm/include/slurm' > '--with-pmi-libdir=/usr/local/slurm/lib64' > configure:85150: checking for pmi.h in /usr/local/slurm/include/slurm > configure:85208: checking pmi.h usability > configure:85208: checking pmi.h presence > configure:85208: checking for pmi.h > configure:85270: checking for libpmi in /usr/local/slurm/lib64 > configure:85277: checking for PMI_Init in -lpmi > configure:85302: gcc -std=gnu99 -o conftest -O3 -DNDEBUG -finline-functions > -fno-strict-aliasing -mcx16 -pthread > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include > -I/usr/local/slurm/include/slurm -L/usr/local/slurm/lib64 conftest.c > -lpmi -lm -lutil -lz -lpmi >&5 > configure:85481: checking for pmi2.h in /usr/local/slurm/include/slurm > configure:85539: checking pmi2.h usability > configure:85539: checking pmi2.h presence > configure:85539: checking for pmi2.h > configure:85601: checking for libpmi2 in /usr/local/slurm/lib64 > configure:85608: checking for PMI2_Init in -lpmi2 > configure:85633: gcc -std=gnu99 -o conftest -O3 -DNDEBUG -finline-functions > -fno-strict-aliasing -mcx16 -pthread > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include > -I/usr/local/slurm/include/slurm -L/usr/local/slurm/lib64 conftest.c > -lpmi2 -lm -lutil -lz -lpmi2 >&5 > configure:86063: result: common, allocator, backtrace, btl, compress, crs, > dl, event, hwloc, if, installdirs, memchecker, memcpy, memory, mpool, > patcher, pmix, pstat, rcache, reachable, shmem, timer > configure:130096: running /bin/sh './configure' --disable-dns --disable-http > --disable-rpc --disable-openssl --enable-thread-support --disable-evport > '--prefix=/usr/local/' '--with-cuda' '--with-slurm' > '--with-pmi=/usr/local/slurm/include/slurm' > '--with-pmi-libdir=/usr/local/slurm/lib64' > 'CPPFLAGS=-I/usr/local/src/openmpi/openmpi-3.1.2 > -I/usr/local/src/openmpi/openmpi-3.1.2 > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include > -Drandom=opal_random' --cache-file=/dev/null --srcdir=. > --disable-option-checking > configure:5903: +++ Configuring MCA framework pmix > configure:146895: checking for no configure components in framework pmix > configure:146899: checking for m4 configure components in framework pmix > configure:146901: result: cray, ext1x, ext2x, flux, pmix2x, s1, s2 > configure:5918: --- MCA component pmix:isolated (no configuration) > configure:146996: checking for MCA component pmix:isolated compile mode > configure:147038: checking if MCA component pmix:isolated can compile > configure:5918: --- MCA component pmix:cray (m4 configuration macro) > configure:147646: checking for MCA component pmix:cray compile mode > configure:147691: $PKG_CONFIG --exists --print-errors "cray-pmi" > Package cray-pmi was not found in the pkg-config search path. > Perhaps you should add the directory containing `cray-pmi.pc' > No package 'cray-pmi' found > configure:147708: $PKG_CONFIG --exists --print-errors "cray-pmi" > Package cray-pmi was not found in the pkg-config search path. > Perhaps you should add the directory containing `cray-pmi.pc' > No package 'cray-pmi' found > configure:147725: $PKG_CONFIG --exists --print-errors "cray-pmi" > Package cray-pmi was not found in the pkg-config search path. > Perhaps you should add the directory containing `cray-pmi.pc' > No package 'cray-pmi' found > No package 'cray-pmi' found > configure:149038: checking if MCA component pmix:cray can compile > configure:5918: --- MCA component pmix:ext1x (m4 configuration macro) > configure:149182: checking for MCA component pmix:ext1x compile mode > configure:149748: checking if MCA component pmix:ext1x can compile > configure:5918: --- MCA component pmix:ext2x (m4 configuration macro) > configure:149892: checking for MCA component pmix:ext2x compile mode > configure:150447: checking if MCA component pmix:ext2x can compile > configure:5918: --- MCA component pmix:flux (m4 configuration macro) > configure:150591: checking for MCA component pmix:flux compile mode > configure:150802: checking if MCA component pmix:flux can compile > configure:5918: --- MCA component pmix:pmix2x (m4 configuration macro) > configure:151409: checking for MCA component pmix:pmix2x compile mode > configure:151568: OPAL configuring in opal/mca/pmix/pmix2x/pmix > configure:151649: running /bin/sh './configure' --enable-embedded-mode > --disable-debug --with-pmix-symbol-rename=OPAL_MCA_PMIX2X_ > --disable-pmix-timing --without-tests-examples > --disable-pmix-backward-compatibility --disable-visibility > --enable-embedded-libevent > --with-libevent-header=\"opal/mca/event/libevent2022/libevent2022.h\" > '--prefix=/usr/local/' '--with-cuda' '--with-slurm' > '--with-pmi=/usr/local/slurm/include/slurm' > '--with-pmi-libdir=/usr/local/slurm/lib64' 'CFLAGS=-O3 -DNDEBUG ' > 'CPPFLAGS=-I/usr/local/src/openmpi/openmpi-3.1.2 > -I/usr/local/src/openmpi/openmpi-3.1.2 > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/include > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/event/libevent2022/libevent > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/event/libevent2022/libevent/include > > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/hwloc/hwloc1117/hwloc/include > ' --cache-file=/dev/null --srcdir=. --disable-option-checking > configure:151655: /bin/sh './configure' succeeded for > opal/mca/pmix/pmix2x/pmix > configure:151809: checking if MCA component pmix:pmix2x can compile > configure:5918: --- MCA component pmix:s1 (m4 configuration macro) > configure:152416: checking for MCA component pmix:s1 compile mode > configure:152478: checking if MCA component pmix:s1 can compile > configure:5918: --- MCA component pmix:s2 (m4 configuration macro) > configure:153085: checking for MCA component pmix:s2 compile mode > configure:153147: checking if MCA component pmix:s2 can compile > configure:177961: result: env, hnp, pmi, singleton, tool > configure:5918: --- MCA component ess:pmi (no configuration) > configure:179336: checking for MCA component ess:pmi compile mode > configure:179378: checking if MCA component ess:pmi can compile > config.status:4112: creating opal/mca/pmix/Makefile > config.status:4112: creating opal/mca/pmix/isolated/Makefile > config.status:4112: creating opal/mca/pmix/cray/Makefile > config.status:4112: creating opal/mca/pmix/ext1x/Makefile > config.status:4112: creating opal/mca/pmix/ext2x/Makefile > config.status:4112: creating opal/mca/pmix/flux/Makefile > config.status:4112: creating opal/mca/pmix/pmix2x/Makefile > config.status:4112: creating opal/mca/pmix/s1/Makefile > config.status:4112: creating opal/mca/pmix/s2/Makefile > config.status:4112: creating orte/mca/ess/pmi/Makefile > ac_cv_header_pmi2_h=yes > ac_cv_header_pmi_h=yes > ac_cv_lib_pmi2_PMI2_Init=yes > ac_cv_lib_pmi_PMI_Init=yes > MCA_BUILD_opal_pmix_cray_DSO_FALSE='#' > MCA_BUILD_opal_pmix_cray_DSO_TRUE='' > MCA_BUILD_opal_pmix_ext1x_DSO_FALSE='#' > MCA_BUILD_opal_pmix_ext1x_DSO_TRUE='' > MCA_BUILD_opal_pmix_ext2x_DSO_FALSE='#' > MCA_BUILD_opal_pmix_ext2x_DSO_TRUE='' > MCA_BUILD_opal_pmix_flux_DSO_FALSE='#' > MCA_BUILD_opal_pmix_flux_DSO_TRUE='' > MCA_BUILD_opal_pmix_isolated_DSO_FALSE='#' > MCA_BUILD_opal_pmix_isolated_DSO_TRUE='' > MCA_BUILD_opal_pmix_pmix2x_DSO_FALSE='#' > MCA_BUILD_opal_pmix_pmix2x_DSO_TRUE='' > MCA_BUILD_opal_pmix_s1_DSO_FALSE='#' > MCA_BUILD_opal_pmix_s1_DSO_TRUE='' > MCA_BUILD_opal_pmix_s2_DSO_FALSE='#' > MCA_BUILD_opal_pmix_s2_DSO_TRUE='' > MCA_BUILD_orte_ess_pmi_DSO_FALSE='#' > MCA_BUILD_orte_ess_pmi_DSO_TRUE='' > MCA_opal_FRAMEWORKS='common allocator backtrace btl compress crs dl event > hwloc if installdirs memchecker memcpy memory mpool patcher pmix pstat rcache > reachable shmem timer' > MCA_opal_FRAMEWORKS_SUBDIRS='mca/common mca/allocator mca/backtrace mca/btl > mca/compress mca/crs mca/dl mca/event mca/hwloc mca/if mca/installdirs > mca/memchecker mca/memcpy mca/memory mca/mpool mca/patcher mca/pmix mca/pstat > mca/rcache mca/reachable mca/shmem mca/timer' > MCA_opal_FRAMEWORK_COMPONENT_ALL_SUBDIRS='$(MCA_opal_common_ALL_SUBDIRS) > $(MCA_opal_allocator_ALL_SUBDIRS) $(MCA_opal_backtrace_ALL_SUBDIRS) > $(MCA_opal_btl_ALL_SUBDIRS) $(MCA_opal_compress_ALL_SUBDIRS) > $(MCA_opal_crs_ALL_SUBDIRS) $(MCA_opal_dl_ALL_SUBDIRS) > $(MCA_opal_event_ALL_SUBDIRS) $(MCA_opal_hwloc_ALL_SUBDIRS) > $(MCA_opal_if_ALL_SUBDIRS) $(MCA_opal_installdirs_ALL_SUBDIRS) > $(MCA_opal_memchecker_ALL_SUBDIRS) $(MCA_opal_memcpy_ALL_SUBDIRS) > $(MCA_opal_memory_ALL_SUBDIRS) $(MCA_opal_mpool_ALL_SUBDIRS) > $(MCA_opal_patcher_ALL_SUBDIRS) $(MCA_opal_pmix_ALL_SUBDIRS) > $(MCA_opal_pstat_ALL_SUBDIRS) $(MCA_opal_rcache_ALL_SUBDIRS) > $(MCA_opal_reachable_ALL_SUBDIRS) $(MCA_opal_shmem_ALL_SUBDIRS) > $(MCA_opal_timer_ALL_SUBDIRS)' > MCA_opal_FRAMEWORK_COMPONENT_DSO_SUBDIRS='$(MCA_opal_common_DSO_SUBDIRS) > $(MCA_opal_allocator_DSO_SUBDIRS) $(MCA_opal_backtrace_DSO_SUBDIRS) > $(MCA_opal_btl_DSO_SUBDIRS) $(MCA_opal_compress_DSO_SUBDIRS) > $(MCA_opal_crs_DSO_SUBDIRS) $(MCA_opal_dl_DSO_SUBDIRS) > $(MCA_opal_event_DSO_SUBDIRS) $(MCA_opal_hwloc_DSO_SUBDIRS) > $(MCA_opal_if_DSO_SUBDIRS) $(MCA_opal_installdirs_DSO_SUBDIRS) > $(MCA_opal_memchecker_DSO_SUBDIRS) $(MCA_opal_memcpy_DSO_SUBDIRS) > $(MCA_opal_memory_DSO_SUBDIRS) $(MCA_opal_mpool_DSO_SUBDIRS) > $(MCA_opal_patcher_DSO_SUBDIRS) $(MCA_opal_pmix_DSO_SUBDIRS) > $(MCA_opal_pstat_DSO_SUBDIRS) $(MCA_opal_rcache_DSO_SUBDIRS) > $(MCA_opal_reachable_DSO_SUBDIRS) $(MCA_opal_shmem_DSO_SUBDIRS) > $(MCA_opal_timer_DSO_SUBDIRS)' > MCA_opal_FRAMEWORK_COMPONENT_STATIC_SUBDIRS='$(MCA_opal_common_STATIC_SUBDIRS) > $(MCA_opal_allocator_STATIC_SUBDIRS) $(MCA_opal_backtrace_STATIC_SUBDIRS) > $(MCA_opal_btl_STATIC_SUBDIRS) $(MCA_opal_compress_STATIC_SUBDIRS) > $(MCA_opal_crs_STATIC_SUBDIRS) $(MCA_opal_dl_STATIC_SUBDIRS) > $(MCA_opal_event_STATIC_SUBDIRS) $(MCA_opal_hwloc_STATIC_SUBDIRS) > $(MCA_opal_if_STATIC_SUBDIRS) $(MCA_opal_installdirs_STATIC_SUBDIRS) > $(MCA_opal_memchecker_STATIC_SUBDIRS) $(MCA_opal_memcpy_STATIC_SUBDIRS) > $(MCA_opal_memory_STATIC_SUBDIRS) $(MCA_opal_mpool_STATIC_SUBDIRS) > $(MCA_opal_patcher_STATIC_SUBDIRS) $(MCA_opal_pmix_STATIC_SUBDIRS) > $(MCA_opal_pstat_STATIC_SUBDIRS) $(MCA_opal_rcache_STATIC_SUBDIRS) > $(MCA_opal_reachable_STATIC_SUBDIRS) $(MCA_opal_shmem_STATIC_SUBDIRS) > $(MCA_opal_timer_STATIC_SUBDIRS)' > MCA_opal_FRAMEWORK_LIBS=' $(MCA_opal_common_STATIC_LTLIBS) > mca/allocator/libmca_allocator.la <http://libmca_allocator.la/> > $(MCA_opal_allocator_STATIC_LTLIBS) mca/backtrace/libmca_backtrace.la > <http://libmca_backtrace.la/> $(MCA_opal_backtrace_STATIC_LTLIBS) > mca/btl/libmca_btl.la <http://libmca_btl.la/> $(MCA_opal_btl_STATIC_LTLIBS) > mca/compress/libmca_compress.la <http://libmca_compress.la/> > $(MCA_opal_compress_STATIC_LTLIBS) mca/crs/libmca_crs.la > <http://libmca_crs.la/> $(MCA_opal_crs_STATIC_LTLIBS) mca/dl/libmca_dl.la > <http://libmca_dl.la/>$(MCA_opal_dl_STATIC_LTLIBS) mca/event/libmca_event.la > <http://libmca_event.la/> $(MCA_opal_event_STATIC_LTLIBS) > mca/hwloc/libmca_hwloc.la > <http://libmca_hwloc.la/>$(MCA_opal_hwloc_STATIC_LTLIBS) mca/if/libmca_if.la > <http://libmca_if.la/> $(MCA_opal_if_STATIC_LTLIBS) > mca/installdirs/libmca_installdirs.la > <http://libmca_installdirs.la/>$(MCA_opal_installdirs_STATIC_LTLIBS) > mca/memchecker/libmca_memchecker.la <http://libmca_memchecker.la/> > $(MCA_opal_memchecker_STATIC_LTLIBS) mca/memcpy/libmca_memcpy.la > <http://libmca_memcpy.la/> $(MCA_opal_memcpy_STATIC_LTLIBS) > mca/memory/libmca_memory.la <http://libmca_memory.la/> > $(MCA_opal_memory_STATIC_LTLIBS) mca/mpool/libmca_mpool.la > <http://libmca_mpool.la/> $(MCA_opal_mpool_STATIC_LTLIBS) > mca/patcher/libmca_patcher.la <http://libmca_patcher.la/> > $(MCA_opal_patcher_STATIC_LTLIBS) mca/pmix/libmca_pmix.la > <http://libmca_pmix.la/> $(MCA_opal_pmix_STATIC_LTLIBS) > mca/pstat/libmca_pstat.la <http://libmca_pstat.la/> > $(MCA_opal_pstat_STATIC_LTLIBS) mca/rcache/libmca_rcache.la > <http://libmca_rcache.la/>$(MCA_opal_rcache_STATIC_LTLIBS) > mca/reachable/libmca_reachable.la <http://libmca_reachable.la/> > $(MCA_opal_reachable_STATIC_LTLIBS) mca/shmem/libmca_shmem.la > <http://libmca_shmem.la/>$(MCA_opal_shmem_STATIC_LTLIBS) > mca/timer/libmca_timer.la <http://libmca_timer.la/> > $(MCA_opal_timer_STATIC_LTLIBS)' > MCA_opal_pmix_ALL_COMPONENTS=' isolated cray ext1x ext2x flux pmix2x s1 s2' > MCA_opal_pmix_ALL_SUBDIRS=' mca/pmix/isolated mca/pmix/cray mca/pmix/ext1x > mca/pmix/ext2x mca/pmix/flux mca/pm x/pmix2x mca/pmix/s1 mca/pmix/s2' > MCA_opal_pmix_DSO_COMPONENTS=' isolated flux pmix2x s1 s2' > MCA_opal_pmix_DSO_SUBDIRS=' mca/pmix/isolated mca/pmix/flux mca/pmix/pmix2x > mca/pmix/s1 mca/pmix/s2' > MCA_opal_pmix_STATIC_COMPONENTS='' > MCA_opal_pmix_STATIC_LTLIBS='' > MCA_opal_pmix_STATIC_SUBDIRS='' > MCA_orte_ess_ALL_COMPONENTS=' env hnp pmi singleton tool alps lsf slurm tm' > MCA_orte_ess_ALL_SUBDIRS=' mca/ess/env mca/ess/hnp mca/ess/pmi > mca/ess/singleton mca/ess/tool mca/ess/alps mca/ess/lsf mca/ess/slurm > mca/ess/tm' > MCA_orte_ess_DSO_COMPONENTS=' env hnp pmi singleton tool slurm' > MCA_orte_ess_DSO_SUBDIRS=' mca/ess/env mca/ess/hnp mca/ess/pmi > mca/ess/singleton mca/ess/tool mca/ess/slurm' > OPAL_CONFIGURE_CLI=' \'\''--prefix=/usr/local/\'\'' \'\''--with-cuda\'\'' > \'\''--with-slurm\'\'' \'\''--with-pmi=/usr/local/slurm/include/slurm\'\'' > \'\''--with-pmi-libdir=/usr/local/slurm/lib64\'\''' > opal_pmi1_CPPFLAGS='' > opal_pmi1_LDFLAGS='' > opal_pmi1_LIBS='-lpmi' > opal_pmi1_rpath='' > opal_pmi2_CPPFLAGS='' > opal_pmi2_LDFLAGS='' > opal_pmi2_LIBS='-lpmi2' > opal_pmi2_rpath='' > opal_pmix_ext1x_CPPFLAGS='' > opal_pmix_ext1x_LDFLAGS='' > opal_pmix_ext1x_LIBS='' > opal_pmix_ext2x_CPPFLAGS='' > opal_pmix_ext2x_LDFLAGS='' > opal_pmix_ext2x_LIBS='' > opal_pmix_pmix2x_CPPFLAGS='-I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/include > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/include > -I/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix' > opal_pmix_pmix2x_DEPENDENCIES='/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/src/libpmix.la > <http://libpmix.la/>' > opal_pmix_pmix2x_LDFLAGS='' > opal_pmix_pmix2x_LIBS='/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x/pmix/src/libpmix.la > <http://libpmix.la/>' > pmix_alps_CPPFLAGS='' > pmix_alps_LDFLAGS='' > pmix_alps_LIBS='' > pmix_cray_CPPFLAGS='' > pmix_cray_LDFLAGS='' > pmix_cray_LIBS='' > > From: users <users-boun...@lists.open-mpi.org> On Behalf Of Ralph H Castain > Sent: Wednesday, October 10, 2018 11:26 AM > To: Open MPI Users <users@lists.open-mpi.org> > Subject: Re: [OMPI users] issue compiling openmpi 3.2.1 with pmi and slurm > > It appears that the CPPFLAGS isn’t getting set correctly as the component > didn’t find the Slurm PMI-1 header file. Perhaps it would help if we saw the > config.log output so we can see where OMPI thought the file was located. > > > > On Oct 10, 2018, at 6:44 AM, Ross, Daniel B. via users > <users@lists.open-mpi.org <mailto:users@lists.open-mpi.org>> wrote: > > I have been able to configure without issue using the following options: > ./configure --prefix=/usr/local/ --with-cuda --with-slurm > --with-pmi=/usr/local/slurm/include/slurm > --with-pmi-libdir=/usr/local/slurm/lib64 > > Everything compiles just fine until I get this error: > > make[3]: Leaving directory > `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x' > make[2]: Leaving directory > `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/pmix2x' > Making all in mca/pmix/s1 > make[2]: Entering directory > `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1' > CC mca_pmix_s1_la-pmix_s1.lo > pmix_s1.c:29:17: fatal error: pmi.h: No such file or directory > #include <pmi.h> > ^ > compilation terminated. > make[2]: *** [mca_pmix_s1_la-pmix_s1.lo] Error 1 > make[2]: Leaving directory > `/usr/local/src/openmpi/openmpi-3.1.2/opal/mca/pmix/s1' > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory `/usr/local/src/openmpi/openmpi-3.1.2/opal' > make: *** [all-recursive] Error 1 > > > any ideas why I am getting this error? > Thanks > > _______________________________________________ > users mailing list > users@lists.open-mpi.org <mailto:users@lists.open-mpi.org> > https://lists.open-mpi.org/mailman/listinfo/users > <https://lists.open-mpi.org/mailman/listinfo/users> > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
