With a newer master tarball I still see PGI + libfabrics failing, but with
different errors this time. Relevant output from "make V=1" appears below.
Though the build below was with pgi-10.9, I see the same problem with other
PGI compiler versions (at least 11.9 as well) on the same system (and with
identical configure arguments):
--prefix=... CC=pgcc CXX=pgCC
FC=pgf90 --with-tm=/usr/syscom/opt/torque/4.1.1 --enable-mpi-fortran=mpifh
-Paul
/bin/sh ../../../../libtool --tag=CC --mode=compile pgcc
-DHAVE_CONFIG_H -I.
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric
-I../../../../opal/include -I../../../../ompi/include
-I../../../../oshmem/include
-I../../../../opal/mca/common/libfabric/libfabric
-I../../../../opal/mca/hwloc/hwloc191/hwloc/include/private/autogen
-I../../../../opal/mca/hwloc/hwloc191/hwloc/include/hwloc/autogen
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include
-D_GNU_SOURCE
-DSYSCONFDIR=\"/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/INST/etc\"
-DRDMADIR=\"/tmp\"
-DEXTDIR=\"/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/INST/lib/openmpi\"
-DENABLE_DEBUG=0 '-DVERSION="embedded libfabric
de8444c9771ab9022d952a27134e44e5d8a5d722"' '-DPACKAGE="embedded libfabric
de8444c9771ab9022d952a27134e44e5d8a5d722"'
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa
-I../../../..
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/orte/include
-I../../../../orte/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/ompi/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/oshmem/include
-D_REENTRANT
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/hwloc/hwloc191/hwloc/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/BLD/opal/mca/hwloc/hwloc191/hwloc/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/event/libevent2022/libevent
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/event/libevent2022/libevent/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/BLD/opal/mca/event/libevent2022/libevent/include
-O -DNDEBUG -c -o libfabric/src/libmca_common_libfabric_la-enosys.lo `test
-f 'libfabric/src/enosys.c' || echo
'/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/'`libfabric/src/enosys.c
libtool: compile: pgcc -DHAVE_CONFIG_H -I.
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric
-I../../../../opal/include -I../../../../ompi/include
-I../../../../oshmem/include
-I../../../../opal/mca/common/libfabric/libfabric
-I../../../../opal/mca/hwloc/hwloc191/hwloc/include/private/autogen
-I../../../../opal/mca/hwloc/hwloc191/hwloc/include/hwloc/autogen
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include
-D_GNU_SOURCE
-DSYSCONFDIR=\"/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/INST/etc\"
-DRDMADIR=\"/tmp\"
-DEXTDIR=\"/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/INST/lib/openmpi\"
-DENABLE_DEBUG=0 "-DVERSION=\"embedded libfabric
de8444c9771ab9022d952a27134e44e5d8a5d722\"" "-DPACKAGE=\"embedded libfabric
de8444c9771ab9022d952a27134e44e5d8a5d722\""
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa
-I../../../..
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/orte/include
-I../../../../orte/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/ompi/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/oshmem/include
-D_REENTRANT
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/hwloc/hwloc191/hwloc/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/BLD/opal/mca/hwloc/hwloc191/hwloc/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/event/libevent2022/libevent
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/event/libevent2022/libevent/include
-I/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/BLD/opal/mca/event/libevent2022/libevent/include
-O -DNDEBUG -c
/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/src/enosys.c
-MD -fpic -DPIC -o libfabric/src/.libs/libmca_common_libfabric_la-enosys.o
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux
-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fabric.h:
380)PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux
-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fabric.h:
405)PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux
-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fabric.h:
411)PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux
-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fabric.h:
420)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
176)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
176)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
228)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
228)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
241)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_domain.h:
241)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
167)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
167)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
172)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
172)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
177)
PGC-W-0095-Type cast required for this conversion
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/include/rdma/fi_endpoint.h:
177)
PGC-S-0137-Incompatible prototype declaration for function fi_no_bind
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/src/enosys.c:
41)
PGC-S-0137-Incompatible prototype declaration for function fi_no_control
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/src/enosys.c:
45)
PGC-S-0137-Incompatible prototype declaration for function fi_no_ops_open
(/global/homes/h/hargrove/GSCRATCH/OMPI/openmpi-master-linux-x86_64-pgi-10.9/openmpi-dev-845-ga3275aa/opal/mca/common/libfabric/libfabric/src/enosys.c:
50)
PGC/x86-64 Linux 10.9-0: compilation completed with severe errors
make[2]: *** [libfabric/src/libmca_common_libfabric_la-enosys.lo] Error 1
make[2]: Leaving directory
`/global/scratch2/sd/hargrove/OMPI/openmpi-master-linux-x86_64-pgi-10.9/BLD/opal/mca/common/libfabric'
On Mon, Feb 2, 2015 at 11:04 PM, Paul Hargrove <phhargr...@lbl.gov> wrote:
> On a Linux/x86_64 system with PGI-14.3 I have configured a current master
> tarball with the following:
> --prefix=... --enable-debug CC=pgcc CXX=pgCC FC=pgfortran
>
> I see "make V=1" fail as shown below.
> This does NOT occur with GNU or Intel compilers on the same system.
>
> Initial guess is mis-ordered includes.
>
> -Paul
>
> DEPDIR=.deps depmode=pgcc /bin/sh
> ../../../../../openmpi-dev-803-g5919b63/config/depcomp \
> /bin/sh ../../../../libtool --tag=CC --mode=compile pgcc
> -DHAVE_CONFIG_H -I. -I../../../../../openm
> pi-dev-803-g5919b63/opal/mca/common/libfabric -I../../../../opal/include
> -I../../../../ompi/include -I../../..
> /../oshmem/include -I../../../../opal/mca/common/libfabric/libfabric
> -I../../../../opal/mca/hwloc/hwloc191/hwl
> oc/include/private/autogen
> -I../../../../opal/mca/hwloc/hwloc191/hwloc/include/hwloc/autogen
> -I/scratch/hargr
> ove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/
> opal/mca/common/libfabric/libfabric/include -D_GNU_SOURCE
> -DSYSCONFDIR=\"/scratch/hargrove/inst/etc\" -DRDMADI
> R=\"/tmp\" -DEXTDIR=\"/scratch/hargrove/inst/lib/openmpi\"
> -I../../../../../openmpi-dev-803-g5919b63 -I../../.
> ./.. -I../../../../../openmpi-dev-803-g5919b63/opal/include
> -I../../../../../openmpi-dev-803-g5919b63/orte/inc
> lude -I../../../../orte/include
> -I../../../../../openmpi-dev-803-g5919b63/ompi/include
> -I../../../../../openmp
> i-dev-803-g5919b63/oshmem/include
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/hwloc/hwloc191/hwloc
> /include -I/scratch/hargrove/bld/opal/mca/hwloc/hwloc191/hwloc/include
> -I/scratch/hargrove/openmpi-dev-803-g59
> 19b63/opal/mca/event/libevent2022/libevent
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/event/libeven
> t2022/libevent/include
> -I/scratch/hargrove/bld/opal/mca/event/libevent2022/libevent/include -g -c
> -o libfabric/src/libmca_common_libfabric_la-fi_tostr.lo `test -f
> 'libfabric/src/fi_tostr.c' || echo
> '../../../../../openmpi-dev-803-g5919b63/opal/mca/common/libfabric/'`libfabric/src/fi_tostr.c
> libtool: compile: pgcc -DHAVE_CONFIG_H -I.
> -I../../../../../openmpi-dev-803-g5919b63/opal/mca/common/libfabric
> -I../../../../opal/include -I../../../../ompi/include
> -I../../../../oshmem/include
> -I../../../../opal/mca/common/libfabric/libfabric
> -I../../../../opal/mca/hwloc/hwloc191/hwloc/include/private/autogen
> -I../../../../opal/mca/hwloc/hwloc191/hwloc/include/hwloc/autogen
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/include
> -D_GNU_SOURCE -DSYSCONFDIR=\"/scratch/hargrove/inst/etc\"
> -DRDMADIR=\"/tmp\" -DEXTDIR=\"/scratch/hargrove/inst/lib/openmpi\"
> -I../../../../../openmpi-dev-803-g5919b63 -I../../../..
> -I../../../../../openmpi-dev-803-g5919b63/opal/include
> -I../../../../../openmpi-dev-803-g5919b63/orte/include
> -I../../../../orte/include
> -I../../../../../openmpi-dev-803-g5919b63/ompi/include
> -I../../../../../openmpi-dev-803-g5919b63/oshmem/include
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/hwloc/hwloc191/hwloc/include
> -I/scratch/hargrove/bld/opal/mca/hwloc/hwloc191/hwloc/include
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/event/libevent2022/libevent
> -I/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/event/libevent2022/libevent/include
> -I/scratch/hargrove/bld/opal/mca/event/libevent2022/libevent/include -g -c
> ../../../../../openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/src/fi_tostr.c
> -MD -fpic -DPIC -o
> libfabric/src/.libs/libmca_common_libfabric_la-fi_tostr.o
> PGC-S-0040-Illegal use of symbol, pthread_mutex_t
> (/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/include/rdma/fi_eq.h:
> 75)
> PGC-W-0156-Type not specified, 'int' assumed
> (/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/include/rdma/fi_eq.h:
> 75)
> PGC-S-0040-Illegal use of symbol, pthread_cond_t
> (/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/include/rdma/fi_eq.h:
> 76)
> PGC-W-0156-Type not specified, 'int' assumed
> (/scratch/hargrove/openmpi-dev-803-g5919b63/opal/mca/common/libfabric/libfabric/include/rdma/fi_eq.h:
> 76)
> PGC-S-0043-Redefinition of symbol, pthread_mutex_t
> (/usr/include/x86_64-linux-gnu/bits/pthreadtypes.h: 104)
> PGC-S-0043-Redefinition of symbol, pthread_cond_t
> (/usr/include/x86_64-linux-gnu/bits/pthreadtypes.h: 130)
> PGC/x86-64 Linux 14.3-0: compilation completed with severe errors
> make[2]: *** [libfabric/src/libmca_common_libfabric_la-fi_tostr.lo] Error 1
>
>
>
> --
> Paul H. Hargrove phhargr...@lbl.gov
> Computer Languages & Systems Software (CLaSS) Group
> Computer Science Department Tel: +1-510-495-2352
> Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
>
--
Paul H. Hargrove phhargr...@lbl.gov
Computer Languages & Systems Software (CLaSS) Group
Computer Science Department Tel: +1-510-495-2352
Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
