Hi Richard,
I've built our OpenMPI with PGI 10.0 and included OpenIB support. I've verified
it works. You'll notice we build with UDAPL and OpenIB, but generally only
OpenIB is used.
Our complete configure flags, and OpenMPI is included with Scyld ClusterWare is
shown here:
./configure --prefix=%{_prefix} \
--bindir="%{_prefix}/${compiler}/bin" \
--datarootdir="%{_prefix}/${compiler}/share" \
--mandir="%{_prefix}/man" \
--sysconfdir="%{_sysconfdir}" \
--libdir="%{_libdir}/${compiler}" \
--includedir="%{_includedir}" \
--with-mx=/opt/open-mx \
--with-udapl \
--without-bproc \
--with-tm \
--with-openib \
--disable-dlopen \
${EXTRA_CONFIG_OPTIONS} \
--without-xgrid --without-slurm --without-loadleveler --without-gm
--without-lsf \
-Joshua Bernstein
Senior Software Engineer
Penguin Computing
Richard Walsh wrote:
All,
Not overwhelmed with responses here ... ;-) ... No one using PGI 10.0 yet?
We need it to make use of the GPU compiler directives they are supporting.
Can some perhaps comment on whether this is the correct way to configure
for an IB system? Everything works with Intel and/or if I compile without the
IB flags.
Sent the same report to PGI, but seems like the support team there is on
break for the Holidays.
Someone else must have seen this as well ... No ... ??
rbw
Richard Walsh
Parallel Applications and Systems Manager
CUNY HPC Center, Staten Island, NY
718-982-3319
612-382-4620
Mighty the Wizard
Who found me at sunrise
Sleeping, and woke me
And learn'd me Magic!
________________________________________
From: users-boun...@open-mpi.org [users-boun...@open-mpi.org] On Behalf Of
Richard Walsh [richard.wa...@csi.cuny.edu]
Sent: Saturday, December 19, 2009 12:18 PM
To: us...@open-mpi.org
Subject: [OMPI users] Problem compiling 1.4.0 snap with PGI 10.0-1 and openib
flags turned on ...
All,
Succeeded in overcoming the 'libtool' failure with PGI using
the patched snap (thanks Jeff), but now I am running
into a down stream problem compiling for our IB clusters.
I am using the latest PGI compiler (10.0-1) and the 12-14-09
snap of OpenMPI of version 1.4.0.
My configure line looks like this:
$ ./configure CC=pgcc CXX=pgCC F77=pgf77 FC=pgf90 --enable-openib-ibcm
--with-openib \
--prefix=/share/apps/openmpi-pgi/1.4.0 --with-tm=/share/apps/pbs/10.1.0.91350
The error I get during the make at about line 8078 is:
libtool: compile: pgcc -DHAVE_CONFIG_H -I. -I../../../../opal/include
-I../../../../orte/include -I../../../../ompi/include
-I../../../../opal/mca/paffinity/linux/plpa/src/libplpa -I../../../..
-D_REENTRANT -O -DNDEBUG -c connect/btl_openib_connect_xoob.c -fpic -DPIC -o
connect/.libs/btl_openib_connect_xoob.o
source='connect/btl_openib_connect_ibcm.c'
object='connect/btl_openib_connect_ibcm.lo' libtool=yes \
DEPDIR=.deps depmode=none /bin/sh ../../../../config/depcomp \
/bin/sh ../../../../libtool --tag=CC --mode=compile pgcc -DHAVE_CONFIG_H -I.
-I../../../../opal/include -I../../../../orte/include
-I../../../../ompi/include
-I../../../../opal/mca/paffinity/linux/plpa/src/libplpa -I../../../..
-D_REENTRANT -O -DNDEBUG -c -o connect/btl_openib_connect_ibcm.lo
connect/btl_openib_connect_ibcm.c
libtool: compile: pgcc -DHAVE_CONFIG_H -I. -I../../../../opal/include
-I../../../../orte/include -I../../../../ompi/include
-I../../../../opal/mca/paffinity/linux/plpa/src/libplpa -I../../../..
-D_REENTRANT -O -DNDEBUG -c connect/btl_openib_connect_ibcm.c -fpic -DPIC -o
connect/.libs/btl_openib_connect_ibcm.o
PGC-S-0040-Illegal use of symbol, __le64
(/usr/include/linux/byteorder/little_endian.h: 43)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/linux/byteorder/little_endian.h: 43)
PGC-S-0039-Use of undeclared variable __le64
(/usr/include/linux/byteorder/little_endian.h: 45)
PGC-S-0104-Non-numeric operand for multiplicative operator
(/usr/include/linux/byteorder/little_endian.h: 45)
PGC-S-0040-Illegal use of symbol, __le64
(/usr/include/linux/byteorder/little_endian.h: 47)
PGC-S-0040-Illegal use of symbol, __be64
(/usr/include/linux/byteorder/little_endian.h: 67)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/linux/byteorder/little_endian.h: 67)
PGC-S-0040-Illegal use of symbol, __be64
(/usr/include/linux/byteorder/little_endian.h: 69)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/linux/byteorder/little_endian.h: 69)PGC-S-0040-Illegal use of
symbol, __be64 (/usr/include/linux/byteorder/little_endian.h: 71)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/linux/byteorder/little_endian.h: 71)PGC/x86-64 Linux 10.0-1:
compilation completed with severe errors
make[2]: *** [connect/btl_openib_connect_ibcm.lo] Error 1
make[2]: Leaving directory
`/export/apps/openmpi-pgi/1.4.0/build/ompi/mca/btl/openib'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/export/apps/openmpi-pgi/1.4.0/build/ompi'
make: *** [all-recursive] Error 1
Compilation with the latest Intel compilers and these 'openib' options completes
without issue.
Are my configure options for 'openib' correct? Has anyone else see this?
Thanks much,
Richard Walsh
Parallel Applications and Systems Manager
CUNY HPC Center, Staten Island, NY
Mighty the Wizard
Who found me at sunrise
Sleeping, and woke me
And learn'd me Magic!
Think green before you print this email.
_______________________________________________
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
Think green before you print this email.
_______________________________________________
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
