Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
I apologize. I did not realize that I did not reply to the list.
Going with the view this is a PGI problem, I noticed they recently
released version 18.10. I had just installed 18.7 within the last couple
weeks.
The problem is resolved in 18.10.
-Ray Muno
On 11/27/18 7:55 PM, Gilles Gouaillardet wrote:
Folks,
sorry for the late follow-up. The config.log was indeed sent offline.
Here is the relevant part :
configure:294375: checking for required lustre data structures
configure:294394: pgcc -O -DNDEBUG -Iyes/include -c conftest.c
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
157)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 157)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
158)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 158)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
159)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 159)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
160)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 160)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
161)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 161)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
162)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 162)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
163)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 163)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
164)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 164)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
211)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 211)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h:
212)
PGC-W-0156-Type not specified, 'int' assumed
(/usr/include/sys/quota.h: 212)
PGC/x86-64 Linux 18.7-0: compilation completed with severe errors
configure:294401: $? = 2
configure:294415: result: no
configure:294424: error: Lustre support requested but not found. Aborting
Here is the conftest.c that triggers the error
#include "lustre/lustreapi.h"
void alloc_lum()
{
int v1, v3;
v1 = sizeof(struct lov_user_md_v1) +
LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
v3 = sizeof(struct lov_user_md_v3) +
LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
}
The same code was reported to work with gcc compiler, so at that
stage, this looks like
a PGI or an environment issue (sometimes the sysadmin has to re-run
makelocalrc if some dependencies have changed),
so I recommend this error is submitted to PGI support.
I reviewed the code and filled a PR that get rids of the
"-Iyes/include" flag.
Merged or not, that does not fix the real issue here.
Cheers,
Gilles
On 11/28/2018 6:04 AM, Gabriel, Edgar wrote:
Gilles submitted a patch for that, and I approved it a couple of days
back, I *think* it has not been merged however. This was a bug in the
Open MPI Lustre configure logic, should be fixed after this one however.
https://github.com/open-mpi/ompi/pull/6080
Thanks
Edgar
-Original Message-
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of
Latham,
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
To: users@lists.open-mpi.org
Cc: Latham, Robert J. ; gi...@rist.or.jp
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using
PGI fails
On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote:
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this. Maybe Ray and
Giles took the
discusison off list? As someone who might have introduced the
offending
configure-time checks, I'm particularly interested in fixing lustre
detection.
==rob
Cheers,
Gilles
- Original Message -
I am trying to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary Lustre components with the PGI compiler.
I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can
build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
When specifying --with-lustre, I get:
--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h p
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Folks,
sorry for the late follow-up. The config.log was indeed sent offline.
Here is the relevant part :
configure:294375: checking for required lustre data structures
configure:294394: pgcc -O -DNDEBUG -Iyes/include -c conftest.c
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 157)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 158)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 159)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 160)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 161)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 162)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 163)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 164)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 211)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 212)
PGC/x86-64 Linux 18.7-0: compilation completed with severe errors
configure:294401: $? = 2
configure:294415: result: no
configure:294424: error: Lustre support requested but not found. Aborting
Here is the conftest.c that triggers the error
#include "lustre/lustreapi.h"
void alloc_lum()
{
int v1, v3;
v1 = sizeof(struct lov_user_md_v1) +
LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
v3 = sizeof(struct lov_user_md_v3) +
LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
}
The same code was reported to work with gcc compiler, so at that stage,
this looks like
a PGI or an environment issue (sometimes the sysadmin has to re-run
makelocalrc if some dependencies have changed),
so I recommend this error is submitted to PGI support.
I reviewed the code and filled a PR that get rids of the "-Iyes/include"
flag.
Merged or not, that does not fix the real issue here.
Cheers,
Gilles
On 11/28/2018 6:04 AM, Gabriel, Edgar wrote:
Gilles submitted a patch for that, and I approved it a couple of days back, I
*think* it has not been merged however. This was a bug in the Open MPI Lustre
configure logic, should be fixed after this one however.
https://github.com/open-mpi/ompi/pull/6080
Thanks
Edgar
-Original Message-
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham,
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
To: users@lists.open-mpi.org
Cc: Latham, Robert J. ; gi...@rist.or.jp
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote:
Raymond,
can you please compress and post your config.log ?
I didn't see the config.log in response to this. Maybe Ray and Giles took the
discusison off list? As someone who might have introduced the offending
configure-time checks, I'm particularly interested in fixing lustre detection.
==rob
Cheers,
Gilles
- Original Message -
I am trying to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).
It builds successfully with Intel compilers, but fails to find the
necessary Lustre components with the PGI compiler.
I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can
build
OpenMPI, but configure does not find the proper Lustre files.
Lustre is installed from current client RPMS, version 2.10.5
Include files are in /usr/include/lustre
When specifying --with-lustre, I get:
--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h presence... yes checking for
lustre/lustreapi.h... yes checking for library containing
llapi_file_create... -llustreapi checking if liblustreapi requires
libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting
--
Ray Muno
IT Manager
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however. https://github.com/open-mpi/ompi/pull/6080 Thanks Edgar > -Original Message- > From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham, > Robert J. via users > Sent: Tuesday, November 27, 2018 2:03 PM > To: users@lists.open-mpi.org > Cc: Latham, Robert J. ; gi...@rist.or.jp > Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails > > On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: > > Raymond, > > > > can you please compress and post your config.log ? > > I didn't see the config.log in response to this. Maybe Ray and Giles took the > discusison off list? As someone who might have introduced the offending > configure-time checks, I'm particularly interested in fixing lustre detection. > > ==rob > > > > > > > Cheers, > > > > Gilles > > > > - Original Message - > > > I am trying to build OpenMPI with Lustre support using PGI 18.7 on > > > CentOS 7.5 (1804). > > > > > > It builds successfully with Intel compilers, but fails to find the > > > necessary Lustre components with the PGI compiler. > > > > > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can > > > build > > > OpenMPI, but configure does not find the proper Lustre files. > > > > > > Lustre is installed from current client RPMS, version 2.10.5 > > > > > > Include files are in /usr/include/lustre > > > > > > When specifying --with-lustre, I get: > > > > > > --- MCA component fs:lustre (m4 configuration macro) checking for > > > MCA component fs:lustre compile mode... dso checking --with-lustre > > > value... simple ok (unspecified value) looking for header without > > > includes checking lustre/lustreapi.h usability... yes checking > > > lustre/lustreapi.h presence... yes checking for > > > lustre/lustreapi.h... yes checking for library containing > > > llapi_file_create... -llustreapi checking if liblustreapi requires > > > libnl v1 or v3... > > > checking for required lustre data structures... no > > > configure: error: Lustre support requested but not found. Aborting > > > > > > > > > -- > > > > > > Ray Muno > > > IT Manager > > > > > > > > >University of Minnesota > > > Aerospace Engineering and Mechanics Mechanical > > > Engineering > > > 110 Union St. S.E. 111 Church Street SE > > > Minneapolis, MN 55455 Minneapolis, MN 55455 > > > > > > ___ > > > users mailing list > > > users@lists.open-mpi.org > > > https://lists.open-mpi.org/mailman/listinfo/users > > > > ___ > > users mailing list > > users@lists.open-mpi.org > > https://lists.open-mpi.org/mailman/listinfo/users > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: > Raymond, > > can you please compress and post your config.log ? I didn't see the config.log in response to this. Maybe Ray and Giles took the discusison off list? As someone who might have introduced the offending configure-time checks, I'm particularly interested in fixing lustre detection. ==rob > > > Cheers, > > Gilles > > - Original Message - > > I am trying to build OpenMPI with Lustre support using PGI 18.7 > > on > > CentOS 7.5 (1804). > > > > It builds successfully with Intel compilers, but fails to find the > > necessary Lustre components with the PGI compiler. > > > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can > > build > > OpenMPI, but configure does not find the proper Lustre files. > > > > Lustre is installed from current client RPMS, version 2.10.5 > > > > Include files are in /usr/include/lustre > > > > When specifying --with-lustre, I get: > > > > --- MCA component fs:lustre (m4 configuration macro) > > checking for MCA component fs:lustre compile mode... dso > > checking --with-lustre value... simple ok (unspecified value) > > looking for header without includes > > checking lustre/lustreapi.h usability... yes > > checking lustre/lustreapi.h presence... yes > > checking for lustre/lustreapi.h... yes > > checking for library containing llapi_file_create... -llustreapi > > checking if liblustreapi requires libnl v1 or v3... > > checking for required lustre data structures... no > > configure: error: Lustre support requested but not found. Aborting > > > > > > -- > > > > Ray Muno > > IT Manager > > > > > >University of Minnesota > > Aerospace Engineering and Mechanics Mechanical > > Engineering > > 110 Union St. S.E. 111 Church Street SE > > Minneapolis, MN 55455 Minneapolis, MN 55455 > > > > ___ > > users mailing list > > users@lists.open-mpi.org > > https://lists.open-mpi.org/mailman/listinfo/users > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Raymond, can you please compress and post your config.log ? Cheers, Gilles - Original Message - > I am trying to build OpenMPI with Lustre support using PGI 18.7 on > CentOS 7.5 (1804). > > It builds successfully with Intel compilers, but fails to find the > necessary Lustre components with the PGI compiler. > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can build > OpenMPI, but configure does not find the proper Lustre files. > > Lustre is installed from current client RPMS, version 2.10.5 > > Include files are in /usr/include/lustre > > When specifying --with-lustre, I get: > > --- MCA component fs:lustre (m4 configuration macro) > checking for MCA component fs:lustre compile mode... dso > checking --with-lustre value... simple ok (unspecified value) > looking for header without includes > checking lustre/lustreapi.h usability... yes > checking lustre/lustreapi.h presence... yes > checking for lustre/lustreapi.h... yes > checking for library containing llapi_file_create... -llustreapi > checking if liblustreapi requires libnl v1 or v3... > checking for required lustre data structures... no > configure: error: Lustre support requested but not found. Aborting > > > -- > > Ray Muno > IT Manager > > >University of Minnesota > Aerospace Engineering and Mechanics Mechanical Engineering > 110 Union St. S.E. 111 Church Street SE > Minneapolis, MN 55455 Minneapolis, MN 55455 > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
