Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
I apologize. I did not realize that I did not reply to the list. Going with the view this is a PGI problem, I noticed they recently released version 18.10. I had just installed 18.7 within the last couple weeks. The problem is resolved in 18.10. -Ray Muno On 11/27/18 7:55 PM, Gilles Gouaillardet wrote: Folks, sorry for the late follow-up. The config.log was indeed sent offline. Here is the relevant part : configure:294375: checking for required lustre data structures configure:294394: pgcc -O -DNDEBUG -Iyes/include -c conftest.c PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 157) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 158) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 159) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 160) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 161) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 162) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 163) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 164) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 211) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 212) PGC/x86-64 Linux 18.7-0: compilation completed with severe errors configure:294401: $? = 2 configure:294415: result: no configure:294424: error: Lustre support requested but not found. Aborting Here is the conftest.c that triggers the error #include "lustre/lustreapi.h" void alloc_lum() { int v1, v3; v1 = sizeof(struct lov_user_md_v1) + LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1); v3 = sizeof(struct lov_user_md_v3) + LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1); } The same code was reported to work with gcc compiler, so at that stage, this looks like a PGI or an environment issue (sometimes the sysadmin has to re-run makelocalrc if some dependencies have changed), so I recommend this error is submitted to PGI support. I reviewed the code and filled a PR that get rids of the "-Iyes/include" flag. Merged or not, that does not fix the real issue here. Cheers, Gilles On 11/28/2018 6:04 AM, Gabriel, Edgar wrote: Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however. https://github.com/open-mpi/ompi/pull/6080 Thanks Edgar -Original Message- From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham, Robert J. via users Sent: Tuesday, November 27, 2018 2:03 PM To: users@lists.open-mpi.org Cc: Latham, Robert J. ; gi...@rist.or.jp Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: Raymond, can you please compress and post your config.log ? I didn't see the config.log in response to this. Maybe Ray and Giles took the discusison off list? As someone who might have introduced the offending configure-time checks, I'm particularly interested in fixing lustre detection. ==rob Cheers, Gilles - Original Message - I am trying to build OpenMPI with Lustre support using PGI 18.7 on CentOS 7.5 (1804). It builds successfully with Intel compilers, but fails to find the necessary Lustre components with the PGI compiler. I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can build OpenMPI, but configure does not find the proper Lustre files. Lustre is installed from current client RPMS, version 2.10.5 Include files are in /usr/include/lustre When specifying --with-lustre, I get: --- MCA component fs:lustre (m4 configuration macro) checking for MCA component fs:lustre compile mode... dso checking --with-lustre value... simple ok (unspecified value) looking for header without includes checking lustre/lustreapi.h usability... yes checking lustre/lustreapi.h p
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Folks, sorry for the late follow-up. The config.log was indeed sent offline. Here is the relevant part : configure:294375: checking for required lustre data structures configure:294394: pgcc -O -DNDEBUG -Iyes/include -c conftest.c PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 157) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 158) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 159) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 160) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 161) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 162) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 163) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 164) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 211) PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212) PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 212) PGC/x86-64 Linux 18.7-0: compilation completed with severe errors configure:294401: $? = 2 configure:294415: result: no configure:294424: error: Lustre support requested but not found. Aborting Here is the conftest.c that triggers the error #include "lustre/lustreapi.h" void alloc_lum() { int v1, v3; v1 = sizeof(struct lov_user_md_v1) + LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1); v3 = sizeof(struct lov_user_md_v3) + LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1); } The same code was reported to work with gcc compiler, so at that stage, this looks like a PGI or an environment issue (sometimes the sysadmin has to re-run makelocalrc if some dependencies have changed), so I recommend this error is submitted to PGI support. I reviewed the code and filled a PR that get rids of the "-Iyes/include" flag. Merged or not, that does not fix the real issue here. Cheers, Gilles On 11/28/2018 6:04 AM, Gabriel, Edgar wrote: Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however. https://github.com/open-mpi/ompi/pull/6080 Thanks Edgar -Original Message- From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham, Robert J. via users Sent: Tuesday, November 27, 2018 2:03 PM To: users@lists.open-mpi.org Cc: Latham, Robert J. ; gi...@rist.or.jp Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: Raymond, can you please compress and post your config.log ? I didn't see the config.log in response to this. Maybe Ray and Giles took the discusison off list? As someone who might have introduced the offending configure-time checks, I'm particularly interested in fixing lustre detection. ==rob Cheers, Gilles - Original Message - I am trying to build OpenMPI with Lustre support using PGI 18.7 on CentOS 7.5 (1804). It builds successfully with Intel compilers, but fails to find the necessary Lustre components with the PGI compiler. I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can build OpenMPI, but configure does not find the proper Lustre files. Lustre is installed from current client RPMS, version 2.10.5 Include files are in /usr/include/lustre When specifying --with-lustre, I get: --- MCA component fs:lustre (m4 configuration macro) checking for MCA component fs:lustre compile mode... dso checking --with-lustre value... simple ok (unspecified value) looking for header without includes checking lustre/lustreapi.h usability... yes checking lustre/lustreapi.h presence... yes checking for lustre/lustreapi.h... yes checking for library containing llapi_file_create... -llustreapi checking if liblustreapi requires libnl v1 or v3... checking for required lustre data structures... no configure: error: Lustre support requested but not found. Aborting -- Ray Muno IT Manager
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Gilles submitted a patch for that, and I approved it a couple of days back, I *think* it has not been merged however. This was a bug in the Open MPI Lustre configure logic, should be fixed after this one however. https://github.com/open-mpi/ompi/pull/6080 Thanks Edgar > -Original Message- > From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham, > Robert J. via users > Sent: Tuesday, November 27, 2018 2:03 PM > To: users@lists.open-mpi.org > Cc: Latham, Robert J. ; gi...@rist.or.jp > Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails > > On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: > > Raymond, > > > > can you please compress and post your config.log ? > > I didn't see the config.log in response to this. Maybe Ray and Giles took the > discusison off list? As someone who might have introduced the offending > configure-time checks, I'm particularly interested in fixing lustre detection. > > ==rob > > > > > > > Cheers, > > > > Gilles > > > > - Original Message - > > > I am trying to build OpenMPI with Lustre support using PGI 18.7 on > > > CentOS 7.5 (1804). > > > > > > It builds successfully with Intel compilers, but fails to find the > > > necessary Lustre components with the PGI compiler. > > > > > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can > > > build > > > OpenMPI, but configure does not find the proper Lustre files. > > > > > > Lustre is installed from current client RPMS, version 2.10.5 > > > > > > Include files are in /usr/include/lustre > > > > > > When specifying --with-lustre, I get: > > > > > > --- MCA component fs:lustre (m4 configuration macro) checking for > > > MCA component fs:lustre compile mode... dso checking --with-lustre > > > value... simple ok (unspecified value) looking for header without > > > includes checking lustre/lustreapi.h usability... yes checking > > > lustre/lustreapi.h presence... yes checking for > > > lustre/lustreapi.h... yes checking for library containing > > > llapi_file_create... -llustreapi checking if liblustreapi requires > > > libnl v1 or v3... > > > checking for required lustre data structures... no > > > configure: error: Lustre support requested but not found. Aborting > > > > > > > > > -- > > > > > > Ray Muno > > > IT Manager > > > > > > > > >University of Minnesota > > > Aerospace Engineering and Mechanics Mechanical > > > Engineering > > > 110 Union St. S.E. 111 Church Street SE > > > Minneapolis, MN 55455 Minneapolis, MN 55455 > > > > > > ___ > > > users mailing list > > > users@lists.open-mpi.org > > > https://lists.open-mpi.org/mailman/listinfo/users > > > > ___ > > users mailing list > > users@lists.open-mpi.org > > https://lists.open-mpi.org/mailman/listinfo/users > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote: > Raymond, > > can you please compress and post your config.log ? I didn't see the config.log in response to this. Maybe Ray and Giles took the discusison off list? As someone who might have introduced the offending configure-time checks, I'm particularly interested in fixing lustre detection. ==rob > > > Cheers, > > Gilles > > - Original Message - > > I am trying to build OpenMPI with Lustre support using PGI 18.7 > > on > > CentOS 7.5 (1804). > > > > It builds successfully with Intel compilers, but fails to find the > > necessary Lustre components with the PGI compiler. > > > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can > > build > > OpenMPI, but configure does not find the proper Lustre files. > > > > Lustre is installed from current client RPMS, version 2.10.5 > > > > Include files are in /usr/include/lustre > > > > When specifying --with-lustre, I get: > > > > --- MCA component fs:lustre (m4 configuration macro) > > checking for MCA component fs:lustre compile mode... dso > > checking --with-lustre value... simple ok (unspecified value) > > looking for header without includes > > checking lustre/lustreapi.h usability... yes > > checking lustre/lustreapi.h presence... yes > > checking for lustre/lustreapi.h... yes > > checking for library containing llapi_file_create... -llustreapi > > checking if liblustreapi requires libnl v1 or v3... > > checking for required lustre data structures... no > > configure: error: Lustre support requested but not found. Aborting > > > > > > -- > > > > Ray Muno > > IT Manager > > > > > >University of Minnesota > > Aerospace Engineering and Mechanics Mechanical > > Engineering > > 110 Union St. S.E. 111 Church Street SE > > Minneapolis, MN 55455 Minneapolis, MN 55455 > > > > ___ > > users mailing list > > users@lists.open-mpi.org > > https://lists.open-mpi.org/mailman/listinfo/users > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
Raymond, can you please compress and post your config.log ? Cheers, Gilles - Original Message - > I am trying to build OpenMPI with Lustre support using PGI 18.7 on > CentOS 7.5 (1804). > > It builds successfully with Intel compilers, but fails to find the > necessary Lustre components with the PGI compiler. > > I have tried building OpenMPI 4.0.0, 3.1.3 and 2.1.5. I can build > OpenMPI, but configure does not find the proper Lustre files. > > Lustre is installed from current client RPMS, version 2.10.5 > > Include files are in /usr/include/lustre > > When specifying --with-lustre, I get: > > --- MCA component fs:lustre (m4 configuration macro) > checking for MCA component fs:lustre compile mode... dso > checking --with-lustre value... simple ok (unspecified value) > looking for header without includes > checking lustre/lustreapi.h usability... yes > checking lustre/lustreapi.h presence... yes > checking for lustre/lustreapi.h... yes > checking for library containing llapi_file_create... -llustreapi > checking if liblustreapi requires libnl v1 or v3... > checking for required lustre data structures... no > configure: error: Lustre support requested but not found. Aborting > > > -- > > Ray Muno > IT Manager > > >University of Minnesota > Aerospace Engineering and Mechanics Mechanical Engineering > 110 Union St. S.E. 111 Church Street SE > Minneapolis, MN 55455 Minneapolis, MN 55455 > > ___ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users ___ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users