Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails

2018-11-27 Thread Gilles Gouaillardet

Folks,


sorry for the late follow-up. The config.log was indeed sent offline.


Here is the relevant part :


configure:294375: checking for required lustre data structures
configure:294394: pgcc -O -DNDEBUG   -Iyes/include -c conftest.c
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 157)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 157)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 158)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 158)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 159)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 159)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 160)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 160)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 161)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 161)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 162)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 162)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 163)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 163)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 164)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 164)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 211)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 211)
PGC-S-0040-Illegal use of symbol, u_int64_t (/usr/include/sys/quota.h: 212)
PGC-W-0156-Type not specified, 'int' assumed (/usr/include/sys/quota.h: 212)
PGC/x86-64 Linux 18.7-0: compilation completed with severe errors
configure:294401: $? = 2
configure:294415: result: no
configure:294424: error: Lustre support requested but not found. Aborting


Here is the conftest.c that triggers the error

#include "lustre/lustreapi.h"
void alloc_lum()
{
  int v1, v3;
  v1 = sizeof(struct lov_user_md_v1) +
   LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
  v3 = sizeof(struct lov_user_md_v3) +
    LOV_MAX_STRIPE_COUNT * sizeof(struct lov_user_ost_data_v1);
}


The same code was reported to work with gcc compiler, so at that stage, 
this looks like


a PGI or an environment issue (sometimes the sysadmin has to re-run 
makelocalrc if some dependencies have changed),


so I recommend this error is submitted to PGI support.


I reviewed the code and filled a PR that get rids of the "-Iyes/include" 
flag.


Merged or not, that does not fix the real issue here.


Cheers,


Gilles


On 11/28/2018 6:04 AM, Gabriel, Edgar wrote:

Gilles submitted a patch for that, and I approved it a couple of days back, I 
*think* it has not been merged however. This was a bug in the Open MPI Lustre 
configure logic, should be fixed after this one however.

https://github.com/open-mpi/ompi/pull/6080

Thanks
Edgar


-Original Message-
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham,
Robert J. via users
Sent: Tuesday, November 27, 2018 2:03 PM
To: users@lists.open-mpi.org
Cc: Latham, Robert J. ; gi...@rist.or.jp
Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails

On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote:

Raymond,

can you please compress and post your config.log ?

I didn't see the config.log in response to this.  Maybe Ray and Giles took the
discusison off list?  As someone who might have introduced the offending
configure-time checks, I'm particularly interested in fixing lustre detection.

==rob



Cheers,

Gilles

- Original Message -

I am trying  to build OpenMPI with Lustre support using PGI 18.7 on
CentOS 7.5 (1804).

It builds successfully with Intel compilers, but fails to find the
necessary  Lustre components with the PGI compiler.

I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can
build
OpenMPI, but configure does not find the proper Lustre files.

Lustre is installed from current client RPMS, version 2.10.5

Include files are in /usr/include/lustre

When specifying --with-lustre, I get:

--- MCA component fs:lustre (m4 configuration macro) checking for
MCA component fs:lustre compile mode... dso checking --with-lustre
value... simple ok (unspecified value) looking for header without
includes checking lustre/lustreapi.h usability... yes checking
lustre/lustreapi.h presence... yes checking for
lustre/lustreapi.h... yes checking for library containing
llapi_file_create... -llustreapi checking if liblustreapi requires
libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting


--

   Ray Muno
   IT Manager


University of Minnesota
   Aerospace Engineering and Mechanics Mechanical
Engineering

Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails

2018-11-27 Thread Gabriel, Edgar
Gilles submitted a patch for that, and I approved it a couple of days back, I 
*think* it has not been merged however. This was a bug in the Open MPI Lustre 
configure logic, should be fixed after this one however.

https://github.com/open-mpi/ompi/pull/6080

Thanks
Edgar

> -Original Message-
> From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Latham,
> Robert J. via users
> Sent: Tuesday, November 27, 2018 2:03 PM
> To: users@lists.open-mpi.org
> Cc: Latham, Robert J. ; gi...@rist.or.jp
> Subject: Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails
> 
> On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote:
> > Raymond,
> >
> > can you please compress and post your config.log ?
> 
> I didn't see the config.log in response to this.  Maybe Ray and Giles took the
> discusison off list?  As someone who might have introduced the offending
> configure-time checks, I'm particularly interested in fixing lustre detection.
> 
> ==rob
> 
> >
> >
> > Cheers,
> >
> > Gilles
> >
> > - Original Message -
> > > I am trying  to build OpenMPI with Lustre support using PGI 18.7 on
> > > CentOS 7.5 (1804).
> > >
> > > It builds successfully with Intel compilers, but fails to find the
> > > necessary  Lustre components with the PGI compiler.
> > >
> > > I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can
> > > build
> > > OpenMPI, but configure does not find the proper Lustre files.
> > >
> > > Lustre is installed from current client RPMS, version 2.10.5
> > >
> > > Include files are in /usr/include/lustre
> > >
> > > When specifying --with-lustre, I get:
> > >
> > > --- MCA component fs:lustre (m4 configuration macro) checking for
> > > MCA component fs:lustre compile mode... dso checking --with-lustre
> > > value... simple ok (unspecified value) looking for header without
> > > includes checking lustre/lustreapi.h usability... yes checking
> > > lustre/lustreapi.h presence... yes checking for
> > > lustre/lustreapi.h... yes checking for library containing
> > > llapi_file_create... -llustreapi checking if liblustreapi requires
> > > libnl v1 or v3...
> > > checking for required lustre data structures... no
> > > configure: error: Lustre support requested but not found. Aborting
> > >
> > >
> > > --
> > >
> > >   Ray Muno
> > >   IT Manager
> > >
> > >
> > >University of Minnesota
> > >   Aerospace Engineering and Mechanics Mechanical
> > > Engineering
> > >   110 Union St. S.E.  111 Church Street SE
> > >   Minneapolis, MN 55455   Minneapolis, MN 55455
> > >
> > > ___
> > > users mailing list
> > > users@lists.open-mpi.org
> > > https://lists.open-mpi.org/mailman/listinfo/users
> >
> > ___
> > users mailing list
> > users@lists.open-mpi.org
> > https://lists.open-mpi.org/mailman/listinfo/users
> 
> ___
> users mailing list
> users@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/users
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users


Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails

2018-11-27 Thread Latham, Robert J. via users
On Tue, 2018-11-13 at 21:57 -0600, gil...@rist.or.jp wrote:
> Raymond,
> 
> can you please compress and post your config.log ?

I didn't see the config.log in response to this.  Maybe Ray and Giles
took the discusison off list?  As someone who might have introduced the
offending configure-time checks, I'm particularly interested in fixing
lustre detection.

==rob

> 
> 
> Cheers,
> 
> Gilles
> 
> - Original Message -
> > I am trying  to build OpenMPI with Lustre support using PGI 18.7
> > on 
> > CentOS 7.5 (1804).
> > 
> > It builds successfully with Intel compilers, but fails to find the 
> > necessary  Lustre components with the PGI compiler.
> > 
> > I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can
> > build 
> > OpenMPI, but configure does not find the proper Lustre files.
> > 
> > Lustre is installed from current client RPMS, version 2.10.5
> > 
> > Include files are in /usr/include/lustre
> > 
> > When specifying --with-lustre, I get:
> > 
> > --- MCA component fs:lustre (m4 configuration macro)
> > checking for MCA component fs:lustre compile mode... dso
> > checking --with-lustre value... simple ok (unspecified value)
> > looking for header without includes
> > checking lustre/lustreapi.h usability... yes
> > checking lustre/lustreapi.h presence... yes
> > checking for lustre/lustreapi.h... yes
> > checking for library containing llapi_file_create... -llustreapi
> > checking if liblustreapi requires libnl v1 or v3...
> > checking for required lustre data structures... no
> > configure: error: Lustre support requested but not found. Aborting
> > 
> > 
> > -- 
> >   
> >   Ray Muno
> >   IT Manager
> >   
> > 
> >University of Minnesota
> >   Aerospace Engineering and Mechanics Mechanical
> > Engineering
> >   110 Union St. S.E.  111 Church Street SE
> >   Minneapolis, MN 55455   Minneapolis, MN 55455
> > 
> > ___
> > users mailing list
> > users@lists.open-mpi.org
> > https://lists.open-mpi.org/mailman/listinfo/users
> 
> ___
> users mailing list
> users@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/users

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users


Re: [OMPI users] Building OpenMPI with Lustre support using PGI fails

2018-11-13 Thread gilles
Raymond,

can you please compress and post your config.log ?


Cheers,

Gilles

- Original Message -
> I am trying  to build OpenMPI with Lustre support using PGI 18.7 on 
> CentOS 7.5 (1804).
> 
> It builds successfully with Intel compilers, but fails to find the 
> necessary  Lustre components with the PGI compiler.
> 
> I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can build 
> OpenMPI, but configure does not find the proper Lustre files.
> 
> Lustre is installed from current client RPMS, version 2.10.5
> 
> Include files are in /usr/include/lustre
> 
> When specifying --with-lustre, I get:
> 
> --- MCA component fs:lustre (m4 configuration macro)
> checking for MCA component fs:lustre compile mode... dso
> checking --with-lustre value... simple ok (unspecified value)
> looking for header without includes
> checking lustre/lustreapi.h usability... yes
> checking lustre/lustreapi.h presence... yes
> checking for lustre/lustreapi.h... yes
> checking for library containing llapi_file_create... -llustreapi
> checking if liblustreapi requires libnl v1 or v3...
> checking for required lustre data structures... no
> configure: error: Lustre support requested but not found. Aborting
> 
> 
> -- 
>   
>   Ray Muno
>   IT Manager
>   
> 
>University of Minnesota
>   Aerospace Engineering and Mechanics Mechanical Engineering
>   110 Union St. S.E.  111 Church Street SE
>   Minneapolis, MN 55455   Minneapolis, MN 55455
> 
> ___
> users mailing list
> users@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/users
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users


[OMPI users] Building OpenMPI with Lustre support using PGI fails

2018-11-13 Thread Raymond Muno
I am trying  to build OpenMPI with Lustre support using PGI 18.7 on 
CentOS 7.5 (1804).


It builds successfully with Intel compilers, but fails to find the 
necessary  Lustre components with the PGI compiler.


I have tried building  OpenMPI 4.0.0, 3.1.3 and 2.1.5.   I can build 
OpenMPI, but configure does not find the proper Lustre files.


Lustre is installed from current client RPMS, version 2.10.5

Include files are in /usr/include/lustre

When specifying --with-lustre, I get:

--- MCA component fs:lustre (m4 configuration macro)
checking for MCA component fs:lustre compile mode... dso
checking --with-lustre value... simple ok (unspecified value)
looking for header without includes
checking lustre/lustreapi.h usability... yes
checking lustre/lustreapi.h presence... yes
checking for lustre/lustreapi.h... yes
checking for library containing llapi_file_create... -llustreapi
checking if liblustreapi requires libnl v1 or v3...
checking for required lustre data structures... no
configure: error: Lustre support requested but not found. Aborting


--
 
 Ray Muno

 IT Manager
 


  University of Minnesota
 Aerospace Engineering and Mechanics Mechanical Engineering
 110 Union St. S.E.  111 Church Street SE
 Minneapolis, MN 55455   Minneapolis, MN 55455

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users