Re: [OMPI users] Unable to build Open MPI with external PMIx library support

2018-12-17 Thread Gilles Gouaillardet 

Eduardo,


By config.log, we mean the config.log automatically generated by your 
configure command


(e.g. not the output of the configure command)

this is a huge file, so please compress it


Cheers,


Gilles


this file should start with

This file contains any messages produced by compilers while
running configure, to aid debugging if configure makes a mistake.

It was created by Open MPI configure 4.0.0, which was
generated by GNU Autoconf 2.69.  Invocation command line was




On 12/17/2018 7:29 PM, Eduardo Rothe via users wrote:

Hi Howard,

Thank you for you reply. I have just re-executed the whole process and 
here is the config.log (in attachment to this message)!


Just for restating, when I use internal PMIx I get the following error 
while running mpirun (using Open MPI 4.0.0):


--
We were unable to find any usable plugins for the BFROPS framework. 
This PMIx
framework requires at least one plugin in order to operate. This can 
be caused

by any of the following:

* we were unable to build any of the plugins due to some combination
  of configure directives and available system support

* no plugin was selected due to some combination of MCA parameter
  directives versus built plugins (i.e., you excluded all the plugins
  that were built and/or could execute)

* the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
  "mca_base_component_path", is set and doesn't point to any location
  that includes at least one usable plugin for this framework.

Please check your installation and environment.
--

Regards,
Eduardo


On Saturday, 15 December 2018, 18:35:44 CET, Howard Pritchard 
 wrote:



Hi Eduardo

Could you post the config.log for the build with internal PMIx so we 
can figure that out first.


Howard

Eduardo Rothe via users > schrieb am Fr. 14. Dez. 2018 um 09:41:


Open MPI: 4.0.0
PMIx: 3.0.2
OS: Debian 9

I'm building a debian package for Open MPI and either I get the
following error messages while configuring:

      undefined reference to symbol 'dlopen@@GLIBC_2.2.5'
  undefined reference to symbol 'lt_dlopen'

when using the configure option:

      ./configure --with-pmix=/usr/lib/x86_64-linux-gnu/pmix

or otherwise, if I use the following configure options:

  ./configure --with-pmix=external
--with-pmix-libdir=/usr/lib/x86_64-linux-gnu/pmix

I have a successfull compile, but when running mpirun I get the
following message:

--
We were unable to find any usable plugins for the BFROPS
framework. This PMIx
framework requires at least one plugin in order to operate. This
can be caused
by any of the following:

* we were unable to build any of the plugins due to some combination
  of configure directives and available system support

* no plugin was selected due to some combination of MCA parameter
  directives versus built plugins (i.e., you excluded all the plugins
  that were built and/or could execute)

* the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
  "mca_base_component_path", is set and doesn't point to any location
  that includes at least one usable plugin for this framework.

Please check your installation and environment.
--

What I find most strange is that I get the same error message
(unable to find
any usable plugins for the BFROPS framework) even if I don't
configure
external PMIx support!

Can someone please hint me about what's going on?

Cheers!
___
users mailing list
users@lists.open-mpi.org 
https://lists.open-mpi.org/mailman/listinfo/users


___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] Unable to build Open MPI with external PMIx library support

2018-12-17 Thread Howard Pritchard 
HI Eduardo,

The config.log looked nominal.Could you try the following additional
options to the build with the internal PMIx builds:

--enable-orterun-prefix-by-default --disable-dlopen


?

Also, for the mpirun built using the internal PMIx,

could you check the output of ldd?


And just in case, check if the PMIX_INSTALL_PREFIX is

somehow being set?


Howard



Am Mo., 17. Dez. 2018 um 03:29 Uhr schrieb Eduardo Rothe <
eduardo.ro...@yahoo.co.uk>:

> Hi Howard,
>
> Thank you for you reply. I have just re-executed the whole process and
> here is the config.log (in attachment to this message)!
>
> Just for restating, when I use internal PMIx I get the following error
> while running mpirun (using Open MPI 4.0.0):
>
> --
> We were unable to find any usable plugins for the BFROPS framework. This
> PMIx
> framework requires at least one plugin in order to operate. This can be
> caused
> by any of the following:
>
> * we were unable to build any of the plugins due to some combination
>   of configure directives and available system support
>
> * no plugin was selected due to some combination of MCA parameter
>   directives versus built plugins (i.e., you excluded all the plugins
>   that were built and/or could execute)
>
> * the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
>   "mca_base_component_path", is set and doesn't point to any location
>   that includes at least one usable plugin for this framework.
>
> Please check your installation and environment.
> --
>
> Regards,
> Eduardo
>
>
> On Saturday, 15 December 2018, 18:35:44 CET, Howard Pritchard <
> hpprit...@gmail.com> wrote:
>
>
> Hi Eduardo
>
> Could you post the config.log for the build with internal PMIx so we can
> figure that out first.
>
> Howard
>
> Eduardo Rothe via users  schrieb am Fr. 14.
> Dez. 2018 um 09:41:
>
> Open MPI: 4.0.0
> PMIx: 3.0.2
> OS: Debian 9
>
> I'm building a debian package for Open MPI and either I get the following
> error messages while configuring:
>
>   undefined reference to symbol 'dlopen@@GLIBC_2.2.5'
>   undefined reference to symbol 'lt_dlopen'
>
> when using the configure option:
>
>   ./configure --with-pmix=/usr/lib/x86_64-linux-gnu/pmix
>
> or otherwise, if I use the following configure options:
>
>   ./configure --with-pmix=external
> --with-pmix-libdir=/usr/lib/x86_64-linux-gnu/pmix
>
> I have a successfull compile, but when running mpirun I get the following
> message:
>
> --
> We were unable to find any usable plugins for the BFROPS framework. This
> PMIx
> framework requires at least one plugin in order to operate. This can be
> caused
> by any of the following:
>
> * we were unable to build any of the plugins due to some combination
>   of configure directives and available system support
>
> * no plugin was selected due to some combination of MCA parameter
>   directives versus built plugins (i.e., you excluded all the plugins
>   that were built and/or could execute)
>
> * the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
>   "mca_base_component_path", is set and doesn't point to any location
>   that includes at least one usable plugin for this framework.
>
> Please check your installation and environment.
> --
>
> What I find most strange is that I get the same error message (unable to
> find
> any usable plugins for the BFROPS framework) even if I don't configure
> external PMIx support!
>
> Can someone please hint me about what's going on?
>
> Cheers!
> ___
> users mailing list
> users@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/users
>
>
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] Limit to number of asynchronous sends/receives?

2018-12-17 Thread Barrett, Brian via users 
Adam -

There are a couple of theoretical limits on how many requests you can have 
outstanding (at some point, you will run the host out of memory).  However, 
those issues should be a problem when posting the MPI_Isend or MPI_Irecv, not 
during MPI_Waitall.  2.1.0 is pretty old; the first step in further debugging 
is to upgrade to one of the recent releases (3.1.3 or 4.0.0) and verify that 
the bug still exists.

Brian

> On Dec 16, 2018, at 6:52 AM, Adam Sylvester  wrote:
> 
> I'm running OpenMPI 2.1.0 on RHEL 7 using TCP communication.  For the 
> specific run that's crashing on me, I'm running with 17 ranks (on 17 
> different physical machines).  I've got a stage in my application where ranks 
> need to transfer chunks of data where the size of each chunk is trivial (on 
> the order of 100 MB) compared to the overall imagery.  However, the chunks 
> are spread out across many buffers in a way that makes the indexing 
> complicated (and the memory is not all within a single buffer)... the 
> simplest way to express the data movement in code is by a large number of 
> MPI_Isend() and MPI_Ireceive() calls followed of course by an eventual 
> MPI_Waitall().  This works fine for many cases, but I've run into a case now 
> where the chunks are imbalanced such that a few ranks have a total of ~450 
> MPI_Request objects (I do a single MPI_Waitall() with all requests at once) 
> and the remaining ranks have < 10 MPI_Requests.  In this scenario, I get a 
> seg fault inside PMPI_Waitall().
> 
> Is there an implementation limit as to how many asynchronous requests are 
> allowed?  Is there a way this can be queried either via a #define value or 
> runtime call?  I probably won't go this route, but when initially compiling 
> OpenMPI, is there a configure option to increase it?
> 
> I've done a fair amount of debugging and am pretty confident this is where 
> the error is occurring as opposed to indexing out of bounds somewhere, but if 
> there is no such limit in OpenMPI, that would be useful to know too.
> 
> Thanks.
> -Adam
> ___
> users mailing list
> users@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/users

___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users

Re: [OMPI users] Unable to build Open MPI with external PMIx library support

2018-12-17 Thread Eduardo Rothe via users 
Hi Howard,

Thank you for you reply. I have just re-executed the whole process and here is 
the config.log (in attachment to this message)!

Just for restating, when I use internal PMIx I get the following error while 
running mpirun (using Open MPI 4.0.0):

--
We were unable to find any usable plugins for the BFROPS framework. This PMIx
framework requires at least one plugin in order to operate. This can be caused
by any of the following:

* we were unable to build any of the plugins due to some combination
  of configure directives and available system support

* no plugin was selected due to some combination of MCA parameter
  directives versus built plugins (i.e., you excluded all the plugins
  that were built and/or could execute)

* the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
  "mca_base_component_path", is set and doesn't point to any location
  that includes at least one usable plugin for this framework.

Please check your installation and environment.
--

Regards,
Eduardo
 

On Saturday, 15 December 2018, 18:35:44 CET, Howard Pritchard 
 wrote:  
 
 Hi Eduardo
Could you post the config.log for the build with internal PMIx so we can figure 
that out first.
Howard
Eduardo Rothe via users  schrieb am Fr. 14. Dez. 2018 
um 09:41:

Open MPI: 4.0.0
PMIx: 3.0.2
OS: Debian 9

I'm building a debian package for Open MPI and either I get the following error 
messages while configuring:

      undefined reference to symbol 'dlopen@@GLIBC_2.2.5'
  undefined reference to symbol 'lt_dlopen'

when using the configure option:

      ./configure --with-pmix=/usr/lib/x86_64-linux-gnu/pmix

or otherwise, if I use the following configure options:

  ./configure --with-pmix=external 
--with-pmix-libdir=/usr/lib/x86_64-linux-gnu/pmix

I have a successfull compile, but when running mpirun I get the following 
message:

--
We were unable to find any usable plugins for the BFROPS framework. This PMIx
framework requires at least one plugin in order to operate. This can be caused
by any of the following:

* we were unable to build any of the plugins due to some combination
  of configure directives and available system support

* no plugin was selected due to some combination of MCA parameter
  directives versus built plugins (i.e., you excluded all the plugins
  that were built and/or could execute)

* the PMIX_INSTALL_PREFIX environment variable, or the MCA parameter
  "mca_base_component_path", is set and doesn't point to any location
  that includes at least one usable plugin for this framework.

Please check your installation and environment.
--

What I find most strange is that I get the same error message (unable to find
any usable plugins for the BFROPS framework) even if I don't configure 
external PMIx support!

Can someone please hint me about what's going on?

Cheers!
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
  

config.log.gz
Description: application/gzip
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users