Re: [OMPI users] OpenMPI 4.3 without ucx

2020-05-10 Thread Gilles Gouaillardet via users
Patrick,

what is the error when no environment variable is set?

can you double check you do not have an old mca_pml_ucx.so in your
//GCC9.3/openmpi/4.0.3/lib/openmpi directory?

Cheers,

Gilles

On Sun, May 10, 2020 at 4:43 PM Patrick Bégou via users
 wrote:
>
> Hi all,
>
> I've built OpenMPI 4.3.0 with GCC 9.3.0 but on the server ucx was not 
> available when I set --with-ucx. I remove this option and it compiles fine 
> without ucx. However I have a strange behavior as when using mpirun I must 
> explicitely remove ucx to avoid an error: in my module file I have to set
>
> setenv OMPI_MCA_pml ^ucx
> setenv OMPI_MCA_btl_openib_allow_ib 1
>
> Is this the normal behavior or a small bug when ucx is not used ? I saw a 
> discussion about this but it was before OpenMPI 4.2.0 release.
>
> Patrick
>
> From ompi_info:
>
> Configure command line: '--with-lustre' '--with-slurm' '--with-hwloc' 
> '--enable-mpirun-prefix-by-default' '--prefix=//GCC9.3/openmpi/4.0.3' 
>   '--with-pmi' '--enable-mpi1-compatibility'
> 
> MCA btl: openib (MCA v2.1.0, API v3.1.0, Component v4.0.3)
> MCA btl: tcp (MCA v2.1.0, API v3.1.0, Component v4.0.3)
> MCA btl: vader (MCA v2.1.0, API v3.1.0, Component v4.0.3)
> MCA btl: self (MCA v2.1.0, API v3.1.0, Component v4.0.3)
>


[OMPI users] OpenMPI 4.3 without ucx

2020-05-10 Thread Patrick Bégou via users
Hi all,

I've built OpenMPI 4.3.0 with GCC 9.3.0 but on the server ucx was not
available when I set --with-ucx. I remove this option and it compiles
fine without ucx. However I have a strange behavior as when using mpirun
I must explicitely remove ucx to avoid an error: in my module file I
have to set

setenv         OMPI_MCA_pml ^ucx
setenv         OMPI_MCA_btl_openib_allow_ib 1

Is this the normal behavior or a small bug when ucx is not used ? I saw
a discussion about this but it was before OpenMPI 4.2.0 release.

Patrick

>From ompi_info:

Configure command line: '--with-lustre' '--with-slurm' '--with-hwloc'
'--enable-mpirun-prefix-by-default'
'--prefix=//GCC9.3/openmpi/4.0.3'   '--with-pmi'
'--enable-mpi1-compatibility'

MCA btl: openib (MCA v2.1.0, API v3.1.0, Component v4.0.3)
MCA btl: tcp (MCA v2.1.0, API v3.1.0, Component v4.0.3)
MCA btl: vader (MCA v2.1.0, API v3.1.0, Component v4.0.3)
MCA btl: self (MCA v2.1.0, API v3.1.0, Component v4.0.3)