Hmmm. ompi_info only shows the ucx pml. I don’t see any “transports”. Will
they show up somewhere or are they documented. Right now it looks like the
only UCX related thing I can do with openmpi 3.1.0 is
export OMPI_MCA_pml=ucx
mpiexec ….
From ompi_info…
$ ompi_info --param all all | more | grep ucx
MCA osc: ucx (MCA v2.1.0, API v3.0.0, Component v3.1.0)
MCA pml: ucx (MCA v2.1.0, API v2.0.0, Component v3.1.0)
I’m assuming there is more to it than that.
Regards,
Charlie
> On Jun 14, 2018, at 1:18 PM, Jeff Squyres (jsquyres) via users
> <users@lists.open-mpi.org> wrote:
>
> Charles --
>
> It may have gotten lost in the middle of this thread, but the
> vendor-recommended way of running on InfiniBand these days is with UCX.
> I.e., install OpenUCX and use one of the UCX transports in Open MPI. Unless
> you have special requirements, you should likely give this a try and see if
> it works for you.
>
> The libfabric / verbs combo *may* work, but I don't know how robust the verbs
> libfabric support was in the v1.5 release series.
>
>
>> On Jun 14, 2018, at 10:01 AM, Charles A Taylor <chas...@ufl.edu> wrote:
>>
>> Hi Matias,
>>
>> Thanks for the response.
>>
>> As of a couple of hours ago we are running:
>>
>> libfabric-devel-1.5.3-1.el7.x86_64
>> libfabric-1.5.3-1.el7.x86_64
>>
>> As for the provider, I saw that one but just listed “verbs”. I’ll go with
>> the “verbs;ofi_rxm” going forward.
>>
>> Regards,
>>
>> Charlie
>>
>>
>>> On Jun 14, 2018, at 12:49 PM, Cabral, Matias A <matias.a.cab...@intel.com>
>>> wrote:
>>>
>>> Hi Charles,
>>>
>>> What version of libfabric do you have installed? To run OMPI using the
>>> verbs provider you need to pair it with the ofi_rxm provider. fi_info
>>> should list it like:
>>> …
>>> provider: verbs;ofi_rxm
>>> …
>>>
>>> So in your command line you have to specify:
>>> mpirun -mca pml cm -mca mtl ofi -mca mtl_ofi_provider_include
>>> “verbs;ofi_rxm” ….
>>>
>>> (don’t skip the quotes)
>>>
>>
>> _______________________________________________
>> users mailing list
>> users@lists.open-mpi.org
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e=
>
>
> --
> Jeff Squyres
> jsquy...@cisco.com
>
> _______________________________________________
> users mailing list
> users@lists.open-mpi.org
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e=
_______________________________________________
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
