Aw, sheesh. Thanks. Somehow I missed that despite being on the page - lack of focus, I guess.
Best, Charlie > On Jun 14, 2018, at 4:38 PM, Pavel Shamis <pasharesea...@gmail.com> wrote: > > You just have to switch PML to UCX. > You have some example of the command line here: > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openucx_ucx_wiki_OpenMPI-2Dand-2DOpenSHMEM-2Dinstallation-2Dwith-2DUCX&d=DwIFaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=8sBODgXZKw_dNqkFqkTqbGD3_7nNlm_pat-D6AqiaC8&m=AtjVGlnk5Sxl6o7bcEa0LnFxgfmLD0qjnMKDqvn085s&s=2BFC-oRO8l3PwqI2eZFfGzFCa4eVxg8xmlx3adKzjug&e= > > <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openucx_ucx_wiki_OpenMPI-2Dand-2DOpenSHMEM-2Dinstallation-2Dwith-2DUCX&d=DwMFaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=69tLaZgRut2phhUywsZ7EtczOR47D8Jb5O22ESQO_TI&s=cop4oKioc-d7X7CFVHdWTiX4p6tsnD7V-uT7JdSnIdw&e=> > Best, > P. > > > On Thu, Jun 14, 2018 at 3:25 PM Charles A Taylor <chas...@ufl.edu > <mailto:chas...@ufl.edu>> wrote: > Hmmm. ompi_info only shows the ucx pml. I don’t see any “transports”. > Will they show up somewhere or are they documented. Right now it looks like > the only UCX related thing I can do with openmpi 3.1.0 is > > export OMPI_MCA_pml=ucx > mpiexec …. > > From ompi_info… > > $ ompi_info --param all all | more | grep ucx > MCA osc: ucx (MCA v2.1.0, API v3.0.0, Component v3.1.0) > MCA pml: ucx (MCA v2.1.0, API v2.0.0, Component v3.1.0) > > I’m assuming there is more to it than that. > > Regards, > > Charlie > > > > On Jun 14, 2018, at 1:18 PM, Jeff Squyres (jsquyres) via users > > <users@lists.open-mpi.org <mailto:users@lists.open-mpi.org>> wrote: > > > > Charles -- > > > > It may have gotten lost in the middle of this thread, but the > > vendor-recommended way of running on InfiniBand these days is with UCX. > > I.e., install OpenUCX and use one of the UCX transports in Open MPI. > > Unless you have special requirements, you should likely give this a try and > > see if it works for you. > > > > The libfabric / verbs combo *may* work, but I don't know how robust the > > verbs libfabric support was in the v1.5 release series. > > > > > >> On Jun 14, 2018, at 10:01 AM, Charles A Taylor <chas...@ufl.edu > >> <mailto:chas...@ufl.edu>> wrote: > >> > >> Hi Matias, > >> > >> Thanks for the response. > >> > >> As of a couple of hours ago we are running: > >> > >> libfabric-devel-1.5.3-1.el7.x86_64 > >> libfabric-1.5.3-1.el7.x86_64 > >> > >> As for the provider, I saw that one but just listed “verbs”. I’ll go with > >> the “verbs;ofi_rxm” going forward. > >> > >> Regards, > >> > >> Charlie > >> > >> > >>> On Jun 14, 2018, at 12:49 PM, Cabral, Matias A <matias.a.cab...@intel.com > >>> <mailto:matias.a.cab...@intel.com>> wrote: > >>> > >>> Hi Charles, > >>> > >>> What version of libfabric do you have installed? To run OMPI using the > >>> verbs provider you need to pair it with the ofi_rxm provider. fi_info > >>> should list it like: > >>> … > >>> provider: verbs;ofi_rxm > >>> … > >>> > >>> So in your command line you have to specify: > >>> mpirun -mca pml cm -mca mtl ofi -mca mtl_ofi_provider_include > >>> “verbs;ofi_rxm” …. > >>> > >>> (don’t skip the quotes) > >>> > >> > >> _______________________________________________ > >> users mailing list > >> users@lists.open-mpi.org <mailto:users@lists.open-mpi.org> > >> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e= > >> > >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e=> > > > > > > -- > > Jeff Squyres > > jsquy...@cisco.com <mailto:jsquy...@cisco.com> > > > > _______________________________________________ > > users mailing list > > users@lists.open-mpi.org <mailto:users@lists.open-mpi.org> > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e= > > > > <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e=> > > _______________________________________________ > users mailing list > users@lists.open-mpi.org <mailto:users@lists.open-mpi.org> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIFaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=8sBODgXZKw_dNqkFqkTqbGD3_7nNlm_pat-D6AqiaC8&m=AtjVGlnk5Sxl6o7bcEa0LnFxgfmLD0qjnMKDqvn085s&s=obTbUGDsuj5GUQPwfuYpI53sxcmmrGIwCanNJdS2u7U&e= > > <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwMFaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=69tLaZgRut2phhUywsZ7EtczOR47D8Jb5O22ESQO_TI&s=fosrNjkTo6gAC9OJRXHUA5V2HLVeRxi9BbVD2ZjGAtQ&e=>_______________________________________________ > users mailing list > users@lists.open-mpi.org > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwICAg&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=69tLaZgRut2phhUywsZ7EtczOR47D8Jb5O22ESQO_TI&s=fosrNjkTo6gAC9OJRXHUA5V2HLVeRxi9BbVD2ZjGAtQ&e=
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
