Florent, I agree with your description for the information I have already found through the use of -mca btl_base_verbose 10. I am requesting some way of obtaining the device selection and configuration information without the rest of the tracing.
As far as routing, I was not referring to the OS network routing, but the routing layer that must exist in OpenMPI. When OMPI must send a message from one process to another, it has to pick a path, namely the one among what may be several possibilities that it has decided is the shortest when mpirun started the run. The internal OMPI routing table would be a summary of all the device choices made my mpirun, I assume. Thank you, Larry Baker US Geological Survey 650-329-5608 ba...@usgs.gov > On Aug 19 2021, at 11:30:58 PM, GERMAIN, Florent <florent.germ...@atos.net> > wrote: > > > > This email has been received from outside of DOI - Use caution before > clicking on links, opening attachments, or responding. > > > > Hello, > Open MPI have given to you the only information it has: message is given to > mlx4_0:1. > As you are using InfiniBand network, the routing tables are handled by the ib > runtime. > You can gather information about ib routing through the ibroute command. > I hope it will help you. > > Florent Germain > Ingénieur de développement > florent.germ...@atos.net > 1 Rue de Provence > 38130 Echirolles > Atos.net > > -----Message d'origine----- > De : devel <devel-boun...@lists.open-mpi.org> De la part de Baker, Lawrence M > via devel > Envoyé : vendredi 20 août 2021 04:19 > À : Geoffrey Paulsen via devel <devel@lists.open-mpi.org> > Cc : Baker, Lawrence M <ba...@usgs.gov> > Objet : [OMPI devel] How to display device selection or routing info > > I am running into dead ends trying to find an mpirun option to display the > device selected for each process. I use > > mpirun --report-bindings > > to view the bindings to nodes/cpus/cores. But I cannot find an equivalent > option that displays the hardware path used for OpenMPI messaging. Or the > device parameters that go with that, if they are programmable. I have found > I can see the openib message selecting InfiniBand when I add > > -mca btl_base_verbose 10 > > [compute-0-30.local:02597] [rank=0] openib: using port mlx4_0:1 > > But, I get lots of other messages that are just noise for this purpose. > > There must be a routing table somewhere being constructed (ORTE?). I could > not find an MCA option to show that. > > Is there a better way to get this information? My Google searching has not > turned up anything. If not, I'd like to put in a request for an mpirun > option similar to --report-bindings that displays the routing table and/or > device bindings and programmable settings used. > > Thank you very much. > > Larry Baker > US Geological Survey > 650-329-5608 > ba...@usgs.gov > >
