Re: [OMPI devel] Hints for using an own pmix server

2018-10-12 Thread Stephan Krempel
Hallo Ralph, > I assume this (--with-ompi-mpix-rte) is a typo as the correct option > is —with-ompi-pmix-rte? You were right, this was a typo, with the correct option I now managed to start an MPI helloworld program using OpenMPI and our own process manager with pmix server. > It all looks okay

[OMPI devel] GPUDirect RDMA/Async for DL Acceleration (MPI)

2018-10-12 Thread Jaco Joubert
Good day All, My hypothesis is that with a SmartNIC offloading the CPU, some benefits of Infiniband can also be achieved with Ethernet and I am looking for information regarding fully supporting GPUDirect on the NIC's side. I was able to DMA between a SmartNIC and a V100 GPU through PCIe. However

Re: [OMPI devel] Hints for using an own pmix server

2018-10-12 Thread Ralph H Castain
Hi Stephan > On Oct 12, 2018, at 2:25 AM, Stephan Krempel wrote: > > Hallo Ralph, > >> I assume this (--with-ompi-mpix-rte) is a typo as the correct option >> is —with-ompi-pmix-rte? > > You were right, this was a typo, with the correct option I now managed > to start an MPI helloworld progra

Re: [OMPI devel] Hints for using an own pmix server

2018-10-12 Thread Ralph H Castain
I took a look at the following: >> A remark to pmix at this point: pmix_bfrops_base_value_load() does >> silently not handle PMIX_DATA_ARRAY type leading to not working makros >> PMIX_VALUE_LOAD and PMIX_INFO_LOAD with that type. I think this is >> unlucky and took me a while to figure out why it