[OMPI users] Bottleneck of OpenMPI over 100Gbps ROCE

Hi all, Sorry for resubmitting this problem because I found I didn't add the subject in the last email. I encountered a problem when I tested the performance of OpenMPI over ROCE 100Gbps. I have two servers connected with mellanox 100Gbps Connect-X4 ROCE NICs on them. I used intel mpi benchmark

[OMPI users] (no subject)

Hi all, I encountered a problem when I tested the performance of OpenMPI over ROCE 100Gbps. I have two servers connected with mellanox 100Gbps Connect-X4 ROCE NICs on them. I used intel mpi benchmark to test the performance of OpenMPI (1.10.3) over RDMA. I found the bandwidth of benchmark

Re: [OMPI users] Bottleneck of OpenMPI over 100Gbps ROCE

Hi Joshua, Thank you very much for your help. I reply the email so late because I wanted to confirm the provided solution with MXM before that. However, unfortunately, I haven't used MXM correctly so far (two servers cannot communicate with MXM). I'll tell you if MXM solves the problem after I