Below is from ompi_info: $ ompi_info --all | grep btl_openib_receive MCA btl: parameter "btl_openib_receive_queues" (current value: <P,128,256,192,128:S,2048,1024,1008,64:S,12288,1024,1008,64:S,65536,1024,1008,64>, data source: default value)
This tunning does make sense for me. # receive_queues = P,128,256,192,128:S,65536,256,192,128 Most likely it was not updated for a long time. I'm pretty sure the ompi_info version is the one that actually used. So comparing the two above, they don’t coincide, in particular for the SRQ settings. Thus, I gather the settings reported by ompi_info above are those that are actually used, and if so, I am wondering where/how they are derived? The idea behind this parameters is coming from here: http://www.open-mpi.org/papers/euro-pvmmpi-2007-ib/euro-pvmmpi-2007-ib.pdf And later on XRC support was introduced: http://www.open-mpi.org/papers/euro-pvmmpi-2008-xrc/euro-pvmmpi-2008-xrc.pdf Best, Pasha