Inquiring about how btl_openib_receive_queues actually gets its default
setting, since what I am seeing is not joving with documentation. We are using
OpenMPI 1.6.5, but I gather the version is moot.
Below is from ompi_info:
$ ompi_info --all | grep btl_openib_receive
MCA btl: parameter "btl_openib_receive_queues" (current value:
<P,128,256,192,128:S,2048,1024,1008,64:S,12288,1024,1008,64:S,65536,1024,1008,64>,
data source: default value)
And based on the IB HCA part ID, this is the entry in
mca-btl-openib-device-params.ini which is applicable:
# A.k.a. ConnectX
[Mellanox Hermon]
vendor_id = 0x2c9,0x5ad,0x66a,0x8f1,0x1708,0x03ba,0x15b3,0x119f
vendor_part_id =
25408,25418,25428,25448,26418,26428,26438,26448,26468,26478,26488,4099,4103,4100
use_eager_rdma = 1
mtu = 2048
max_inline_data = 128
Yet according to the doc in mca-btl-openib-device-params.ini, the default
setting if receive_queues is not specified should be:
# receive_queues = P,128,256,192,128:S,65536,256,192,128
So comparing the two above, they don't coincide, in particular for the SRQ
settings. Thus, I gather the settings reported by ompi_info above are those
that are actually used, and if so, I am wondering where/how they are derived?
--john
