Sylvain Jeaugey wrote:
The XRC protocol seems to create shared receive queues, which is a
good thing. However, comparing memory used by an "X" queue versus
and "S" queue, we can see a large difference. Digging a bit into the
code, we found some
So, do you see that X consumes more that S ? This is really odd.
Yes, but that's what we see. At least after MPI_Init.
What is the difference (in Kb)?
strange things, like the completion queue size not being the same as
"S" queues (the patch below would fix it, but the root of the
problem may be elsewhere).
Is anyone able to comment on this ?
The fix looks ok, please submit it to trunk.
I don't have an account to do this, so I'll let maintainers push it
into SVN.
Ok, I will push it.
BTW do you want to prepare the patch for send queue size factor ? It
should be quite simple.
Maybe we can do this. However, we are a little playing with parameters
and code without really knowing the deep consequences of what we do.
Therefore, I would feel more confortable if someone who knows much on
the openib btl confirms it's not breaking everything.
Well, please feel free to submit a patch for review. Also if you see any
other issues with XRC, MLNX will be happy to help.
Regards,
Pasha.
