On 09/12/2010 01:52 AM, Or Gerlitz wrote:
Hi Andy, looking on this net-next-2.6 patch, I wonder if you can
elaborate on your "significantly helps performance" comment - what
improvement you see with this patch?
> What about the QP/CQ memory, are they better be placed in node-local
> to the HCA manner?
Hi Or, I'm afraid I don't have exact numbers for you.. those changes
were part of a series of tweaks and fixes for bottlenecks in rds code.
On our numa box, the HCA is attached to a particular package of CPUs &
memory. Having the in-memory structures that the hca is accessing in
node-local RAM seemed to measurably help, although reducing contention
helped even more. Chris Mason says it seemed like init-time allocations
seemed to benefit while runtime allocations were not helped, or even hurt.
Clearly this is not enough data to go on, beyond the conclusion that yes
it's something that should be looked at more closely. Big machines are
still rather scarce, which makes it harder.
Regards -- Andy
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
