On Fri, Jan 20, 2012 at 9:39 AM, Albert Strasheim <[email protected]> wrote:
> Is there some kind of limit that would prevent me from registering
> more than 32 GiB worth of memory regions with ibv_reg_mr in
> libibverbs?
Yes, by default mlx4 allocates a limited amount of adapter resources
for tracking memory regions. I forget the exact limits but 32GB looks
reasonable...
In mlx4/main.c, there is
static struct mlx4_profile default_profile = {
.num_qp = 1 << 18,
.num_srq = 1 << 16,
.rdmarc_per_qp = 1 << 4,
.num_cq = 1 << 16,
.num_mcg = 1 << 13,
.num_mpt = 1 << 19,
.num_mtt = 1 << 20,
};
and I think if you bump num_mtt up a few powers of 2 (eg
1 << 22) then you should be able to register more.
(num_mpt controls the number of MRs but I guess 33 is
not near the limit of 512K yet ;)
- R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
