> I could get LACP bonding working with RDMA driver now. I was going through
> the RDMA plugin code and found there is a concept of "mode" in RDMA
> interfaces. When I modified the interface command like below, I could see
> the LACP bonding working:-
> vpp# create int rdma host-if eth1 mode ibv
> vpp# create int rdma host-if eth2 mode ibv

Hmm that's unexpected.

> I was trying to find some documentation on rdma interface modes and their
> types i.e. auto, ibv and dv. But could not find any documentation on them.
> What does this mode and its type mean in terms of RDMA interfaces?

There is some here: 
https://s3-docs.fd.io/vpp/23.02/developer/devicedrivers/rdma.html#direct-verb-mode
But I agree it's a bit too elliptic 😊

The rdma driver use the Linux RDMA subsystem to access the NIC. The "normal" 
way to interact with it is through the libibverb library. It's still userspace 
polling (no syscall) but the libibverb add overhead (descriptors translation 
etc).
Mellanox also supports a mode calls direct verbs, which allows to use libibverb 
for the initialization, but then allows direct HW access for the datapath, 
which is more efficient.
The rdma mode refers to the libibverb datapath as "ibv" and the direct verb 
datapath as "dv".

That said, ibv and dv modes should behave similarly...

Best
ben
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22430): https://lists.fd.io/g/vpp-dev/message/22430
Mute This Topic: https://lists.fd.io/mt/94956154/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to