> I could get LACP bonding working with RDMA driver now. I was going through > the RDMA plugin code and found there is a concept of "mode" in RDMA > interfaces. When I modified the interface command like below, I could see > the LACP bonding working:- > vpp# create int rdma host-if eth1 mode ibv > vpp# create int rdma host-if eth2 mode ibv
Hmm that's unexpected. > I was trying to find some documentation on rdma interface modes and their > types i.e. auto, ibv and dv. But could not find any documentation on them. > What does this mode and its type mean in terms of RDMA interfaces? There is some here: https://s3-docs.fd.io/vpp/23.02/developer/devicedrivers/rdma.html#direct-verb-mode But I agree it's a bit too elliptic 😊 The rdma driver use the Linux RDMA subsystem to access the NIC. The "normal" way to interact with it is through the libibverb library. It's still userspace polling (no syscall) but the libibverb add overhead (descriptors translation etc). Mellanox also supports a mode calls direct verbs, which allows to use libibverb for the initialization, but then allows direct HW access for the datapath, which is more efficient. The rdma mode refers to the libibverb datapath as "ibv" and the direct verb datapath as "dv". That said, ibv and dv modes should behave similarly... Best ben
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22430): https://lists.fd.io/g/vpp-dev/message/22430 Mute This Topic: https://lists.fd.io/mt/94956154/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-