Do you use SRIOV VFs? If so make spoof-checking etc. is off. See https://s3-docs.fd.io/vpp/23.02/developer/devicedrivers/rdma.html for more details.
Best ben > -----Original Message----- > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of r...@gmx.net > Sent: Friday, January 6, 2023 15:38 > To: vpp-dev@lists.fd.io > Subject: [vpp-dev] Using TrafficGen with rdma driver > > Hey VPP community, > > anyone out there using TRex setup with rdma driver? > The setup works just fine on legacy DPDK drivers, as documented here > https://fd.io/docs/vpp/v2101/usecases/simpleperf/trex.html > > Once switching over to rdma ( as advised for Mellanox cards) I get the > TRex warning that "Failed resolving dest MAC for default gateway" aka ARP > resolve failed. > > My tested debugging: > - traces show that ARP resolution works just fine within VPP > - set same MAC address to rdma interface as the real MAC > - changing to mac-based TRex config ( xconnect aka l2fwd ) shows same > issue, but I can see VPP correctly forwarding > - it appears that the host blocks somehow the ARP response outbound ( rdma > security settings? Trusted flags missing ? ) > > existing working cfg for DPDK driver: > {quote} > set interface ip address HundredGigabitEthernet4b/0/0 10.10.1.1/24 > set interface ip address HundredGigabitEthernet4b/0/1 10.10.2.1/24 > set interface state HundredGigabitEthernet4b/0/0 up > set interface state HundredGigabitEthernet4b/0/1 up > ip route add 16.0.0.0/8 via 10.10.1.2 > ip route add 48.0.0.0/8 via 10.10.2.2 > {quote} > > - vs - *failed rdma based* : > {quote} > create int rdma host-if ens3f0np0 name HundredGigabitEthernet4b/0/0 > create int rdma host-if ens3f1np1 name HundredGigabitEthernet4b/0/1 > # giving same MAC address as host NIC `ip link show` b8:ce:f6:01:XXXX > set interface mac address HundredGigabitEthernet4b/0/0 b8:ce:f6:01:XXXX > set interface mac address HundredGigabitEthernet4b/0/1 b8:ce:f6:01:XXXX > > set interface ip address HundredGigabitEthernet4b/0/0 10.10.1.1/24 > set interface ip address HundredGigabitEthernet4b/0/1 10.10.2.1/24 > set interface state HundredGigabitEthernet4b/0/0 up > set interface state HundredGigabitEthernet4b/0/1 up > ip route add 16.0.0.0/8 via 10.10.1.2 > ip route add 48.0.0.0/8 via 10.10.2.2 > {quote} > > Sent using the mobile mail app
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22425): https://lists.fd.io/g/vpp-dev/message/22425 Mute This Topic: https://lists.fd.io/mt/96094182/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
