Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
No errors in VPP. You need to debug your environment to trace where the packets are being dropped or stuck. From: on behalf of "long...@gmail.com" Date: Friday, April 8, 2022 at 2:34 AM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp Hi, this is vppctl sh error: [https://s3-us-west-1.amazonaws.com/groupsioattachments/12197/90135014/21225/0?AWSAccessKeyId=AKIAJECNKOVMCCU3ATNQ=1649382137=Fwra6GinrcULumKtSnGDpcX9Jzw%3D]root@ubuntu2004:/home/ubuntu# vppctl sh error Count Node Reason Severity 1809 l2-output L2 output packets error 1809 l2-input L2 input packets error 1 ip4-localip4 source lookup miss error 114 l2-output L2 output packets error 114 l2-input L2 input packets error 1 ethernet-inputno error On tcpdump server 192.168.56.1, it can not receive any message from 192.168.56.101 and always send arp to know who is 192.168.56.101, but no receive arp response -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21233): https://lists.fd.io/g/vpp-dev/message/21233 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi, this is vppctl sh error: root@ubuntu2004:/home/ubuntu# vppctl sh error Count Node Reason Severity 1809 l2-output L2 output packets error 1809 l2-input L2 input packets error 1 ip4-local ip4 source lookup miss error 114 l2-output L2 output packets error 114 l2-input L2 input packets error 1 ethernet-input no error *On tcpdump server 192.168.56.1, it can not receive any message from 192.168.56.101 and always send arp to know who is 192.168.56.101, but no receive arp response* -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21227): https://lists.fd.io/g/vpp-dev/message/21227 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: > > > > Please use tcpdump to trace on Linux side to see what is happening. Please > also check for error counters on Linux side. > > > > > > Hi Mohsin, After dump, *I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK.* *But server 192.168.56.1 can not receive any message from tap. In tcpdump at tap interface, tap ask who is 192.168.56.1 and below is vpp show trace when I ping from tap to 192.168.56.1, I see that* 0a:00:27:00:00:14 is mac address of 192.168.56.1 is in the trace but message can not go to 192.168.56.1 Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 *And this is vppctl sh error:* root@ubuntu2004:/home/ubuntu# vppctl sh error Count Node Reason Severity 1809 l2-output L2 output packets error 1809 l2-input L2 input packets error 1 ip4-local ip4 source lookup miss error 114 l2-output L2 output packets error 114 l2-input L2 input packets error 1 ethernet-input no error -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21225): https://lists.fd.io/g/vpp-dev/message/21225 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: > > > > Please use tcpdump to trace on Linux side to see what is happening. Please > also check for error counters on Linux side. > > > > > > Hi Mohsin, After dump, *I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK.* *But server 192.168.56.1 can not receive any message from tap. In tcpdump at tap interface, tap ask who is 192.168.56.1 and below is vpp show trace when I ping from tap to 192.168.56.1, I see that* 0a:00:27:00:00:14 is mac address of 192.168.56.1 is in the trace but message can not go to 192.168.56.1 Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 And this is vppctl sh error: root@ubuntu2004:/home/ubuntu# vppctl sh error Count Node Reason Severity 1809 l2-output L2 output packets error 1809 l2-input L2 input packets error 1 ip4-local ip4 source lookup miss error 114 l2-output L2 output packets error 114 l2-input L2 input packets error 1 ethernet-input no error -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21225): https://lists.fd.io/g/vpp-dev/message/21225 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: > > > > Please use tcpdump to trace on Linux side to see what is happening. Please > also check for error counters on Linux side. > > > > > > Hi Mohsin, After dump, *I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK.* *But server 192.168.56.1 can not receive any message from tap. In tcpdump at tap interface, tap ask who is 192.168.56.1 and below is vpp show trace when I ping from tap to 192.168.56.1, I see that* 0a:00:27:00:00:14 is mac address of 192.168.56.1 is in the trace but message can not go to 192.168.56.1 Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 And this is vppctl sh error: -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21225): https://lists.fd.io/g/vpp-dev/message/21225 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Please check error counters in VPP sh errors Please trace the packet using tcpdump on the server side too, if packets are being dropped in Linux. -br Mohsin From: on behalf of "long...@gmail.com" Date: Thursday, April 7, 2022 at 3:08 PM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp [Edited Message Follows] On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: Please use tcpdump to trace on Linux side to see what is happening. Please also check for error counters on Linux side. Hi Mohsin, After dump, I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK. But server 192.168.56.1 can not receive any message from tap. In tcpdump at tap interface, tap ask who is 192.168.56.1 and below is vpp show trace when I ping from tap to 192.168.56.1, I see that 0a:00:27:00:00:14 is mac address of 192.168.56.1 is in the trace but message can not go to 192.168.56.1 Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21226): https://lists.fd.io/g/vpp-dev/message/21226 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: > > > > Please use tcpdump to trace on Linux side to see what is happening. Please > also check for error counters on Linux side. > > > > > > Hi Mohsin, After dump, *I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK.* *But server 192.168.56.1 can not receive any message from tap. In tcpdump at tap interface, tap ask who is 192.168.56.1 and below is vpp show trace when I ping from tap to 192.168.56.1, I see that* 0a:00:27:00:00:14 is mac address of 192.168.56.1 is in the trace but message can not go to 192.168.56.1 Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21225): https://lists.fd.io/g/vpp-dev/message/21225 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
On Thu, Apr 7, 2022 at 06:44 PM, Mohsin Kazmi wrote: > > > > Please use tcpdump to trace on Linux side to see what is happening. Please > also check for error counters on Linux side. > > > > > > Hi Mohsin, After dump, *I see that on tap interface, it can receive ping message from 192.168.56.1 so the data way 192.168.56.1 -> NIC-> virtio-> tap is OK.* *But server 192.168.56.1 can not receive any message from tap. In tcpdump, tap ask who is 192.168.56.1 and below is trace when I ping from tap to 192.168.56.1:* Packet 3 00:09:45:753528: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:45:753533: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:45:753535: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:45:753539: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:45:753541: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:45:753543: virtio-0/0/8/0-tx buffer 0x94e56: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x202 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 Packet 4 00:09:46:777288: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:09:46:777293: ethernet-input ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 00:09:46:777296: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a [l2-output ] 00:09:46:777299: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:87:f0:2a:4a data 08 06 00 01 08 00 06 04 00 01 02 fe 00:09:46:777301: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 00:09:46:777303: virtio-0/0/8/0-tx buffer 0x94e7b: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x203 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:87:f0:2a:4a -> 0a:00:27:00:00:14 request, type ethernet/IP4, address size 6/4 02:fe:87:f0:2a:4a/192.168.56.101 -> 00:00:00:00:00:00/192.168.56.1 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21225): https://lists.fd.io/g/vpp-dev/message/21225 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi, The trace looks good to me. Please use tcpdump to trace on Linux side to see what is happening. Please also check for error counters on Linux side. -br Mohsin From: on behalf of "long...@gmail.com" Date: Thursday, April 7, 2022 at 2:57 AM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp On Thu, Apr 7, 2022 at 05:04 AM, Mohsin Kazmi wrote: trace add virtio-input 10 Hi Mohsin. This is the trace log: --- Start of thread 1 vpp_wk_0 --- Packet 1 00:25:26:931409: virtio-input virtio: hw_if_index 1 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:25:26:931412: ethernet-input ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff 00:25:26:931415: l2-input l2-input: sw_if_index 1 dst ff:ff:ff:ff:ff:ff src 0a:00:27:00:00:14 [l2-output ] 00:25:26:931418: l2-output l2-output: sw_if_index 2 dst ff:ff:ff:ff:ff:ff src 0a:00:27:00:00:14 data 08 06 00 01 08 00 06 04 00 01 0a 00 00:25:26:931420: tap0-output tap0 ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff request, type ethernet/IP4, address size 6/4 0a:00:27:00:00:14/192.168.56.1 -> 00:00:00:00:00:00/192.168.56.101 00:25:26:931422: tap0-tx buffer 0x963ba: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x100 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff request, type ethernet/IP4, address size 6/4 0a:00:27:00:00:14/192.168.56.1 -> 00:00:00:00:00:00/192.168.56.101 --- Start of thread 2 vpp_wk_1 --- Packet 1 00:25:26:931584: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:25:26:931587: ethernet-input ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 00:25:26:931588: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:4d:3e:ec:be [l2-output ] 00:25:26:931589: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:4d:3e:ec:be data 08 06 00 01 08 00 06 04 00 02 02 fe 00:25:26:931590: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 reply, type ethernet/IP4, address size 6/4 02:fe:4d:3e:ec:be/192.168.56.101 -> 0a:00:27:00:00:14/192.168.56.1 00:25:26:931591: virtio-0/0/8/0-tx buffer 0x93f04: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x200 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 reply, type ethernet/IP4, address size 6/4 02:fe:4d:3e:ec:be/192.168.56.101 -> 0a:00:27:00:00:14/192.168.56.1 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21221): https://lists.fd.io/g/vpp-dev/message/21221 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
On Thu, Apr 7, 2022 at 05:04 AM, Mohsin Kazmi wrote: > > trace add virtio-input 10 Hi Mohsin. This is the trace log: --- Start of thread 1 vpp_wk_0 --- Packet 1 00:25:26:931409: virtio-input virtio: hw_if_index 1 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:25:26:931412: ethernet-input ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff 00:25:26:931415: l2-input l2-input: sw_if_index 1 dst ff:ff:ff:ff:ff:ff src 0a:00:27:00:00:14 [l2-output ] 00:25:26:931418: l2-output l2-output: sw_if_index 2 dst ff:ff:ff:ff:ff:ff src 0a:00:27:00:00:14 data 08 06 00 01 08 00 06 04 00 01 0a 00 00:25:26:931420: tap0-output tap0 ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff request, type ethernet/IP4, address size 6/4 0a:00:27:00:00:14/192.168.56.1 -> 00:00:00:00:00:00/192.168.56.101 00:25:26:931422: tap0-tx buffer 0x963ba: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x100 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 0a:00:27:00:00:14 -> ff:ff:ff:ff:ff:ff request, type ethernet/IP4, address size 6/4 0a:00:27:00:00:14/192.168.56.1 -> 00:00:00:00:00:00/192.168.56.101 --- Start of thread 2 vpp_wk_1 --- Packet 1 00:25:26:931584: virtio-input virtio: hw_if_index 2 next-index 4 vring 0 len 42 hdr: flags 0x00 gso_type 0x00 hdr_len 0 gso_size 0 csum_start 0 csum_offset 0 num_buffers 1 00:25:26:931587: ethernet-input ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 00:25:26:931588: l2-input l2-input: sw_if_index 2 dst 0a:00:27:00:00:14 src 02:fe:4d:3e:ec:be [l2-output ] 00:25:26:931589: l2-output l2-output: sw_if_index 1 dst 0a:00:27:00:00:14 src 02:fe:4d:3e:ec:be data 08 06 00 01 08 00 06 04 00 02 02 fe 00:25:26:931590: virtio-0/0/8/0-output virtio-0/0/8/0 ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 reply, type ethernet/IP4, address size 6/4 02:fe:4d:3e:ec:be/192.168.56.101 -> 0a:00:27:00:00:14/192.168.56.1 00:25:26:931591: virtio-0/0/8/0-tx buffer 0x93f04: current data 0, length 42, buffer-pool 0, ref-count 1, totlen-nifb 0, trace handle 0x200 l2-hdr-offset 0 l3-hdr-offset 14 hdr-sz 0 l2-hdr-offset 0 l3-hdr-offset 14 l4-hdr-offset 0 l4-hdr-sz 0 ARP: 02:fe:4d:3e:ec:be -> 0a:00:27:00:00:14 reply, type ethernet/IP4, address size 6/4 02:fe:4d:3e:ec:be/192.168.56.101 -> 0a:00:27:00:00:14/192.168.56.1 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21219): https://lists.fd.io/g/vpp-dev/message/21219 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
You can check VPP error counters using: sh errors You can also trace the packet within VPP: Please add ‘trace add virtio-input 10’ before pinging through tap interface. Once you ping the desired IP address, please do ‘sh trace’. -br Mohsin From: on behalf of "long...@gmail.com" Date: Wednesday, April 6, 2022 at 8:59 AM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp [Edited Message Follows] Hi All, I created virtio interface and using l2 xconnect to connect it to tap interface: vppctl create int virtio :00:08.0 gso-enabled vppctl create tap id 0 host-ip4-addr 192.168.56.101/24 gso vppctl set interface l2 xconnect tap0 virtio-0/0/8/0 vppctl set interface l2 xconnect virtio-0/0/8/0 tap0 vppctl set interface state virtio-0/0/8/0 up vppctl set interface state tap0 up But currently I can not ping to 192.168.56.1(an external server gateway) through tap interface. Can you help me correct? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21218): https://lists.fd.io/g/vpp-dev/message/21218 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] Hi All, I created virtio interface and using l2 xconnect to connect it to tap interface: vppctl create int virtio :00:08.0 gso-enabled vppctl create tap id 0 host-ip4-addr 192.168.56.101/24 gso vppctl set interface l2 xconnect tap0 virtio-0/0/8/0 vppctl set interface l2 xconnect virtio-0/0/8/0 tap0 vppctl set interface state virtio-0/0/8/0 up vppctl set interface state tap0 up But currently I can not ping to 192.168.56.1(an external server gateway) through tap interface. Can you help me correct? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21206): https://lists.fd.io/g/vpp-dev/message/21206 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi Mohsin, I created virtio interface and using l2 xconnect to connect it to tap interface: vppctl create int virtio :00:08.0 gso-enabled vppctl create tap id 0 host-ip4-addr 192.168.56.101/24 gso vppctl set interface l2 xconnect tap0 virtio-0/0/8/0 vppctl set interface l2 xconnect virtio-0/0/8/0 tap0 vppctl set interface state virtio-0/0/8/0 up vppctl set interface state tap0 up But currently I can not ping to 192.168.56.1(an external server gateway) through tap interface. Can you help me correct? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21206): https://lists.fd.io/g/vpp-dev/message/21206 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi Mohsin, Thank you, After trying with dpdk as you said, the latency and throughput is still not better than without vpp ( use direct linux kernel). Is VPP native virtio interface better than linux kernel? Do you have an example benchmark of vpp virtio? Thank. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21202): https://lists.fd.io/g/vpp-dev/message/21202 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
virtio device is using Linux Kernel driver “virtio-pci”. You need to rebind it to ‘vfio-pci’ be able to use it in user-space. There is a rebinding script in vpp: https://git.fd.io/vpp/tree/extras/scripts/pci-nic-bind -br mohsin From: on behalf of "long...@gmail.com" Date: Thursday, March 31, 2022 at 5:50 PM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp Thank Mohsin, I create interface without DPDK like below: create int virtio :00:08.0 gso-enabl but I got error: create interface virtio: device not bound to 'vfio-pci' or 'uio_pci_generic' kernel module I tried modprobe virtio_pci but still got it. Do you know how to fix that? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21170): https://lists.fd.io/g/vpp-dev/message/21170 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] Thank Mohsin, I create interface without DPDK like below: > > create int virtio :00:08.0 gso-enabl > but I got *error* : *create interface virtio: device not bound to 'vfio-pci' or 'uio_pci_generic' kernel module * I tried modprobe virtio_pci but still got it. List pci in my server: root@ubuntu2004:/home/ubuntu# vppctl show pci Address Sock VID:PID Link Speed Driver Product Name Vital Product Data :00:03.0 0 8086:100e unknown e1000 :00:08.0 0 1af4:1000 unknown virtio-pci :00:09.0 0 1af4:1000 unknown virtio-pci Do you know how to fix that? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21169): https://lists.fd.io/g/vpp-dev/message/21169 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Thank Mohsin, I create interface without DPDK like below: > > create int virtio :00:08.0 gso-enabl > but I got *error* : *create interface virtio: device not bound to 'vfio-pci' or 'uio_pci_generic' kernel module * I tried modprobe virtio_pci but still got it. Do you know how to fix that? -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21169): https://lists.fd.io/g/vpp-dev/message/21169 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Forgot to mention, your config have enabled gso on tap interface while is not
enabled on dpdk interface.
Either enable it on dpdk interface if the underneath vhost device supports it.
or, disable it from tap interface too.
In case of vpp native virtio:
create int virtio :00:08.0 gso-enabled
From: on behalf of "Mohsin Kazmi via lists.fd.io"
Reply-To: "Mohsin Kazmi (sykazmi)"
Date: Thursday, March 31, 2022 at 4:54 PM
To: "long...@gmail.com" , "vpp-dev@lists.fd.io"
Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP
#vpp
Please add following to dpdk stanza in startup.conf
“DPDK { dev :00:08.0 { tso on } enable-tcp-udp-checksum }”
Or else try VPP native virtio without using dpdk:
create int virtio :00:08.0
From: on behalf of "long...@gmail.com"
Date: Thursday, March 31, 2022 at 4:40 PM
To: "vpp-dev@lists.fd.io"
Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP
#vpp
Hi Mohsin,
Please see below:
Can you please share the numbers you are getting?
Without VPP, I get 5Gbps. With VPP I get ~2Gbps.
And also please share the output of:
sh hardware
sh tap
sh threads
sh cpu
Please see in the attachments.
Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21167): https://lists.fd.io/g/vpp-dev/message/21167
Mute This Topic: https://lists.fd.io/mt/90135014/21656
Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Please add following to dpdk stanza in startup.conf
“DPDK { dev :00:08.0 { tso on } enable-tcp-udp-checksum }”
Or else try VPP native virtio without using dpdk:
create int virtio :00:08.0
From: on behalf of "long...@gmail.com"
Date: Thursday, March 31, 2022 at 4:40 PM
To: "vpp-dev@lists.fd.io"
Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP
#vpp
Hi Mohsin,
Please see below:
Can you please share the numbers you are getting?
Without VPP, I get 5Gbps. With VPP I get ~2Gbps.
And also please share the output of:
sh hardware
sh tap
sh threads
sh cpu
Please see in the attachments.
Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21166): https://lists.fd.io/g/vpp-dev/message/21166
Mute This Topic: https://lists.fd.io/mt/90135014/21656
Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi Mohsin, Please see below: > > > > Can you please share the numbers you are getting? > > *Without VPP, I get 5Gbps. With VPP I get ~2Gbps.* > > > > And also please share the output of: > > > > sh hardware > > > > sh tap > > > > sh threads > > > > sh cpu > > Please see in the attachments. Thank you. root@ubuntu2004:/home/ubuntu# vppctl sh hardware NameIdx Link Hardware enp0s8 1 up enp0s8 Link speed: 4294 Gbps RX Queues: queue thread mode 0 vpp_wk_0 (1) polling Ethernet address 08:00:27:76:f4:06 Red Hat Virtio carrier up full duplex mtu 9206 promisc flags: admin-up promisc pmd maybe-multiseg Devargs: rx: queues 1 (max 1), desc 256 (min 0 max 65535 align 1) tx: queues 1 (max 1), desc 256 (min 0 max 65535 align 1) pci: device 1af4:1000 subsystem 1af4:0001 address :00:08.00 numa 0 max rx packet len: 9728 promiscuous: unicast on all-multicast on vlan offload: strip off filter off qinq off rx offload avail: vlan-strip udp-cksum tcp-cksum tcp-lro vlan-filter jumbo-frame scatter rx offload active: jumbo-frame scatter tx offload avail: vlan-insert udp-cksum tcp-cksum tcp-tso multi-segs tx offload active: multi-segs rss avail: none rss active:none tx burst function: virtio_xmit_pkts rx burst function: virtio_recv_mergeable_pkts tx frames ok 47 tx bytes ok 5720 rx frames ok 9 rx bytes ok 770 extended stats: rx_good_packets 9 tx_good_packets 47 rx_good_bytes 770 tx_good_bytes 5720 rx_q0_packets9 rx_q0_bytes770 tx_q0_packets 47 tx_q0_bytes 5720 rx_q0_good_packets 9 rx_q0_good_bytes 770 rx_q0_undersize_packets 2 rx_q0_size_65_127_packets7 tx_q0_good_packets 47 tx_q0_good_bytes 5720 tx_q0_multicast_packets 38 tx_q0_broadcast_packets 1 tx_q0_undersize_packets 3 tx_q0_size_65_127_packets 29 tx_q0_size_128_255_packets 15 local0 0down local0 Link speed: unknown local tap0 2 up tap0 Link speed: unknown RX Queues: queue thread mode 0 vpp_wk_1 (2) polling Ethernet address 02:fe:f6:35:06:33 VIRTIO interface instance 0 root@ubuntu2004:/home/ubuntu# vppctl sh cpu Model name: AMD Ryzen 7 4800H with Radeon Graphics Microarch model (family): unknown (family 0x0f model 0x60) Flags:sse3 pclmulqdq ssse3 sse41 sse42 avx rdrand avx2 rdseed aes invariant_tsc Base frequency: 2.89 GHz oot@ubuntu2004:/home/ubuntu# vppctl sh tap Interface: tap0 (ifindex 2) name "tap0" host-ns "(nil)" host-mac-addr: 02:fe:fa:c8:b3:ca host-carrier-up: 1 vhost-fds 38 39 40 41 42 tap-fds 37 gso-enabled 1 csum-enabled 0 packet-coalesce 0 packet-buffering 0 Mac Address: 02:fe:f6:35:06:33 Device instance: 0 flags 0x1 admin-up (0) features 0x110008000 VIRTIO_NET_F_MRG_RXBUF (15) VIRTIO_RING_F_INDIRECT_DESC (28) VIRTIO_F_VERSION_1 (32) remote-features 0x33d008000 VIRTIO_NET_F_MRG_RXBUF (15) VIRTIO_F_NOTIFY_ON_EMPTY (24) VHOST_F_LOG_ALL (26) VIRTIO_F_ANY_LAYOUT (27) VIRTIO_RING_F_INDIRECT_DESC (28) VIRTIO_RING_F_EVENT_IDX (29) VIRTIO_F_VERSION_1 (32) VIRTIO_F_IOMMU_PLATFORM (33) Number of RX Virtqueue 1 Number of TX Virtqueue 5 Virtqueue (RX) 0 qsz 256, last_used_idx 60, desc_next 32, desc_in_use 228 avail.flags 0x1 avail.idx 288 used.flags 0x1 used.idx 60 kickfd 44, callfd 43 Virtqueue (TX) 1 qsz 256, last_used_idx 0, desc_next 0, desc_in_use 0 avail.flags 0x1 avail.idx 0 used.flags 0x0 used.idx 0 kickfd 45, callfd -1 Virtqueue (TX) 3 qsz 256, last_used_idx 20, desc_next 21, desc_in_use 1 avail.flags 0x1 avail.idx 21 used.flags 0x0 used.idx 21 kickfd 46, callfd -1 Virtqueue (TX) 5 qsz 256, last_used_idx 0, desc_next 0, desc_in_use 0 avail.flags 0x1 avail.idx 0 used.flags 0x0 used.idx 0 kickfd 47, callfd
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hi Jerome, > > you enabled gso but didn't turn gro on. IOW, in this mode, VPP accepts GSO > packets sent by linux but won't coalesce packets to reduce the load on > linux side. > You may be interested in this article > https://medium.com/fd-io-vpp/getting-to-40g-encrypted-container-networking-with-calico-vpp-on-commodity-hardware-d7144e52659a > even if it's not super recent. Anyway, if you application can support VCL, > it will certainly be much faster. I have read article you shared, It is very useful but I don't know to configure vpp to support virtio backend or enable GRO and how to enable multiple queue for tap interface. Do you know how to do that? Please share me, many thanks tp you -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21164): https://lists.fd.io/g/vpp-dev/message/21164 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hello, Can you please share the numbers you are getting? And also please share the output of: sh hardware sh tap sh threads sh cpu -br Mohsin From: on behalf of "long...@gmail.com" Date: Thursday, March 31, 2022 at 10:20 AM To: "vpp-dev@lists.fd.io" Subject: Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp Thank you Ole, NIC - VPP - BSD socket app (using LD_PRELOAD https://s3-docs.fd.io/vpp/22.02/developer/extras/vcl_ldpreload.html) ==> Can any my application (Java, Python,...) run on vlc ld preload like NIC - VPP - vcl ld_preload socket - application? But the answer here is very much "it depends". ==> What is it? Thank you very much for helping me! -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21160): https://lists.fd.io/g/vpp-dev/message/21160 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Hello, In your config you enabled gso but didn't turn gro on. IOW, in this mode, VPP accepts GSO packets sent by linux but won't coalesce packets to reduce the load on linux side. You may be interested in this article https://medium.com/fd-io-vpp/getting-to-40g-encrypted-container-networking-with-calico-vpp-on-commodity-hardware-d7144e52659a even if it's not super recent. Anyway, if you application can support VCL, it will certainly be much faster. Jerome -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21159): https://lists.fd.io/g/vpp-dev/message/21159 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Thank you Ole, > > NIC - VPP - BSD socket app (using LD_PRELOAD > https://s3-docs.fd.io/vpp/22.02/developer/extras/vcl_ldpreload.html > ) ==> Can any my application (Java, Python,...) run on vlc ld preload like NIC - VPP - vcl ld_preload socket - application? > > But the answer here is very much "it depends". > ==> What is it? Thank you very much for helping me! -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21158): https://lists.fd.io/g/vpp-dev/message/21158 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] Fastest way to connect application in user space to VPP #vpp
Dear Mr Longtrb, > I am a newbie in VPP. Many thanks to you all for making great Vpp. > I have many applications in user space (written by java, C, python,...) and I > want to connect those apps to VPP so what is the fastest way that VPP can > support without changing the application? > > I tried with tap create by VPP and cross connect it to a physical NIC, NIC is > bound by DPDK ( data path: NIC VPP - tap - application): > > vppctl create tap id 0 host-ip4-addr 192.168.56.110/24 gso > vppctl set interface tap0 ip address 192.168.56.110/24 > vppctl set interface l2 xconnect tap0 enp0s8 > vppctl set interface l2 xconnect enp0s8 tap0 > vppctl set interface state enp0s8 up > vppctl set interface state tap0 up > > But the bandwidth are lower and latency is higher than when I use real NIC ( > without VPP). > VPP is version 21.10, I use 4 workers. Server is ubuntu 20.04, tool test is > Iperf3. If you compare: NIC - Linux kernel - BSD socket app and NIC - VPP - Linux kernel - BSD socket app Then I would indeed expect the latter to be slower. NIC - VPP - BSD socket app (using LD_PRELOAD https://s3-docs.fd.io/vpp/22.02/developer/extras/vcl_ldpreload.html) is one option. But the answer here is very much "it depends". Best regards, Ole -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21156): https://lists.fd.io/g/vpp-dev/message/21156 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] Fastest way to connect application in user space to VPP #vpp
[Edited Message Follows] Dear vpp-dev teams, I am a newbie in VPP. Many thanks to you all for making great Vpp. I have many applications in user space (written by java, C, python,...) and I want to connect those apps to VPP so what is the fastest way that VPP can support without changing the application? I tried with tap create by VPP and cross connect it to a physical NIC, NIC is bound by DPDK ( data path: NIC VPP - tap - application): vppctl create tap id 0 host-ip4-addr 192.168.56.110/24 ( http://192.168.56.110/24 ) gso vppctl set interface tap0 ip address 192.168.56.110/24 ( http://192.168.56.110/24 ) vppctl set interface l2 xconnect tap0 enp0s8 vppctl set interface l2 xconnect enp0s8 tap0 vppctl set interface state enp0s8 up vppctl set interface state tap0 up But the bandwidth are lower and latency is higher than when I use real NIC ( without VPP). VPP is version 21.10, I use 4 workers. Server is ubuntu 20.04, tool test is Iperf3. Please help me , thank you very much. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21149): https://lists.fd.io/g/vpp-dev/message/21149 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] Fastest way to connect application in user space to VPP #vpp
Dear vpp-dev teams, I am a newbie in VPP. Many thanks to you all for making great Vpp. I have many applications in user space (written by java, C, python,...) and I want to connect those apps to VPP so what is the fastest way that VPP can support without changing the application? I tried with tap create by VPP and cross connect it to a physical NIC, NIC is binded by DPDK: vppctl create tap id 0 host-ip4-addr 192.168.56.110/24 ( http://192.168.56.110/24 ) gso vppctl set interface tap0 ip address 192.168.56.110/24 ( http://192.168.56.110/24 ) vppctl set interface l2 xconnect tap0 enp0s8 vppctl set interface l2 xconnect enp0s8 tap0 vppctl set interface state enp0s8 up vppctl set interface state tap0 up But the bandwidth are lower and latency is higher than use real NIC ( not using VPP). VPP is version 21.10. Please help me, thank you very much. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21149): https://lists.fd.io/g/vpp-dev/message/21149 Mute This Topic: https://lists.fd.io/mt/90135014/21656 Mute #vpp:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
