Re: [vpp-dev] "tx frame not ready " error in host-vpp1out tx
Hi Mohsin I have find the root cause of this issue. VPP send a huge malform packet to linux kernel, the memcpy in VNET_DEVICE_CLASS_TX_FN (af_packet_device_class) overwrite the tx_ring Thanks Guangming zhangguangm...@baicells.com From: Mohsin Kazmi via lists.fd.io Date: 2022-11-21 19:00 To: vpp-dev@lists.fd.io Subject: Re: [vpp-dev] "tx frame not ready " error in host-vpp1out tx Hi Guangming, What is the VPP version are you using? -br Mohsin From: on behalf of Guangming Reply-To: "vpp-dev@lists.fd.io" Date: Tuesday, November 8, 2022 at 8:01 AM To: "Mohsin Kazmi (sykazmi)" , vpp-dev Subject: [vpp-dev] "tx frame not ready " error in host-vpp1out tx Hi,Mohsin I used linux veth pari interface as af-packet interfeace in vpp. When the vpp run for some time, there are many "tx frame not ready " error in host-vpp1out-tx. If there is error, we can not ping from linux side to vpp side. Must need restart vpp to restore. From old mail. you say "tx frame not ready" means VPP didn't find empty queue at linux side. But in my envirment ,the trafiic is not big .Could give me some clues? vvp# monitor interface host-vpp1out interval 1 count 10 rx: 34.74Kpps 294.82Mbps tx: 17.68Kpps 32.39Mbps rx: 42.78Kpps 372.72Mbps tx: 19.97Kpps 37.45Mbps rx: 38.29Kpps 322.97Mbps tx: 18.50Kpps 33.34Mbps rx: 33.73Kpps 273.07Mbps tx: 16.19Kpps 35.59Mbps rx: 37.39Kpps 317.19Mbps tx: 15.38Kpps 33.30Mbps rx: 33.81Kpps 274.42Mbps tx: 16.21Kpps 34.01Mbps rx: 39.40Kpps 339.30Mbps tx: 16.12Kpps 33.15Mbps rx: 37.98Kpps 330.83Mbps tx: 15.55Kpps 31.44Mbps rx: 39.59Kpps 340.14Mbps tx: 16.37Kpps 36.92Mbps rx: 39.44Kpps 340.84Mbps tx: 15.48Kpps 35.64Mbps linux side vpp1host: flags=4163 mtu 1600 inet 10.155.32.76 netmask 255.0.0.0 broadcast 10.255.255.255 ether e2:27:5e:cb:38:6b txqueuelen 1000 (Ethernet) RX packets 375729479 bytes 105801826082 (98.5 GiB) RX errors 0 dropped 21875 overruns 0 frame 0 TX packets 829224788 bytes 867242223136 (807.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 vpp1out: flags=4163 mtu 1600 ether 2e:1d:20:a2:bd:9c txqueuelen 1000 (Ethernet) RX packets 829224804 bytes 867242242079 (807.6 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 375729488 bytes 105801827209 (98.5 GiB) TX errors 0 dropped 10937 overruns 0 carrier 0 collisions 0 VPP side vpp# show interface addr TenGigabitEthernet19/0/0 (up): L3 10.155.32.6/27 TenGigabitEthernet19/0/2 (up): L3 10.155.32.68/29 host-vpp1out (up): L3 10.155.32.75/29 local0 (dn): host-vpp1out 3 up host-vpp1out Link speed: unknown RX Queues: queue thread mode 0 vpp_wk_0 (1) interrupt Ethernet address 02:fe:06:f0:ef:d6 Linux PACKET socket interface block:10485760 frame:10240 next frame:867 available:0 request:0 sending:0 wrong:1024 total:1024 Thanks Guangming zhangguangm...@baicells.com -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22212): https://lists.fd.io/g/vpp-dev/message/22212 Mute This Topic: https://lists.fd.io/mt/94886139/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] "tx frame not ready " error in host-vpp1out tx
Hi Guangming, What is the VPP version are you using? -br Mohsin From: on behalf of Guangming Reply-To: "vpp-dev@lists.fd.io" Date: Tuesday, November 8, 2022 at 8:01 AM To: "Mohsin Kazmi (sykazmi)" , vpp-dev Subject: [vpp-dev] "tx frame not ready " error in host-vpp1out tx Hi,Mohsin I used linux veth pari interface as af-packet interfeace in vpp. When the vpp run for some time, there are many "tx frame not ready " error in host-vpp1out-tx. If there is error, we can not ping from linux side to vpp side. Must need restart vpp to restore. From old mail. you say "tx frame not ready" means VPP didn't find empty queue at linux side. But in my envirment ,the trafiic is not big .Could give me some clues? vvp# monitor interface host-vpp1out interval 1 count 10 rx: 34.74Kpps 294.82Mbps tx: 17.68Kpps 32.39Mbps rx: 42.78Kpps 372.72Mbps tx: 19.97Kpps 37.45Mbps rx: 38.29Kpps 322.97Mbps tx: 18.50Kpps 33.34Mbps rx: 33.73Kpps 273.07Mbps tx: 16.19Kpps 35.59Mbps rx: 37.39Kpps 317.19Mbps tx: 15.38Kpps 33.30Mbps rx: 33.81Kpps 274.42Mbps tx: 16.21Kpps 34.01Mbps rx: 39.40Kpps 339.30Mbps tx: 16.12Kpps 33.15Mbps rx: 37.98Kpps 330.83Mbps tx: 15.55Kpps 31.44Mbps rx: 39.59Kpps 340.14Mbps tx: 16.37Kpps 36.92Mbps rx: 39.44Kpps 340.84Mbps tx: 15.48Kpps 35.64Mbps linux side vpp1host: flags=4163 mtu 1600 inet 10.155.32.76 netmask 255.0.0.0 broadcast 10.255.255.255 ether e2:27:5e:cb:38:6b txqueuelen 1000 (Ethernet) RX packets 375729479 bytes 105801826082 (98.5 GiB) RX errors 0 dropped 21875 overruns 0 frame 0 TX packets 829224788 bytes 867242223136 (807.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 vpp1out: flags=4163 mtu 1600 ether 2e:1d:20:a2:bd:9c txqueuelen 1000 (Ethernet) RX packets 829224804 bytes 867242242079 (807.6 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 375729488 bytes 105801827209 (98.5 GiB) TX errors 0 dropped 10937 overruns 0 carrier 0 collisions 0 VPP side vpp# show interface addr TenGigabitEthernet19/0/0 (up): L3 10.155.32.6/27 TenGigabitEthernet19/0/2 (up): L3 10.155.32.68/29 host-vpp1out (up): L3 10.155.32.75/29 local0 (dn): host-vpp1out 3 up host-vpp1out Link speed: unknown RX Queues: queue thread mode 0 vpp_wk_0 (1) interrupt Ethernet address 02:fe:06:f0:ef:d6 Linux PACKET socket interface block:10485760 frame:10240 next frame:867 available:0 request:0 sending:0 wrong:1024 total:1024 Thanks Guangming zhangguangm...@baicells.com -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22211): https://lists.fd.io/g/vpp-dev/message/22211 Mute This Topic: https://lists.fd.io/mt/94886139/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] "tx frame not ready " error in host-vpp1out tx
Hi,Mohsin I used linux veth pari interface as af-packet interfeace in vpp. When the vpp run for some time, there are many "tx frame not ready " error in host-vpp1out-tx. If there is error, we can not ping from linux side to vpp side. Must need restart vpp to restore. From old mail. you say "tx frame not ready" means VPP didn't find empty queue at linux side. But in my envirment ,the trafiic is not big .Could give me some clues? vvp# monitor interface host-vpp1out interval 1 count 10 rx: 34.74Kpps 294.82Mbps tx: 17.68Kpps 32.39Mbps rx: 42.78Kpps 372.72Mbps tx: 19.97Kpps 37.45Mbps rx: 38.29Kpps 322.97Mbps tx: 18.50Kpps 33.34Mbps rx: 33.73Kpps 273.07Mbps tx: 16.19Kpps 35.59Mbps rx: 37.39Kpps 317.19Mbps tx: 15.38Kpps 33.30Mbps rx: 33.81Kpps 274.42Mbps tx: 16.21Kpps 34.01Mbps rx: 39.40Kpps 339.30Mbps tx: 16.12Kpps 33.15Mbps rx: 37.98Kpps 330.83Mbps tx: 15.55Kpps 31.44Mbps rx: 39.59Kpps 340.14Mbps tx: 16.37Kpps 36.92Mbps rx: 39.44Kpps 340.84Mbps tx: 15.48Kpps 35.64Mbps linux side vpp1host: flags=4163 mtu 1600 inet 10.155.32.76 netmask 255.0.0.0 broadcast 10.255.255.255 ether e2:27:5e:cb:38:6b txqueuelen 1000 (Ethernet) RX packets 375729479 bytes 105801826082 (98.5 GiB) RX errors 0 dropped 21875 overruns 0 frame 0 TX packets 829224788 bytes 867242223136 (807.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 vpp1out: flags=4163 mtu 1600 ether 2e:1d:20:a2:bd:9c txqueuelen 1000 (Ethernet) RX packets 829224804 bytes 867242242079 (807.6 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 375729488 bytes 105801827209 (98.5 GiB) TX errors 0 dropped 10937 overruns 0 carrier 0 collisions 0 VPP side vpp# show interface addr TenGigabitEthernet19/0/0 (up): L3 10.155.32.6/27 TenGigabitEthernet19/0/2 (up): L3 10.155.32.68/29 host-vpp1out (up): L3 10.155.32.75/29 local0 (dn): host-vpp1out 3 up host-vpp1out Link speed: unknown RX Queues: queue thread mode 0 vpp_wk_0 (1) interrupt Ethernet address 02:fe:06:f0:ef:d6 Linux PACKET socket interface block:10485760 frame:10240 next frame:867 available:0 request:0 sending:0 wrong:1024 total:1024 Thanks Guangming zhangguangm...@baicells.com -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22150): https://lists.fd.io/g/vpp-dev/message/22150 Mute This Topic: https://lists.fd.io/mt/94886139/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
