Just to inform: That error errno:-22 was caused by bad configuration of hugepages.
Machine: Ubuntu 18.04.1 LTS , kernel 4.15.0-20-generic , gcc (Ubuntu/Linaro 5.5.0-12ubuntu1) 5.5.0 20171010 There was found the error in /var/log/kern.log : Jul 30 11:52:14 vppagent kernel: [ 3334.545602] Failed to set up IOMMU for device 0002:01:00.2; retaining platform DMA ops According https://certification.ubuntu.com/hardware/201609-25110/ I added into /etc/default/grub to the command GRUB_CMDLINE parameter iommu.passthrough=1 Then sudo update-grub Also the problem was that there were not properly setup hugepages – it seems that Cavium ThunderX NIC properly works only with 1GB hugepages Using gdb my colleage found out that the error -22 come into being at this line of vpp code { vpp/build-root/build-vpp_debug-native/dpdk/dpdk-18.05/drivers/net/thunderx/nicvf_ethdev.c 1278 PMD_INIT_LOG(ERR, "Non-contiguous mempool, add more huge pages"); } So now the hugepages are setup like this in /etc/default/grub GRUB_DEFAULT=0 #GRUB_HIDDEN_TIMEOUT=0 GRUB_HIDDEN_TIMEOUT_QUIET=true GRUB_TIMEOUT=10 GRUB_DISTRIBUTOR=Ubuntu GRUB_CMDLINE_LINUX="console=ttyAMA0,115200n8 biosdevname=0 net.ifnames=1 crashkernel=auto LANG=en_US.UTF-8 iommu.passthrough=1 hugepagesz=1GB hugepages=16 default_hugepagesz=1GB iomem=relaxed" GRUB_TERMINAL=serial GRUB_SERIAL_COMMAND="serial" The VPP is able to see the NIC and I am able to set it UP and also to use in communication. There is only „cosmetic“ bug Sometimes there is the message while VPP starts like this: /home/stanislav/work/vpp/build-root/install-vpp_debug-native/vpp/bin/vpp[6330]: dpdk: Unsupported PCI device 0x177d:0xa034 found at PCI address 0002:01:00.2 But this DOES NOT PREVENT the Cavium NIC from working properly. Thanks for your time and advice Stan From: Nitin Saxena [mailto:nitin.sax...@cavium.com] Sent: Monday, July 23, 2018 9:01 AM To: vpp-dev@lists.fd.io Subject: Re: [vpp-dev] #vpp Cavium ThunderX (ARM64) Hi Stanislav, Are you seeing this issue with dpdk-18.05? You will get this error with dpdk-18.02.1. In vpp master branch dpdk-18.05 is enabled by default. Thanks, Nitin On Friday 20 July 2018 05:49 PM, Stanislav Chlebec wrote: External Email Hello all I was trying to achieve cooperation of VPP with the NIC present in the ThunderX (c1.large.arm) It was not successful: https://gist.github.com/stanislav-chlebec/a36c43c2eee8c16d3d297e67bac1d711 Conclusion: VPP was successfully built on the system. VPP is not able to work with the NIC + vfio_pci neither with NIC + uio_pci_generic neither with NIC + igb_uio The output of the cpmmand in vpp is like this DBGvpp# sh int Name Idx State MTU (L3/IP4/IP6/MPLS) Counter Count VirtualFunctionEthernet1/0/2 1 error 9000/0/0/0 local0 0 down 0/0/0/0 DBGvpp# show hardware-interfaces Name Idx Link Hardware VirtualFunctionEthernet1/0/2 1 down VirtualFunctionEthernet1/0/2 Ethernet address 30:0e:d5:ff:0d:9e Cavium ThunderX carrier down flags: pmd pmd-init-fail maybe-multiseg rx queues 1, rx desc 1024, tx queues 1, tx desc 1024 cpu socket 0 Errors: rte_eth_rx_queue_setup[port:0, errno:-22]: Unknown error -22 local0 0 down local0 local DBGvpp# DBGvpp# set interface state VirtualFunctionEthernet1/0/2 up set interface state: Interface in the error state DBGvpp# set interface state VirtualFunctionEthernet1/0/2 down set interface state: Interface not initialized DBGvpp# -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#9897): https://lists.fd.io/g/vpp-dev/message/9897 Mute This Topic: https://lists.fd.io/mt/23753373/675748 Mute #vpp: https://lists.fd.io/mk?hashtag=vpp&subid=1480717 Group Owner: vpp-dev+ow...@lists.fd.io<mailto:vpp-dev+ow...@lists.fd.io> Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [nsax...@caviumnetworks.com<mailto:nsax...@caviumnetworks.com>] -=-=-=-=-=-=-=-=-=-=-=-
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#10093): https://lists.fd.io/g/vpp-dev/message/10093 Mute This Topic: https://lists.fd.io/mt/23753373/21656 Mute #vpp: https://lists.fd.io/mk?hashtag=vpp&subid=1480452 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
