Upgraded from 4.13.0-11.12 to 4.13.0-11.12+yarmouth2.1 Nothing changed: - on initial card probing with kernel driver "Failed to set up IOMMU" messages - on vfio assign again "Failed to set up IOMMU" messages - on usage of the PMD by Openvswitch Kernel fault - on usage of the PMD by Openvswitch OVS crash
[ 1322.211137] device ovsdpdkbr0 entered promiscuous mode [ 1323.420792] eal-intr-thread[3188]: unhandled level 2 translation fault (11) at 0xfffc17400200, esr 0x92000006, in librte_pmd_thunderx_nicvf.so.17.05[ffffaf0a8000+11000] [ 1323.424214] CPU: 0 PID: 3188 Comm: eal-intr-thread Not tainted 4.13.0-11-generic #12+yarmouth2.1-Ubuntu [ 1323.424217] Hardware name: GIGABYTE R120-T33/MT30-GS1, BIOS T45 06/14/2017 [ 1323.424219] task: ffff800fb0692d00 task.stack: ffff800fab60c000 [...] Since we had issues with secondary groups in the past I picked one of the few that came up as SQS=true and used that as dpdk port: $ ovs-vsctl del-port dpdk0 $ ovs-vsctl add-port ovsdpdkbr0 dpdk0 -- set Interface dpdk0 type=dpdk "options:dpdk-devargs=0002:01:00.5" # To be able to do so with a crashing OVS you need to unbind all devices from vfio--pci so they can not initialize and crash. # Then after the config change bind all to vfio again and start OVS It scans all devices but initializes only the one I have passed as dpdk dev. In this case everything works which confirms this being an issue of secondary queues. P.S. it also breaks out assumptions on the box for our testing, we need to be able to use more ports. The only current SQS=true are 4 VFs of port 0, but we need the other ports. But I expect it needs to be resolved with a fix to get those initializing correctly. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1718638 Title: Crash on Cavium ThunderX when using Openvswitch-DPDK: nicvf_eth_dev_init(): Failed to get ready message from PF / eal-intr- thread[41505]: unhandled level 2 translation fault" To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1718638/+subscriptions -- ubuntu-bugs mailing list [email protected] https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
