On Wed, Jun 17, 2020 at 12:50:46PM +0200, Hrvoje Popovski wrote: > On 17.6.2020. 12:45, Hrvoje Popovski wrote: > > On 17.6.2020. 11:27, Hrvoje Popovski wrote: > >> On 17.6.2020. 10:36, David Gwynne wrote: > >>> this is an updated version of a diff from christiano haesbaert by way of > >>> mpi@ to enable the use of multiple tx and rx rings with msi-x. > >>> > >>> the high level description is that that driver checks to see if msix is > >>> available, and if so how many vectors it has. it then gets an intrmap > >>> based on that information, and bumps the number of queues to the number > >>> of cpus that intrmap says are available. > >>> > >>> once the queues are allocated, it then iterates over them and wires up > >>> interrupts to the cpus provided by the intrmap. > >>> > >>> im happy for people to try this out, but i can't commit it until all the > >>> architectures that ix(4) is enabled on support the APIs that it's using. > >>> this basically means it'll work on amd64 (and a little bit on i386), but > >>> not much else. please hold back your tears and cries of anguish. > >>> > >>> thanks to christiano and mpi for doing most of the work leading up to > >>> this diff :) > >> > >> Hi, > >> > >> first, thank you all for mq work :) > >> > >> with this diff, if i'm sending traffic over ix and at the same time > >> execute ifconfig ix down/up, forwarding stops until i stop generator, > >> wait for few seconds and execute ifconfig ix down/up few times and than > >> forwarding start normally > > > > > in vmstat i should see ix0:0-5 and ix1:0-5 ?
vmstat -i only shows interrupts that have actually fired. Use -zi to show all interrupts. This diff doesn't set up RSS, so received packets will only go to the first vector, which is why only one of the ix1 interrupts has fired. Outgoing packets are scattered across the tx queues, so all the ix0 interrupts have fired. > > r620-1# vmstat -i > interrupt total rate > irq0/clock 3985752 599 > irq0/ipi 3462063 520 > irq144/acpi0 4 0 > irq114/ix0:0 8042709 1209 > irq115/ix0:1 2906070 437 > irq116/ix0:2 1975350 297 > irq117/ix0:3 849089681 127721 > irq118/ix0:4 4441608 668 > irq119/ix0:5 4330871 651 > irq120/ix0 10 0 > irq121/ix1:0 43209056 6499 > irq127/ix1 16 0 > irq97/mfi0 36846 5 > irq132/ixl2 7 0 > irq133/ixl2:0 459 0 > irq134/ixl3 7 0 > irq135/ixl3:0 451 0 > irq99/ehci0 139 0 > irq136/em0 18637 2 > irq137/em1 451 0 > irq100/ehci1 28 0 > irq101/ahci0 1 0 > irq146/com1 4411 0 > Total 921504627 138613 >
