Kris, are deep C-states enabled? -- richard On Jun 23, 2014, at 10:46 PM, Kris Shannon via illumos-discuss <discuss@lists.illumos.org> wrote:
> On 24 June 2014 13:46, Rich <rerc...@acm.jhu.edu> wrote: >> What version of il-gate is it running, then? Latest illumos-gate as of when? >> >> - Rich > > OpenIndiana 151a9 pulled illumos-gate 52e13e00baadc11c135170cd60a8b3c4f253a694 > > > It looks like it might be an issue with interrupts. > > The same code runnning on another box with a duplicate Intel 82599ES > card works fine. > > The obvious differences between the two: > > Perfomance Penalty: Dual 8-core (=16 cpus) with an apix interrupt controller. > Performance Great: Dual 4-core with Hyperthreading (=16 cpus) with > pcplusmp interrupt controller. > > > On the working box (with pcplusmp and 1 intel 82599ES card) > > # echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p > IRQ Vect IPL Bus Trg Type CPU Share APIC/INT# ISR(s) > 56 0x63 6 PCI Edg MSI-X 0 1 - ixgbe_intr_msix > 57 0x64 6 PCI Edg MSI-X 1 1 - ixgbe_intr_msix > 58 0x65 6 PCI Edg MSI-X 2 1 - ixgbe_intr_msix > 59 0x66 6 PCI Edg MSI-X 3 1 - ixgbe_intr_msix > > On the slow box (with apix and 2 Intel 82599ES cards + onboard ixgbe) > > # echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p > CPU/Vect IRQ IPL Bus Trg Type Share APIC/INT# ISR > 0/0x20 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x26 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x26 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > .... > and repeated for CPUs 3-15 > > > ------------------------------------------- > illumos-discuss > Archives: https://www.listbox.com/member/archive/182180/=now > RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175743-23d1427b > Modify Your Subscription: https://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com ------------------------------------------- illumos-discuss Archives: https://www.listbox.com/member/archive/182180/=now RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be Modify Your Subscription: https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4 Powered by Listbox: http://www.listbox.com
