Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-20 Thread Eggert, Lars
On 2015-5-20, at 17:30, Roger Pau Monné roger@citrix.com wrote: Did you manage to get past this? TBH I don't know why Xen tries to build the tests, my build of tools doesn't even try to. Yes, I think the issue was that I tried to build Xen 4.5-release. I'm now building master without

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-20 Thread Roger Pau Monné
El 15/05/15 a les 14.06, Eggert, Lars ha escrit: On 2015-5-13, at 18:00, Eggert, Lars l...@netapp.com wrote: On 2015-5-13, at 16:46, Roger Pau Monné roger@citrix.com wrote: I guess migration-rdma gets compiled because Qemu detects that you have some library and assumes that you want it

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-18 Thread Eggert, Lars
Unfortunately, the storm is still there with this patch. On 2015-5-15, at 18:28, Roger Pau Monné roger@citrix.com wrote: El 15/05/15 a les 16.42, Eggert, Lars ha escrit: On 2015-5-15, at 16:35, Roger Pau Monné roger@citrix.com wrote: Yes, but I've realized that isci for example

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-18 Thread Roger Pau Monné
El 18/05/15 a les 15.01, Eggert, Lars ha escrit: Unfortunately, the storm is still there with this patch. I guess you will have to resort to using hw.isci.force_legacy_interrupts=1 until I get around to implement MSI-X support for Xen Dom0, sorry for the trouble. Roger.

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-18 Thread Eggert, Lars
On 2015-5-18, at 15:39, Roger Pau Monné roger@citrix.com wrote: I guess you will have to resort to using hw.isci.force_legacy_interrupts=1 until I get around to implement MSI-X support for Xen Dom0, sorry for the trouble. No worries, that's a fine workaround. Thanks for all the help!

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-13, at 18:00, Eggert, Lars l...@netapp.com wrote: On 2015-5-13, at 16:46, Roger Pau Monné roger@citrix.com wrote: I guess migration-rdma gets compiled because Qemu detects that you have some library and assumes that you want it enabled. Did you install something new between

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-15, at 13:59, Roger Pau Monné roger@citrix.com wrote: Can you provide the bootlog with the patch applied? Below. Also, can you try if there's any difference when setting: hw.isci.force_legacy_interrupts=1 on /boot/loader.conf? That seems to elimintate the storm. The isci line

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Roger Pau Monné
El 15/05/15 a les 13.53, Eggert, Lars ha escrit: On 2015-5-13, at 16:52, Roger Pau Monné roger@citrix.com wrote: I have a patch for FreeBSD which might solve it, however I don't have any similar box I can use to test it, would you mind giving it a spin? Unfortunately, the irq storm is

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-13, at 16:52, Roger Pau Monné roger@citrix.com wrote: I have a patch for FreeBSD which might solve it, however I don't have any similar box I can use to test it, would you mind giving it a spin? Unfortunately, the irq storm is still present with that patch applied. Lars

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-15, at 16:42, Eggert, Lars l...@netapp.com wrote: Will now set hw.isci.force_legacy_interrupts=1 and check if the device then works correctly. That seems to be the case. Lars signature.asc Description: Message signed with OpenPGP using GPGMail

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Roger Pau Monné
El 15/05/15 a les 16.30, Eggert, Lars ha escrit: On 2015-5-15, at 16:14, Roger Pau Monné roger@citrix.com wrote: I've attached another patch that will force isci to print some messages, can you try that? Trying this now. +*irq = 0; FWIW, this was *irq = -1 in your previous

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-15, at 16:14, Roger Pau Monné roger@citrix.com wrote: I've attached another patch that will force isci to print some messages, can you try that? Trying this now. + *irq = 0; FWIW, this was *irq = -1 in your previous patch... Lars signature.asc Description: Message

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Eggert, Lars
On 2015-5-15, at 16:35, Roger Pau Monné roger@citrix.com wrote: Yes, but I've realized that isci for example passes an uint32_t instead of an int, so it might be best to set it to 0. Here is what I see now: isci0: Intel(R) C600 Series Chipset SAS Controller (SATA mode) port

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-15 Thread Roger Pau Monné
El 15/05/15 a les 16.42, Eggert, Lars ha escrit: On 2015-5-15, at 16:35, Roger Pau Monné roger@citrix.com wrote: Yes, but I've realized that isci for example passes an uint32_t instead of an int, so it might be best to set it to 0. Here is what I see now: isci0: Intel(R) C600 Series

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Roger Pau Monné
Hello, El 13/05/15 a les 10.20, Eggert, Lars ha escrit: Hi, with Xen from git and a recent -CURRENT, I get interrupt storm detected on irq16:; throttling interrupt source messages on the dom0 console about once a second. irq16 is used for ehci: # vmstat -i | grep irq16 irq16: ehci0

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Roger Pau Monné
Hello, El 13/05/15 a les 16.40, Eggert, Lars ha escrit: Also, building the xen tools currently seems to fail with: gmake[3]: Entering directory '/usr/home/elars/xen/tools/qemu-xen-dir-remote' GEN config-host.h GEN trace/generated-tracers.h GEN trace/generated-tcg-tracers.h

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Roger Pau Monné
El 13/05/15 a les 15.48, Eggert, Lars ha escrit: isci0: Intel(R) C600 Series Chipset SAS Controller (SATA mode) port 0x6000-0x60ff mem 0xde07c000-0xde07,0xddc0-0xddff irq 16 at device 0.0 on pci10 isci0: attempting to allocate 2 MSI-X vectors (2 supported) isci: 1:89 ISCI

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Eggert, Lars
On 2015-5-13, at 10:54, Roger Pau Monné roger@citrix.com wrote: Can you post the full output of vmstat -i and the log of Xen and FreeBSD booting (with boot_verbose=YES)? If you don't have a serial console setup you can get the Xen boot log using xl dmesg. Here you go: Xen

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Eggert, Lars
I'll test Friday, thanks. On 2015-5-13, at 16:52, Roger Pau Monné roger@citrix.com wrote: El 13/05/15 a les 15.48, Eggert, Lars ha escrit: isci0: Intel(R) C600 Series Chipset SAS Controller (SATA mode) port 0x6000-0x60ff mem 0xde07c000-0xde07,0xddc0-0xddff irq 16 at device

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Eggert, Lars
On 2015-5-13, at 16:46, Roger Pau Monné roger@citrix.com wrote: I guess migration-rdma gets compiled because Qemu detects that you have some library and assumes that you want it enabled. Did you install something new between your previous build of Xen and this one? Yes, this box has world

Re: Xen dom0 interrupt storm detected on irq16:; throttling interrupt source

2015-05-13 Thread Roger Pau Monné
El 13/05/15 a les 18.00, Eggert, Lars ha escrit: On 2015-5-13, at 16:46, Roger Pau Monné roger@citrix.com wrote: I guess migration-rdma gets compiled because Qemu detects that you have some library and assumes that you want it enabled. Did you install something new between your previous