Thanks for looking into this Stefan! We were completely fine with 15.05 and 3.19. If it won't break anything terribly, I can try to put 3.19, 4.0, and 4.1 on these machines, but each one crashes every 24-48 hours, so it might take me several days. Which kernel would you recommend starting with, say, 4.0 or 4.4?
Another thing that I didn't find relevant before, but seems to confirm what you're saying about the per-CPU timers--AWS told me the following after a crash where I disabled my auto-reboot-on-alarm triggers: I was able to successfully get a trace - most of the vCPU were just in a halted state, so nothing there, but one had some potentially useful information: ++++++++++++++++++++ VCPU 1 rip: ffffffff810c3ef5 __pv_queued_spin_lock_slowpath+0xc5 flags: 00000206 i nz p rsp: ffff8803ff243e78 rax: 0000000000000a2a rcx: 00000000fffffffa rdx: 0000000000000003 rbx: ffff8803f7ef2e38 rsi: ffff8803ff243df8 rdi: 0000000000000003 rbp: ffff8803ff243ea8 r8: 0000000000000000 r9: ffff8803fe800000 r10: 0000000000000000 r11: ffffffff813ef2b0 r12: ffff8803ff2571c0 r13: 0000000000080000 r14: ffff88040ffa30c0 r15: 0000000000000001 cs: 0010 ss: 0000 ds: 0000 es: 0000 fs: 0000 @ 00007fc1867b8700 gs: 0000 @ ffff8803ff240000/0000000000000000 cr0: 80050033 cr2: 000000a8 cr3: de15f000 cr4: 001406e0 dr0: 00000000 dr1: 00000000 dr2: 00000000 dr3: 00000000 dr6: ffff0ff0 dr7: 00000400 Code (instr addr ffffffff810c3ef5) 41 bf 01 00 00 00 48 0f af c3 48 89 45 d0 b8 00 80 00 00 eb 0b <f3> 90 83 e8 01 0f 84 d4 00 00 00 Stack: 8c2fa8473f0f2e38 ffff8803ff2577c0 ffff8803f7ef2e10 0000000000000000 ffff8803f7ef2e10 0000000101155691 ffff8803ff243eb8 ffffffff817f0021 ffff8803ff243f38 ffffffff816e48f4 0000000101155693 000000400000012c 0000000000000024 ffff8803ff243ee0 ffff8803ff243ee0 ffff8803ff243ef0 Call Trace: [<ffffffff810c3ef5>] __pv_queued_spin_lock_slowpath+0xc5 <-- [<ffffffff817f0021>] _raw_spin_lock+0x21 [<ffffffff816e48f4>] net_rx_action+0xe4 [<ffffffff8107f846>] __do_softirq+0xf6 [<ffffffff817f1ddc>] do_softirq_own_stack+0x1c ++++++++++++++++++++ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1534345 Title: Ubuntu 15.10 Crashing Frequently on EC2 Instances w/ Enhanced Networking To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1534345/+subscriptions -- ubuntu-bugs mailing list [email protected] https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
