[Bug 1744169] Re: KVM + Virtio kernel panic
Hi Joseph. It's possible, but not ideal in my situation. I'm running Ubuntu 16.04 server VMs in KVM (via OpenStack) on a CentOS hypervisor, and I'm unable to easily reproduce the issue as it can occur on any of the 50+ VMs I have running. I'd prefer not to change the kernel on every VM if I can avoid it. Is there anything else I can do? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] UdevDb.txt
apport information ** Attachment added: "UdevDb.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039833/+files/UdevDb.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] WifiSyslog.txt
apport information ** Attachment added: "WifiSyslog.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039834/+files/WifiSyslog.txt ** Changed in: linux (Ubuntu) Status: Incomplete => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] ProcInterrupts.txt
apport information ** Attachment added: "ProcInterrupts.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039831/+files/ProcInterrupts.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] ProcModules.txt
apport information ** Attachment added: "ProcModules.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039832/+files/ProcModules.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] Lspci.txt
apport information ** Attachment added: "Lspci.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039829/+files/Lspci.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] ProcCpuinfoMinimal.txt
apport information ** Attachment added: "ProcCpuinfoMinimal.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039830/+files/ProcCpuinfoMinimal.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] JournalErrors.txt
apport information ** Attachment added: "JournalErrors.txt" https://bugs.launchpad.net/bugs/1744169/+attachment/5039828/+files/JournalErrors.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] Re: KVM + Virtio kernel panic
apport information ** Tags added: apport-collected ec2-images ** Description changed: I received the following kernel panic on a KVM VM which is acting as an OpenStack compute node. I'm unable to consistently reproduce this, but I do consistently get various kernel panics (this is only one of them). Is anyone able to shed any light on what might be happening here? Ubuntu Server 16.04 cloud image. Kernel Version: 4.4.0-98-generic [19927.255474] general protection fault: [#1] SMP [19927.256033] Modules linked in: vhost_net vhost macvtap macvlan xt_REDIRECT nf_nat_redirect xt_mark ip6table_mangle iptable_nat nf_nat_ipv4 nf_nat xt_connmark iptable_mangle ip6table_raw nf_conntrack_ipv6 xt_CT xt_mac xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_comment xt_physdev xt_set xt_conntrack ip_set_hash_net ip_set nfnetlink iptable_raw veth ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables br_netfilter bridge stp llc vport_gre ip_gre ip_tunnel gre vport_vxlan vxlan ip6_udp_tunnel udp_tunnel openvswitch nf_defrag_ipv6 nf_conntrack ppdev kvm_amd kvm input_leds serio_raw joydev irqbypass parport_pc parport ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse floppy [19927.256033] CPU: 3 PID: 2801 Comm: vna_agent Not tainted 4.4.0-98-generic #121-Ubuntu [19927.256033] Hardware name: RDO OpenStack Compute, BIOS 1.9.1-5.el7_3.3 04/01/2014 [19927.256033] task: 88023551c600 ti: 8800bb9ac000 task.ti: 8800bb9ac000 [19927.256033] RIP: 0010:[] [] cmpxchg_double_slab.isra.54+0x24/0xe0 [19927.256033] RSP: :88023fd83a40 EFLAGS: 00010206 [19927.256033] RAX: 009a660a158b487e RBX: 880233955a00 RCX: c01902a30f48c088 [19927.256033] RDX: c01902a30f48c089 RSI: 8106b846 RDI: 4000 [19927.256033] RBP: 88023fd83a88 R08: 880233955a00 R09: c01902a30f48c088 [19927.256033] R10: 009a660a158b487e R11: 8801cf5bfc00 R12: 009a660a158b487e [19927.256033] R13: 8106b846 R14: R15: 880237001700 [19927.256033] FS: 7fbf85e38740() GS:88023fd8() knlGS: [19927.256033] CS: 0010 DS: ES: CR0: 80050033 [19927.256033] CR2: 7ffcaa2ca468 CR3: ba76 CR4: 003406e0 [19927.256033] Stack: [19927.256033] 880233d4f008 880233cabc80 [19927.256033] c9e48004 0001 88023fd83ac0 8175ff24 [19927.256033] 0f48c088 88023fd83b50 811ef3fb 880233d4f008 [19927.256033] Call Trace: [19927.256033] [19927.256033] [] ? sch_direct_xmit+0x74/0x220 [19927.256033] [] __slab_free+0xcb/0x2c0 [19927.256033] [] ? __dev_queue_xmit+0x286/0x590 [19927.256033] [] kmem_cache_free+0x1d4/0x1e0 [19927.256033] [] kfree_skbmem+0x59/0x60 [19927.256033] [] consume_skb+0x34/0x90 [19927.256033] [] arp_process+0x80/0x750 [19927.256033] [] arp_rcv+0x133/0x1c0 [19927.256033] [] ? packet_rcv+0x44/0x440 [19927.256033] [] __netif_receive_skb_core+0x704/0xa60 [19927.256033] [] ? __build_skb+0x2a/0xe0 [19927.256033] [] __netif_receive_skb+0x18/0x60 [19927.256033] [] netif_receive_skb_internal+0x32/0xa0 [19927.256033] [] napi_gro_receive+0xc3/0xf0 [19927.256033] [] virtnet_receive+0x4a6/0x8f0 [19927.256033] [] virtnet_poll+0x1d/0x80 [19927.256033] [] net_rx_action+0x21e/0x360 [19927.256033] [] ? skb_recv_done+0x43/0x50 [19927.256033] [] __do_softirq+0x101/0x290 [19927.256033] [] irq_exit+0xa3/0xb0 [19927.256033] [] do_IRQ+0x54/0xd0 [19927.256033] [] common_interrupt+0x82/0x82 [19927.256033] [19927.256033] [] ? native_safe_halt+0x6/0x10 [19927.256033] [] kvm_wait+0x52/0x60 [19927.256033] [] __pv_queued_spin_lock_slowpath+0x1d6/0x210 [19927.256033] [] _raw_spin_lock+0x21/0x30 [19927.256033] [] handle_mm_fault+0x60b/0x1820 [19927.256033] [] ? hrtimer_try_to_cancel+0x29/0x130 [19927.256033] [] ? do_nanosleep+0x96/0xf0 [19927.256033] [] ? hrtimer_nanosleep+0xdc/0x210 [19927.256033] [] __do_page_fault+0x197/0x400 [19927.256033] [] trace_do_page_fault+0x37/0xe0 [19927.256033] [] do_async_page_fault+0x19/0x70 [19927.256033] [] async_page_fault+0x28/0x30 [19927.256033] Code: 0f 1f 80 00 00 00 00 55 49 89 d2 48 89 e5 53 48 83 e4 f0 48 83 ec 40 f7 c7 00 00 00 40 74 2c 48 89 ca 4c 89 d0 4c 89 c3 4c 89 c9 48 0f c7 4e 10 0f 94 c0 41 89 c0 b8 01 00 00 00 45 84 c0 75 [19927.256033] RIP [] cmpxchg_double_slab.isra.54+0x24/0xe0 [19927.256033] RSP [19927.296033] general protection fault:
[Bug 1744169] Re: KVM + Virtio kernel panic
** Package changed: ubuntu => kernel-package (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1744169 Title: KVM + Virtio kernel panic To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/kernel-package/+bug/1744169/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1744169] [NEW] KVM + Virtio kernel panic
Public bug reported: I received the following kernel panic on a KVM VM which is acting as an OpenStack compute node. I'm unable to consistently reproduce this, but I do consistently get various kernel panics (this is only one of them). Is anyone able to shed any light on what might be happening here? Ubuntu Server 16.04 cloud image. Kernel Version: 4.4.0-98-generic [19927.255474] general protection fault: [#1] SMP [19927.256033] Modules linked in: vhost_net vhost macvtap macvlan xt_REDIRECT nf_nat_redirect xt_mark ip6table_mangle iptable_nat nf_nat_ipv4 nf_nat xt_connmark iptable_mangle ip6table_raw nf_conntrack_ipv6 xt_CT xt_mac xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_comment xt_physdev xt_set xt_conntrack ip_set_hash_net ip_set nfnetlink iptable_raw veth ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables br_netfilter bridge stp llc vport_gre ip_gre ip_tunnel gre vport_vxlan vxlan ip6_udp_tunnel udp_tunnel openvswitch nf_defrag_ipv6 nf_conntrack ppdev kvm_amd kvm input_leds serio_raw joydev irqbypass parport_pc parport ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse floppy [19927.256033] CPU: 3 PID: 2801 Comm: vna_agent Not tainted 4.4.0-98-generic #121-Ubuntu [19927.256033] Hardware name: RDO OpenStack Compute, BIOS 1.9.1-5.el7_3.3 04/01/2014 [19927.256033] task: 88023551c600 ti: 8800bb9ac000 task.ti: 8800bb9ac000 [19927.256033] RIP: 0010:[] [] cmpxchg_double_slab.isra.54+0x24/0xe0 [19927.256033] RSP: :88023fd83a40 EFLAGS: 00010206 [19927.256033] RAX: 009a660a158b487e RBX: 880233955a00 RCX: c01902a30f48c088 [19927.256033] RDX: c01902a30f48c089 RSI: 8106b846 RDI: 4000 [19927.256033] RBP: 88023fd83a88 R08: 880233955a00 R09: c01902a30f48c088 [19927.256033] R10: 009a660a158b487e R11: 8801cf5bfc00 R12: 009a660a158b487e [19927.256033] R13: 8106b846 R14: R15: 880237001700 [19927.256033] FS: 7fbf85e38740() GS:88023fd8() knlGS: [19927.256033] CS: 0010 DS: ES: CR0: 80050033 [19927.256033] CR2: 7ffcaa2ca468 CR3: ba76 CR4: 003406e0 [19927.256033] Stack: [19927.256033] 880233d4f008 880233cabc80 [19927.256033] c9e48004 0001 88023fd83ac0 8175ff24 [19927.256033] 0f48c088 88023fd83b50 811ef3fb 880233d4f008 [19927.256033] Call Trace: [19927.256033] [19927.256033] [] ? sch_direct_xmit+0x74/0x220 [19927.256033] [] __slab_free+0xcb/0x2c0 [19927.256033] [] ? __dev_queue_xmit+0x286/0x590 [19927.256033] [] kmem_cache_free+0x1d4/0x1e0 [19927.256033] [] kfree_skbmem+0x59/0x60 [19927.256033] [] consume_skb+0x34/0x90 [19927.256033] [] arp_process+0x80/0x750 [19927.256033] [] arp_rcv+0x133/0x1c0 [19927.256033] [] ? packet_rcv+0x44/0x440 [19927.256033] [] __netif_receive_skb_core+0x704/0xa60 [19927.256033] [] ? __build_skb+0x2a/0xe0 [19927.256033] [] __netif_receive_skb+0x18/0x60 [19927.256033] [] netif_receive_skb_internal+0x32/0xa0 [19927.256033] [] napi_gro_receive+0xc3/0xf0 [19927.256033] [] virtnet_receive+0x4a6/0x8f0 [19927.256033] [] virtnet_poll+0x1d/0x80 [19927.256033] [] net_rx_action+0x21e/0x360 [19927.256033] [] ? skb_recv_done+0x43/0x50 [19927.256033] [] __do_softirq+0x101/0x290 [19927.256033] [] irq_exit+0xa3/0xb0 [19927.256033] [] do_IRQ+0x54/0xd0 [19927.256033] [] common_interrupt+0x82/0x82 [19927.256033] [19927.256033] [] ? native_safe_halt+0x6/0x10 [19927.256033] [] kvm_wait+0x52/0x60 [19927.256033] [] __pv_queued_spin_lock_slowpath+0x1d6/0x210 [19927.256033] [] _raw_spin_lock+0x21/0x30 [19927.256033] [] handle_mm_fault+0x60b/0x1820 [19927.256033] [] ? hrtimer_try_to_cancel+0x29/0x130 [19927.256033] [] ? do_nanosleep+0x96/0xf0 [19927.256033] [] ? hrtimer_nanosleep+0xdc/0x210 [19927.256033] [] __do_page_fault+0x197/0x400 [19927.256033] [] trace_do_page_fault+0x37/0xe0 [19927.256033] [] do_async_page_fault+0x19/0x70 [19927.256033] [] async_page_fault+0x28/0x30 [19927.256033] Code: 0f 1f 80 00 00 00 00 55 49 89 d2 48 89 e5 53 48 83 e4 f0 48 83 ec 40 f7 c7 00 00 00 40 74 2c 48 89 ca 4c 89 d0 4c 89 c3 4c 89 c9 48 0f c7 4e 10 0f 94 c0 41 89 c0 b8 01 00 00 00 45 84 c0 75 [19927.256033] RIP [] cmpxchg_double_slab.isra.54+0x24/0xe0 [19927.256033] RSP [19927.296033] general protection fault: [#2] [19927.405901] ---[ end trace f7ced269874d3811 ]--- [19927.405903] Kernel panic - not syncing: Fatal exception in interrupt [19927.296033] SMP [19927.296033] Modules linked in: vhost_net vhost macvtap
