[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Hi, In the meantime I upgraded kvm to 1:84+dfsg-0ubuntu16+1.0+noroms+0ubuntu14.11. But problem occured again. Hope this will be helpful: 0x7f19d124ae3a dma_complete+42: 1887144776 1962902856 2083055629 -951517190 0x7f19d124ae4a dma_complete+58: 28739 2071986176 175374409 147096392 0x7f19d124ae5a dma_complete+74: 264461659 -2092433377 -1991767868 -379757601 0x7f19d124ae6a dma_complete+90: -296174 1213436006 -1958151287 -2058866561 0x7f19d125bc3a ide_bus_reset+74: -394032312 1207959558 3162311 1207959552 0x7f19d125bc4a ide_bus_reset+90: 115905419 -1958215680 -678868990 1082869851 0x7f19d125bc5a ide_bus_reset+106: 266403648 -1991770081 1222124636 -534483831 0x7f19d125bc6a ide_init_drive+10: 1291553096 -400268151 611092812 -175552272 0x7f19d125d031 piix3_reset+33:1488817480 -402653173 -5197 279494 0x7f19d125d041 piix3_reset+49:345030 -2147073082 34030534 18891718 0x7f19d125d051 piix3_reset+65:610044744 1821067272 -2092429276 1103304900 0x7f19d125d061 pci_piix3_xen_ide_unplug+1:-58111660 -617524395 29351561-402653184 0x7f19d12802ed qemu_system_reset+45: 1977320776 -310099730 -164557708 447 0x7f19d12802fd qemu_system_reset+61: -486676480 -2092433398 1566247108 128758505 0x7f19d128030d qemu_system_reset+77: 1217422848 -1962349437 -1939055099 1975551232 0x7f19d128031d qemu_system_reset_request+13: -335165662 16813165 -402653184 505507 0x7f19d11ed944 main+5284: 283027432 1426426624 -2097130423 158597880 0x7f19d11ed954 main+5300: 252442755 -201595 311295 -370671616 0x7f19d11ed964 main+5316: -385873635 -8033007-525670400 0x7f19d11ed974 main+5332: -1226244080 1224736764 -1924601463 516264725 0x7f19cd8ca76d __libc_start_main+237: -51853431 822084001 -12654126 -1958150145 0x7f19cd8ca77d __libc_start_main+253: 969551365 -926857216 860382225 3155204 0x7f19cd8ca78d __libc_start_main+269: -788594688 134581064 1207974346 1678887105 0x7f19cd8ca79d __libc_start_main+285: 621032264 48 252248048 -1070480748 0x7f19d11f0d3d _start+41: 1217433844 1208544387 1393362315 -2058878894 0x7f19d11f0d4d call_gmon_start+13:-16616256 -998029104 -1869561080 -1869574000 0x7f19d11f0d5d call_gmon_start+29:1435537552 802700672 1207959637 1413604745 0x7f19d11f0d6d __do_global_dtors_aux+13: 1214412115 1325415811 1946157138 1032538124 Regards -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
I tried to reproduce this by passing -u -b 2000M to iperf to force some packets to be dropped, but no crashes yet. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Hi, I don't seem able to get gdb to tell me where the failures are. If possible, could you install qemu-kvm-dbgsym (see https://wiki.ubuntu.com/DebuggingProgramCrash#Debug_Symbol_Packages if needed), fire up such a VM, attach to it with gdb (gdb -p $pid) then print the addresses in question: x/16 0x7fcd4533bb96 x/16 0x7fcd48c5ee3a x/16 0x7fcd48c6fc3a x/16 0x7fcd48c71031 x/16 0x7fcd48c942ed x/16 0x7fcd48c01944 x/16 0x7fcd452de76d x/16 0x7fcd48c04d3d -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
** Changed in: qemu-kvm (Ubuntu) Status: Incomplete = Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
I'm trying to reproduce this on a precise host using a VM with 3 nics connected to a host bridge, running iperf. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Thank you. I found that some packets were dropped on interface working as a bridge port. The same story is on the second server. I don't if this may have impact on this crash. You can find this in logs I attached. Regards ** Attachment added: Logs from affected server https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+attachment/3785073/+files/logs.tar.gz -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Sigh, sorry - I meant /var/log/libvirt/qemu/domain.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Thanks - was there anything in /var/log/libvirt/domain.log? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Thanks for your help. Below are details you are asking for: 1. We use bridge networking. Three network adapters attached to the VM use the same host bridge interface. There're no errors on this network adapter (e1000e). 2. VM was running linux-based os (customized Debian distribution). 3. We used these VMs to test HA cluster so there was Heartbeat/iSCSI/drbd (quite intensive network test). VMs involved into the cluster were set up on different physical hosts. 4. VM had been running for almost 4 days I suppose before the crash. I looked also in libvirtd.log and found this (maybe it can help): 2013-08-13 09:31:12.654+: 3093: info : libvirt version: 0.9.8 2013-08-13 09:31:12.654+: 3093: error : qemuMonitorIORead:513 : Unable to read from monitor: Connection reset by peer 2013-08-13 09:50:59.524+: 3093: error : qemuMonitorIORead:513 : Unable to read from monitor: Connection reset by peer 2013-08-13 10:31:18.026+: 3093: error : qemuMonitorIO:603 : internal error End of file from monitor Regards ** Attachment added: qemu log https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+attachment/3774923/+files/one-455.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
Thanks for submitting this bug. Nothing seems unusual other than high vnc port and 3 network interfaces. Can you tell me what os was running in the VM, what sort of workloadi t was running, how the three network interfaces were connected on the host, and how long it was up before it crashed? I'll see if I can find out any more based on the addresses in the dump ** Changed in: qemu-kvm (Ubuntu) Importance: Undecided = High -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1211722] Re: VM crashes on Ubuntu 12.04
This appears to be happening in handle_9p_output (cae3a) immediately after a call to bdr_aio_ready. But your command line doesn't seem to set up any 9pfs. So my objdump may not match your kvm. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
Re: [Bug 1211722] Re: VM crashes on Ubuntu 12.04
status: incomplete ** Changed in: qemu-kvm (Ubuntu) Status: New = Incomplete -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1211722 Title: VM crashes on Ubuntu 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1211722/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
