[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
saucy has seen the end of its life and is no longer receiving any updates. Marking the saucy task for this ticket as Won't Fix. ** Changed in: qemu-kvm (Ubuntu Saucy) Status: Confirmed = Won't Fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in linux package in Ubuntu: Fix Released Status in qemu-kvm package in Ubuntu: Confirmed Status in linux source package in Saucy: Won't Fix Status in qemu-kvm source package in Saucy: Won't Fix Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Changed in: linux (Ubuntu Saucy) Status: In Progress = Won't Fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Fix Released Status in “qemu-kvm” package in Ubuntu: Confirmed Status in “linux” source package in Saucy: Won't Fix Status in “qemu-kvm” source package in Saucy: Confirmed Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Changed in: linux (Ubuntu) Status: In Progress = Fix Released -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Fix Released Status in “qemu-kvm” package in Ubuntu: Confirmed Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: Confirmed Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Changed in: linux (Ubuntu) Assignee: Stefan Bader (smb) = (unassigned) ** Changed in: linux (Ubuntu Saucy) Assignee: Stefan Bader (smb) = (unassigned) ** Changed in: qemu-kvm (Ubuntu) Assignee: Stefan Bader (smb) = (unassigned) ** Changed in: qemu-kvm (Ubuntu Saucy) Assignee: Stefan Bader (smb) = (unassigned) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: Confirmed Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: Confirmed Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
I tried reproducing this while using trusty on the host and was unable to do so. I also could not reproduce with the trusty kernel (currently 3.12) running with saucy userspace on the host. So as far as I can tell the issue is fixed in 3.12. I took a stab at trying to bisect, but something between 3.11 and 3.12-rc1 is causing the machine to not boot. With 3.12-rc1 my VMs failed to boot, and with 3.12-rc2 I couldn't reproduce the issue at all. So it looks like bisecting to find the fix will be nearly impossible. Going through the kvm commits in 3.12 revealed a lot of changes related to running nested VMs but nothing that stood out from the pack. So if anyone _really_ needs this fixed in saucy, let me know, otherwise I'm going to assume that having it fixed in trusty is good enough. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: Confirmed Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: Confirmed Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: qemu-kvm (Ubuntu) Status: New = Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: Confirmed Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: Confirmed Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Stefan: I assigned you in the server team meeting. Please unassign if you object. Thanks! ** Changed in: linux (Ubuntu Saucy) Assignee: (unassigned) = Stefan Bader (smb) ** Changed in: qemu-kvm (Ubuntu Saucy) Assignee: (unassigned) = Stefan Bader (smb) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
As it seemed that starting a 64bit hypervisor (qemu-system-x86_64) from a 32bit user-space running on another 64bit hypervisor has different issues which seem to go back even further, I concentrated on bisecting the case of host running 64bit user-space on a 64bit CPU and the first level guest running 64bit user-space under a 64bit hypervisor. The second level guest is started with a 64bit hypervisor but a 32bit userspace. All host and guests are Saucy and started with the same kernel. Then for bisecting I only replaced the host kernel with kernels between v3.9 and v3.10. Then started a guest and ran the prepare-testbed repeatedly. The first change that broke things was: commit 5f3d5799974b89100268ba813cec8db7bd0693fb KVM: nVMX: Rework event injection and recovery However at that point starting a 2nd level guest is completely broken until: commit 5a2892ce72e010e3cb96b438d7cdddce0c88e0e6 KVM: nVMX: Skip PF interception check when queuing during nested run So potentially the rework patch broke things and the current issue is remaining after fixing the major issues. Though it could be introduced by one of the patches in between but it cannot be bisected. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Btw, James, this means there is a simple but not very helpful work- around for Saucy: use AMD CPU based hosts. Did not check for 32bit user- space on 1rst level but with 64bit and had no issues. Not very surprising as the regression seems to be in the nested VMX code. But also not very useful when working in the cloud... -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
They can be even together. The -nographic removes any emulated graphics card. I am not sure in detail how the cloud images work, but I believe serial line as a console is always on. Depending on which release (in that case I think it is the qemu user-space) the used setup would not work even. Because -monitor stdio redicrects the monitor to stdio and the default of serial was stdio, too. So they did clash (might depend on -nographic as well). So when playing without -nogrphics, and crashes persist, you might play with -vga std which would give a std vga card instead of cirrus. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
'qemu -serial file:/tmp/kvm.log' Looks like an alternative to 'qemu -nographic /tmp/kvm.log 21'. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Re #27, removing -nographic still causes the same lockup for me. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
So host Q and 1rst 32 completed 35 runs and 1rst 64 completed 40. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Latest kernel panic (from 2nd-level guest) using following kernel versions: host: 3.11.0-1-generic (-2 causes problems for my graphics hardware atm) 1st-level guest: 3.11.0-2-generic 2nd-level guest: 3.11.0-2-generic ** Attachment added: kvm.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+attachment/3775059/+files/kvm.log -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
I saw a similar crash when running the prepare script with a Saucy64 host, a Saucy32 1rst and Saucy32 2nd level guest. The 1rst level guest cpu set to core2duo and I also had to replace the qemu-system-x86_64 by qemu (which maps to the same arch). Otherwise the 2nd level guest was not started at all. That would on one run give a double-fault as you had, but the second attempt did succeed. Though both runs had a lot of NMI (reason 21 and 31) messages in them. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Using a 64bit 1rst level guest seemed better on manual runs but running in loops seemed to have locked up on the third run. Though completely without any messages. I have to look into that next week. I need to run again with qmp enabled. At least this allows to check for the instruction pointer of the cpus. But unfortunately I don't know yet how to get any better data from the 2nd level guest. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Now that 3.11 is out of proposed, we're seeing a different kernel failure, starting with run-parts: executing /etc/kernel/postinst.d/zz-update-grub 3.11.0-2-generic /boot/vmlinuz-3.11.0-2-generic Generating grub.cfg ... Found linux image: /boot/vmlinuz-3.11.0-2-generic Found initrd image: /boot/initrd.img-3.11.0-2-generic Found memtest86+ image: /boot/memtest86+.bin [ 776.392144] BUG: soft lockup - CPU#0 stuck for 23s! [modprobe:18758] [ 776.392144] CPU: 0 PID: 18758 Comm: modprobe Tainted: GF 3.11.0-2-generic #5-Ubuntu [ 776.432133] BUG: soft lockup - CPU#1 stuck for 23s! [systemd-udevd:333] [ 776.432133] CPU: 1 PID: 333 Comm: systemd-udevd Tainted: GF 3.11.0-2-generic #5-Ubuntu [ 776.432133] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 776.432133] task: f5f619c0 ti: f5f3c000 task.ti: f5f3c000 [ 776.432133] Stack: [ 776.432133] Call Trace: [ 776.432133] Code: 08 89 0c 24 89 f1 e8 16 fc ff ff e9 36 ff ff ff 90 55 ba 00 01 00 00 89 e5 f0 66 0f c1 10 0f b6 ce 38 d1 74 0d 8d 74 26 00 f3 90 0f b6 10 38 ca 75 f7 5d c3 8d b6 00 00 00 00 8d bc 27 00 00 00 [ 776.392144] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 776.392144] task: f56919c0 ti: f5746000 task.ti: f5746000 ** Attachment added: kvm.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+attachment/3773460/+files/kvm.log -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
To recreate: 1) Follow instructions on internal wiki (page InformationInfrastructure/IS/CanonicalOpenstack) to create a keypair. 2) Create an guest instance: $ keyname=${USER}_lcy01 $ image=$(euca-describe-images|grep saucy|head -1|awk '{print $2}') $ euca-run-instances -k $keyname -t m1.medium $image 3) Identify IP address and instance name (i-): $ euca-describe-instances 4) ssh into system 5) Install required packages: $ sudo apt-get -y install genisoimage linux-image-extra-virtual bzr qemu-kvm qemu-utils 6) Setup groups $ usermod -G kvm -a ubuntu 7) Logout and back in again to pick up kvm group membership. 8) Checkout bzr branch: $ bzr branch lp:auto-package-testing $ cd auto-package-testing 9) Apply patch on this bug to disable byobu and enable kvm logging (to /tmp/kvm.log) 10) Run the following: bin/prepare-testbed -r saucy -d i386 11) tail -f /tmp/kvm.log and wait for massive cpu usage and kernel spew in /tmp/kvm.log. 12) Cleanup: $ euca-terminate-instances i- -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Tags added: patch -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Before running prepare-testbed: - create a directory in /mnt that user ubuntu can write to (say /mnt/adt) - echo BASEDIR=/mnt/adt ~/.adtrc autopkgtest should then use /mnt which has lots of space on medium guests. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Tags removed: kernel-key ** Tags added: kernel-da-key -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
I got the panic again last night. This was running a 3.11 kernel for the host, but of course the 1st and 2nd level guests were still running 3.10 as 3.11 is still in -proposed. So, although it's possible to get a test run with (3.11, 3.10, 3.10) I really need to try running with (3.11, 3.11, 3.11) to see if this provides a reliable solution. ** Changed in: linux (Ubuntu Saucy) Status: Fix Committed = In Progress -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: In Progress Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: In Progress Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Testing with linux-image-3.11.0-0-generic from -proposed with nested=Y in all 3 environments does appear to solve this issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Serge mentioned today on IRC that this may be also a glibc issue, but I am not sure what exactly he was looking at and why he thinks so. Apparently ftracing (I guess the qemu process) and some partially inlining clone function (those with .isra extention) were involved. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
Re: [Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Quoting Stefan Bader (stefan.ba...@canonical.com): Serge mentioned today on IRC that this may be also a glibc issue, but I am not sure what exactly he was looking at and why he thinks so. Apparently ftracing (I guess the qemu process) and some partially inlining clone function (those with .isra extention) were involved. Right, ftrace seems the most likely culprit. In any case, since a newer kernel is confirmed to fix it, disregard anything I said about libc :) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Per comment #13, it sounds like this issue is resolved in the 3.11 kernel, which is what Saucy will be rebased to. Does this issue only exist in Saucy, or should the bug be targeted to other releases as well? ** Also affects: linux (Ubuntu Saucy) Importance: High Status: Incomplete ** Also affects: qemu-kvm (Ubuntu Saucy) Importance: High Status: New ** Changed in: linux (Ubuntu Saucy) Status: Incomplete = Fix Committed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Fix Committed Status in “qemu-kvm” package in Ubuntu: New Status in “linux” source package in Saucy: Fix Committed Status in “qemu-kvm” source package in Saucy: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
Fresh kernel panic from 2nd-level nested VM running with host, 1st level and 2nd level all running with nested=1. ** Attachment added: kvm.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+attachment/3763650/+files/kvm.log -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
** Changed in: qemu-kvm (Ubuntu) Importance: Undecided = High -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1208455] Re: general protection fault running apt-get inside double nested kvm VM
All the kernel logs Ive seen have shown oops at rtc_sysfs_del_device, starting with something like [ 509.317630] general protection fault: [#1] SMP [ 509.320084] Modules linked in: dm_crypt(F) kvm_intel kvm ppdev(F) nls_utf8 isofs(F) microcode(F) parport_pc(F) pvpanic parport(F) psmouse(F) serio_raw(F) i2c_piix4 mac_hid cirrus syscopyarea(F) sysfillrect(F) sysimgblt(F) ttm drm_kms_helper drm floppy(F) e1000(F) [ 509.320084] CPU: 0 PID: 1335 Comm: dpkg Tainted: GF 3.10.0-6-generic #17-Ubuntu [ 509.320084] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 509.320084] task: c6143380 ti: c1a42000 task.ti: c338a000 [ 509.320084] EIP: 0060:[c12e46de] EFLAGS: 00014086 CPU: 0 [ 509.320084] EIP is at number.isra.2+0xe/0x350 [ 509.320084] EAX: c7eec000 EBX: c17e2633 ECX: 0021 EDX: c1a46380 [ 509.320084] ESI: c17e2633 EDI: c1a45fbe EBP: c1a43618 ESP: c1a435ac [ 509.320084] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 [ 509.320084] CR0: 8005003b CR2: CR3: 01a36000 CR4: 06f0 [ 509.320084] DR0: DR1: DR2: DR3: [ 509.320084] DR6: 0ff0 DR7: 0400 [ 509.320084] Stack: [ 509.320084] [ 509.320084] [ 509.320084] c17e262e c17e262f c1a43618 c12e40e3 c1a43648 c17e262e c17e2632 [ 509.320084] Call Trace: [ 509.320084] [c12e40e3] ? format_decode+0x323/0x390 [ 509.320084] [c12e5f8c] vsnprintf+0x2bc/0x390 [ 509.320084] [c12e6076] vscnprintf+0x16/0x30 [ 509.320084] [c104990b] vprintk_emit+0x12b/0x530 [ 509.320084] [c161a120] printk+0x50/0x52 [ 509.320084] [c10347c9] doublefault_fn+0x39/0x120 [ 509.320084] [c14b8c20] ? rtc_sysfs_del_device+0x30/0x30 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1208455 Title: general protection fault running apt-get inside double nested kvm VM Status in “linux” package in Ubuntu: Incomplete Status in “qemu-kvm” package in Ubuntu: New Bug description: Attempting to run apt-get in a nested vm hosted in OpenStack results in a general protection fault in the kernel in the nested VM. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1208455/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp