On Sun, May 12, 2013 at 06:00:38PM +0530, Kashyap Chamarthy wrote:
> >>
> >> I tried to reproduce such a problem, and I found L2 (Linux) hangs in
> >> SeaBIOS, after line "iPXE (http://ipxe.org) ...". It happens with or
> >> w/o VMCS shadowing (and even without my virtual EPT patches). I didn't
> >> realize this problem until I updated the L1 kernel to the latest (e.g.
> >> 3.9.0) from 3.7.0. L0 uses the kvm.git, next branch. It's possible
> >> that the L1 kernel exposed a bug with the nested virtualization, as we
> >> saw such cases before.
> >>
> > This is probably fixed by 8d76c49e9ffeee839bc0b7a3278a23f99101263e. Try
> > it please.
>
> I don't see the above SeaBIOS hang, however I'm able to consistently
> reproduce this stack trace when booting L1 guest:
>
You mean L2 here?
L2 guest cannot find root file system. Unlikely related to KVM.
> ============
> ....
> [ 2.516894] VFS: Cannot open root device "mapper/fedora-root" or
> unknown-block(0,0): error -6
> [ 2.527636] Please append a correct "root=" boot option; here are
> the available partitions:
> [ 2.538792] Kernel panic - not syncing: VFS: Unable to mount root
> fs on unknown-block(0,0)
> [ 2.539716] Pid: 1, comm: swapper/0 Not tainted 3.8.11-200.fc18.x86_64 #1
> [ 2.539716] Call Trace:
> [ 2.539716] [<ffffffff81649c19>] panic+0xc1/0x1d0
> [ 2.539716] [<ffffffff81d010e0>] mount_block_root+0x1fa/0x2ac
> [ 2.539716] [<ffffffff81d011e9>] mount_root+0x57/0x5b
> [ 2.539716] [<ffffffff81d0132a>] prepare_namespace+0x13d/0x176
> [ 2.539716] [<ffffffff81d00e1c>] kernel_init_freeable+0x1cf/0x1da
> [ 2.539716] [<ffffffff81d00610>] ? do_early_param+0x8c/0x8c
> [ 2.539716] [<ffffffff81637ca0>] ? rest_init+0x80/0x80
> [ 2.539716] [<ffffffff81637cae>] kernel_init+0xe/0xf0
> [ 2.539716] [<ffffffff8165bd6c>] ret_from_fork+0x7c/0xb0
> [ 2.539716] [<ffffffff81637ca0>] ? rest_init+0x80/0x80
> [ 2.539716] Uhhuh. NMI received for unknown reason 30 on CPU 1.
> [ 2.539716] Do you have a strange power saving mode enabled?
> [ 2.539716] Dazed and confused, but trying to continue
> [ 2.539716] Uhhuh. NMI received for unknown reason 20 on CPU 1.
> ============
>
> Howver, L1 boots just fine.
>
> When I try to boot L2, it throws this different stack trace.
Who is "it"? The stack trace bellow is from L0 judging by hardware name.
Again not KVM related.
> ============
> [176092.303585] lock(&dev->device_lock);
> [176092.307947]
> [176092.307947] *** DEADLOCK ***
> [176092.307947]
> [176092.314943] 2 locks held by systemd/1:
> [176092.319283] #0: (misc_mtx){+.+.+.}, at: [<ffffffff814534b8>]
> misc_open+0x28/0x1d0
> [176092.328104] #1: (&wdd->lock){+.+...}, at: [<ffffffff81557f22>]
> watchdog_start+0x22/0x80
> [176092.337532]
> [176092.337532] stack backtrace:
> [176092.342661] CPU: 1 PID: 1 Comm: systemd Not tainted
> 3.10.0-0.rc0.git23.1.fc20.x86_64 #1
> [176092.351823] Hardware name: Intel Corporation Shark Bay Client
> platform/Flathead Creek Crb, BIOS HSWLPTU1.86C.0109.R03.1301282055
> 01/28/2013
> [176092.366101] ffffffff8257d070 ffff880241b1b9c0 ffffffff81719128
> ffff880241b1ba00
> [176092.374617] ffffffff81714d75 ffff880241b1ba50 ffff880241b80960
> ffff880241b80000
> [176092.383130] 0000000000000002 0000000000000002 ffff880241b80960
> ffff880241b1bac0
> [176092.391647] Call Trace:
> [176092.394514] [<ffffffff81719128>] dump_stack+0x19/0x1b
> 2m OK ] Re[176092.400430] [<ffffffff81714d75>]
> print_circular_bug+0x201/0x210
> [176092.408898] [<ffffffff810db094>] __lock_acquire+0x17c4/0x1b30
> ached target Shu[176092.415602] [<ffffffff81720d7c>] ?
> _raw_spin_unlock_irq+0x2c/0x50
> [176092.424276] [<ffffffff810dbbf2>] lock_acquire+0xa2/0x1f0
> tdown.
> [176092.430489] [<ffffffff8149028d>] ? mei_wd_ops_start+0x2d/0xf0
> [176092.438070] [<ffffffff8171d590>] mutex_lock_nested+0x80/0x400
> [176092.444772] [<ffffffff8149028d>] ? mei_wd_ops_start+0x2d/0xf0
> [176092.451471] [<ffffffff8149028d>] ? mei_wd_ops_start+0x2d/0xf0
> [176092.458172] [<ffffffff81557f22>] ? watchdog_start+0x22/0x80
> [176092.464678] [<ffffffff81557f22>] ? watchdog_start+0x22/0x80
> [176092.471182] [<ffffffff8149028d>] mei_wd_ops_start+0x2d/0xf0
> [176092.477687] [<ffffffff81557f5d>] watchdog_start+0x5d/0x80
> [176092.483994] [<ffffffff81558168>] watchdog_open+0x88/0xf0
> [176092.490214] [<ffffffff81453547>] misc_open+0xb7/0x1d0
> [176092.496128] [<ffffffff811e15d2>] chrdev_open+0x92/0x1d0
> [176092.502240] [<ffffffff811da57b>] do_dentry_open+0x24b/0x300
> [176092.508745] [<ffffffff812e8e7c>] ? security_inode_permission+0x1c/0x30
> [176092.516330] [<ffffffff811e1540>] ? cdev_put+0x30/0x30
> [176092.522243] [<ffffffff811da670>] finish_open+0x40/0x50
> [176092.528256] [<ffffffff811ec139>] do_last+0x4d9/0xe40
> [176092.534071] [<ffffffff811ecb53>] path_openat+0xb3/0x530
> [176092.540193] [<ffffffff810acc1f>] ? local_clock+0x5f/0x70
> [176092.546403] [<ffffffff8101fcf5>] ? native_sched_clock+0x15/0x80
> [176092.553301] [<ffffffff810d5d9d>] ? trace_hardirqs_off+0xd/0x10
> [176092.560099] [<ffffffff811ed658>] do_filp_open+0x38/0x80
> [176092.566211] [<ffffffff81720c77>] ? _raw_spin_unlock+0x27/0x40
> [176092.572913] [<ffffffff811fc39f>] ? __alloc_fd+0xaf/0x200
> [176092.579123] [<ffffffff811db9a9>] do_sys_open+0xe9/0x1c0
> [176092.585235] [<ffffffff811dba9e>] SyS_open+0x1e/0x20
> [176092.590953] [<ffffffff8172a999>] system_call_fastpath+0x16/0x1b
> Sending SIGTERM to remaining processes...
> [176092.622745] systemd-journald[338]: Received SIGTERM
> Sending SIGKILL to remaining processes...
> Hardware watchdog 'INTCAMT', version 0
> Unmounting file systems.
> Unmounting /sys/kernel/config.
> Unmounting /dev/mqueue.
> Unmounting /dev/hugepages.
> Unmounting /sys/kernel/debug.
> [176094.363845] EXT4-fs (dm-1): re-mounted. Opts: (null)
> [176094.548631] EXT4-fs (dm-1): re-mounted. Opts: (null)
> [176094.554450] EXT4-fs (dm-1): re-mounted. Opts: (null)
> All filesystems unmounted.
> Deactivating swaps.
> All swaps deactivated.
> Detaching loop devices.
> All loop devices detached.
> Detaching DM devices.
> Detaching DM 253:2.
> Detaching DM 253:0.
> Not all DM devices detached, 1 left.
> Detaching DM devices.
> Not all DM devices detached, 1 left.
> Cannot finalize remaining file systems and devices, giving up.
> Storage is finalized.
> Successfully changed into root pivot.
> Returning to initrd...
> [176094.675812] dracut Warning: Killing all remaining processes
> ============
>
>
> L1 Kernel: 3.10.0-0.rc0.git26.1.fc20.x86_64
>
> L2 Kernel: 3.10.0-0.rc0.git26.1.fc20.x86_64
>
> How I re-produced this, I noted it in my previous emails to this thread.
>
> Am I doing anything plain incorrect ?
>
--
Gleb.
--
To unsubscribe from this list: send the line "unsubscribe kvm" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html