[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu) Assignee: Tim Gardner (timg-tpi) => (unassigned) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Released Status in linux source package in Yakkety: Won't Fix Status in linux source package in Zesty: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu Yakkety) Status: In Progress => Won't Fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Released Status in linux source package in Yakkety: Won't Fix Status in linux source package in Zesty: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
Hi Lekshmi, Thank you for testing the fix on 4.4.0-78.99. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Released Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu Zesty) Status: In Progress => Incomplete -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Released Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu Yakkety) Assignee: Tim Gardner (timg-tpi) => Kleber Sacilotto de Souza (kleber-souza) ** Changed in: linux (Ubuntu Zesty) Assignee: Tim Gardner (timg-tpi) => Kleber Sacilotto de Souza (kleber-souza) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Released Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
This bug was fixed in the package linux - 4.4.0-78.99 --- linux (4.4.0-78.99) xenial; urgency=low * linux: 4.4.0-78.99 -proposed tracker (LP: #1686645) * Please backport fix to reference leak in cgroup blkio throttle (LP: #1683976) - block: fix module reference leak on put_disk() call for cgroups throttle * UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic (LP: #1659111) - block: Unhash block device inodes on gendisk destruction - block: Use pointer to backing_dev_info from request_queue - block: Dynamically allocate and refcount backing_dev_info - block: Make blk_get_backing_dev_info() safe without open bdev - block: Get rid of blk_get_backing_dev_info() - block: Move bdev_unhash_inode() after invalidate_partition() - block: Unhash also block device inode for the whole device - block: Revalidate i_bdev reference in bd_aquire() - block: Initialize bd_bdi on inode initialization - block: Move bdi_unregister() to del_gendisk() - block: Allow bdi re-registration - bdi: Fix use-after-free in wb_congested_put() - block: Make del_gendisk() safer for disks without queues - block: Fix bdi assignment to bdev inode when racing with disk delete - bdi: Mark congested->bdi as internal - bdi: Make wb->bdi a proper reference - bdi: Unify bdi->wb_list handling for root wb_writeback - bdi: Shutdown writeback on all cgwbs in cgwb_bdi_destroy() - bdi: Do not wait for cgwbs release in bdi_unregister() - bdi: Rename cgwb_bdi_destroy() to cgwb_bdi_unregister() - block: Fix oops in locked_inode_to_wb_and_lock_list() - kobject: Export kobject_get_unless_zero() - block: Fix oops scsi_disk_get() * Touchpad not working correctly after kernel upgrade (LP: #1662589) - Input: ALPS - fix V8+ protocol handling (73 03 28) * Xenial update to v4.4.62 stable release (LP: #1683728) - drm/i915: Avoid tweaking evaluation thresholds on Baytrail v3 - drm/i915: Stop using RP_DOWN_EI on Baytrail - usb: dwc3: gadget: delay unmap of bounced requests - mtd: bcm47xxpart: fix parsing first block after aligned TRX - MIPS: Introduce irq_stack - MIPS: Stack unwinding while on IRQ stack - MIPS: Only change $28 to thread_info if coming from user mode - MIPS: Switch to the irq_stack in interrupts - MIPS: Select HAVE_IRQ_EXIT_ON_IRQ_STACK - MIPS: IRQ Stack: Fix erroneous jal to plat_irq_dispatch - crypto: caam - fix RNG deinstantiation error checking - Linux 4.4.62 * ifup service of network device stay active after driver stop (LP: #1672144) - net: use net->count to check whether a netns is alive or not * [Hyper-V] mkfs regression in kernel 4.4+ (LP: #1682215) - block: relax check on sg gap * [Feature] KBL: intel_powerclamp driver support (LP: #1591641) - thermal/powerclamp: remove cpu whitelist - thermal/powerclamp: correct cpu support check - thermal/powerclamp: add back module device table * sysfs channel reads of lps22hb pressure sensor are stale (LP: #1682103) - iio: st_pressure: initialize lps22hb bootime * Backlight control does not work and there are no entries in /sys/class/backlight (LP: #1667323) - Revert "ACPI / video: Add force_native quirk for HP Pavilion dv6" * [Feature] KBL: intel_rapl driver support (LP: #1591640) - powercap/intel_rapl: Add support for Kabylake * Xenial update to v4.4.61 stable release (LP: #1682140) - drm/vmwgfx: Type-check lookups of fence objects - drm/vmwgfx: NULL pointer dereference in vmw_surface_define_ioctl() - drm/vmwgfx: avoid calling vzalloc with a 0 size in vmw_get_cap_3d_ioctl() - drm/ttm, drm/vmwgfx: Relax permission checking when opening surfaces - drm/vmwgfx: Remove getparam error message - drm/vmwgfx: fix integer overflow in vmw_surface_define_ioctl() - sysfs: be careful of error returns from ops->show() - staging: android: ashmem: lseek failed due to no FMODE_LSEEK. - arm/arm64: KVM: Take mmap_sem in stage2_unmap_vm - arm/arm64: KVM: Take mmap_sem in kvm_arch_prepare_memory_region - iio: bmg160: reset chip when probing - Reset TreeId to zero on SMB2 TREE_CONNECT - ptrace: fix PTRACE_LISTEN race corrupting task->state - ring-buffer: Fix return value check in test_ringbuffer() - metag/usercopy: Drop unused macros - metag/usercopy: Fix alignment error checking - metag/usercopy: Add early abort to copy_to_user - metag/usercopy: Zero rest of buffer from copy_from_user - metag/usercopy: Set flags before ADDZ - metag/usercopy: Fix src fixup in from user rapf loops - metag/usercopy: Add missing fixups - powerpc/mm: Add missing global TLB invalidate if cxl is active - powerpc: Don't try to fix up misaligned load-with-reservation instructions - nios2: reserve boot memory for device tree - s390/decompressor: fix initrd corruption caused by bss
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
Hello IBM, The fix for this issue has been included on linux kernel 4.4.0-78.99 for Xenial, which is about to be promoted from -proposed to -updates. Could you please verify if this kernel version fixes the issue? Thank you. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Committed Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70]
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu Xenial) Assignee: Tim Gardner (timg-tpi) => Kleber Sacilotto de Souza (kleber-souza) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Committed Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed- xenial' to 'verification-done-xenial'. If the problem still exists, change the tag 'verification-needed-xenial' to 'verification-failed- xenial'. If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you! ** Tags added: verification-needed-xenial -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Committed Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0]
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Tags removed: targetmilestone-inin--- ** Tags added: targetmilestone-inin16043 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Committed Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu Xenial) Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: Fix Committed Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
https://lists.ubuntu.com/archives/kernel-team/2017-April/083530.html ** Changed in: linux (Ubuntu Xenial) Status: New => In Progress -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: In Progress Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
Thiago - can you note which patches are backports and which files had conflicts ? ** Also affects: linux (Ubuntu Zesty) Importance: High Assignee: Canonical Kernel Team (canonical-kernel-team) Status: Triaged ** Also affects: linux (Ubuntu Yakkety) Importance: Undecided Status: New ** Also affects: linux (Ubuntu Xenial) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Xenial) Assignee: (unassigned) => Tim Gardner (timg-tpi) ** Changed in: linux (Ubuntu Yakkety) Status: New => In Progress ** Changed in: linux (Ubuntu Yakkety) Assignee: (unassigned) => Tim Gardner (timg-tpi) ** Changed in: linux (Ubuntu Zesty) Status: Triaged => In Progress ** Changed in: linux (Ubuntu Zesty) Assignee: Canonical Kernel Team (canonical-kernel-team) => Tim Gardner (timg-tpi) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: In Progress Status in linux source package in Xenial: New Status in linux source package in Yakkety: In Progress Status in linux source package in Zesty: In Progress Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu) Assignee: Taco Screen team (taco-screen-team) => Canonical Kernel Team (canonical-kernel-team) ** Changed in: linux (Ubuntu) Importance: Undecided => High ** Changed in: linux (Ubuntu) Status: Incomplete => Triaged -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Triaged Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Tags added: bugnameltc-149014 severity-critical -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Tags removed: bugnameltc-149014 severity-critical -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
Kernel team is aware of this bug, removing Tasty Taco ** Changed in: linux (Ubuntu) Assignee: Taco Screen team (taco-screen-team) => (unassigned) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80]
[Kernel-packages] [Bug 1659111] Re: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic
** Changed in: linux (Ubuntu) Assignee: (unassigned) => Taco Screen team (taco-screen-team) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1659111 Title: UbuntuKVM guest crashed while running I/O stress test with Ubuntu kernel 4.4.0-47-generic Status in linux package in Ubuntu: Incomplete Bug description: Attn. Canonical: For your awareness only at this time. == Comment: #0 - LEKSHMI C. PILLAI - 2016-11-22 03:49:38 == Machine INFO KVM HOST: luckyv1 Guest :lucky05 lucky05 crashed while running the I/O stress test for SAN disks. Installed lucky05 and enabled the xmon on that.After that started the RAW disk test on around 50 disks.After 6-7 hours after running,Now machine dropped into xmon. Logs: [25023.224182] Unable to handle kernel paging request for data at address 0x [25023.224257] Faulting instruction address: 0xc0324c60 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3620] pc: c0324c60: locked_inode_to_wb_and_lock_list+0x50/0x290 lr: c032831c: writeback_sb_inodes+0x30c/0x590 sp: c000fffc38a0 msr: 80019033 dar: 0 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> f 3:mon> th [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130 [c000fffc3e30] c0009538 ret_from_kernel_thread+0x5c/0xa4 3:mon> sh [27384.651055] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651220] (detected by 4, t=40598 jiffies, g=2849830, c=2849829, q=992) [27384.651286] All QSes seen, last rcu_sched kthread activity 40596 (4301188714-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.651501] rcu_sched kthread starved for 40596 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.651747] INFO: rcu_sched detected stalls on CPUs/tasks: [27384.651905] (detected by 4, t=590354 jiffies, g=2849830, c=2849829, q=1285) [27384.652012] All QSes seen, last rcu_sched kthread activity 590352 (4301738470-4301148118), jiffies_till_next_fqs=1, root ->qsmask 0x0 [27384.652191] rcu_sched kthread starved for 590352 jiffies! g2849830 c2849829 f0x2 s3 ->state=0x0 [27384.730645] Unable to handle kernel paging request for data at address 0xffd8 [27384.730781] Faulting instruction address: 0xc00e7258 cpu 0x3: Vector: 300 (Data Access) at [c000fffc3000] pc: c00e7258: kthread_data+0x28/0x40 lr: c00de940: wq_worker_sleeping+0x30/0x110 sp: c000fffc3280 msr: 80019033 dar: ffd8 dsisr: 4000 current = 0xc000ff99e470 paca= 0xcfb41c80 softe: 0irq_happened: 0x01 pid = 14736, comm = kworker/u16:8 enter ? for help == Comment: #1 - LEKSHMI C. PILLAI - 2016-11-22 04:05:41 == 3:mon> th [c000fffc32b0] c00de940 wq_worker_sleeping+0x30/0x110 [c000fffc32f0] c0af31bc __schedule+0x6ec/0x990 [c000fffc33c0] c0af34a8 schedule+0x48/0xc0 [c000fffc33f0] c00bd3d0 do_exit+0x760/0xc30 [c000fffc34b0] c0020bf4 die+0x314/0x470 [c000fffc3540] c0050d98 bad_page_fault+0xd8/0x150 [c000fffc35b0] c0008680 handle_page_fault+0x2c/0x30 --- Exception: 300 (Data Access) at c0324c60 locked_inode_to_wb_and_lock_list+0x50/0x290 [c000fffc3900] c032831c writeback_sb_inodes+0x30c/0x590 [c000fffc3a10] c0328684 __writeback_inodes_wb+0xe4/0x150 [c000fffc3a70] c0328aec wb_writeback+0x30c/0x450 [c000fffc3b40] c03296b4 wb_workfn+0x264/0x570 [c000fffc3c50] c00dd930 process_one_work+0x1e0/0x5a0 [c000fffc3ce0] c00dde84 worker_thread+0x194/0x680 [c000fffc3d80] c00e6980 kthread+0x110/0x130
