[Kernel-packages] [Bug 1632471] Comment bridged from LTC Bugzilla
--- Comment From vipar...@in.ibm.com 2016-11-14 05:34 EDT--- *** Bug 148569 has been marked as a duplicate of this bug. *** -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1632471 Title: Briggs: ISST-LTE:UbuntuKVM: system hangs, console shows all of these messages raw_spin_lock_irqsave, rcu_sched, rcu_bh detected stalls on CPUs #166 Status in linux package in Ubuntu: Fix Released Status in linux source package in Yakkety: Fix Released Bug description: == Comment: #0 - Chanh H. Nguyen- 2016-08-15 11:56:22 == We have the SuperMicro system "Briggs" that have 2 Qlogic cards on it (16Gb and 8Gb) connect to the V7000 storage. We install Ubuntu 16.04.1 kernel -34 on it and run test BASE/IO over weekend on the bare metal mode . System seems to hang now, it responses to ping only, nothing else. Open the console, it doesn't give out the login promt except all of these errors print out ... [323294.686996] INFO: rcu_bh detected stalls on CPUs/tasks: [323294.687105] 3-...: (1 GPs behind) idle=813/140/0 softirq=9880043/9935887 fqs=48656494 [323294.687187] 71-...: (1 GPs behind) idle=a99/140/0 softirq=9875483/9935684 fqs=48656494 [323294.687268] 153-...: (1 GPs behind) idle=321/140/0 softirq=3948104/3976836 fqs=48656494 [323294.687346] (detected by 75, t=48672447 jiffies, g=79, c=78, q=706) [323294.687427] Task dump for CPU 3: [323294.687462] gmond R running task0 16394 1 0x00040004 [323294.687542] Call Trace: [323294.687568] [c03fb3bdb700] [c03fb3bdb740] 0xc03fb3bdb740 (unreliable) [323294.687648] [c03fb3bdb8d0] [c03fec8de900] 0xc03fec8de900 [323294.687716] [c03fb3bdb920] [0020] 0x20 [323294.687773] [c03fb3bdb960] [c03fb3bdb9b0] 0xc03fb3bdb9b0 [323294.687842] [c03fb3bdb9b0] [c00f9d14] task_sched_runtime+0xc4/0x250 [323294.687922] [c03fb3bdba20] [c01003d8] thread_group_cputime+0xc8/0x1c0 [323294.688002] [c03fb3bdba80] [c0100720] thread_group_cputime_adjusted+0x40/0x80 [323294.688082] [c03fb3bdbae0] [c0385428] do_task_stat+0x2b8/0xaf0 [323294.688152] [c03fb3bdbc60] [c037c710] proc_single_show+0x80/0x100 [323294.688232] [c03fb3bdbcb0] [c0317808] seq_read+0xe8/0x530 [323294.688302] [c03fb3bdbd50] [c02e170c] __vfs_read+0x6c/0xe0 [323294.688412] [c03fb3bdbd90] [c02e2464] vfs_read+0xa4/0x1c0 [323294.688481] [c03fb3bdbde0] [c02e356c] SyS_read+0x6c/0x110 [323294.688550] [c03fb3bdbe30] [c0009204] system_call+0x38/0xb4 [323294.688618] Task dump for CPU 71: [323294.688653] fs_inod R running task0 151173 78575 0x00040004 [323294.688735] Call Trace: [323294.688760] [c03fbcd17890] [c05cc0adee00] 0xc05cc0adee00 (unreliable) [323294.688840] Task dump for CPU 153: [323294.688876] fs_inod D 3fffafd1efb8 0 151172 79296 0x00040004 [323294.688956] Call Trace: [323294.688981] [c05a398675e0] [004352ca] 0x4352ca (unreliable) [323294.689049] [c05a398677b0] [c03feee5e900] 0xc03feee5e900 [323294.689118] [c05a39867800] [c0ae8604] __schedule+0x314/0x990 [323294.689187] [c05a398678d0] [c0ae8cc8] schedule+0x48/0xc0 [323294.689257] [c05a39867900] [c0aecc08] rwsem_down_write_failed+0x2b8/0x410 [323294.689337] [c05a39867990] [c0aebdf8] down_write+0x78/0xa0 [323294.689407] [c05a398679c0] [c02797bc] unlink_file_vma+0x4c/0x90 [323294.689475] [c05a39867a00] [c0270110] free_pgtables+0x100/0x1c0 [323294.689543] [c05a39867a50] [c027d4e0] exit_mmap+0x100/0x1a0 [323294.689612] [c05a39867b10] [c00b5098] mmput+0xa8/0x1b0 [323294.689681] [c05a39867b40] [c02ec740] flush_old_exec+0x680/0x840 [323294.689792] [c05a39867bb0] [c036412c] load_elf_binary+0x43c/0xf90 [323294.689872] [c05a39867c90] [c02ecbb8] search_binary_handler+0xe8/0x2a0 [323294.689951] [c05a39867d20] [c02edad0] do_execveat_common.isra.14+0x600/0x850 [323294.690031] [c05a39867df0] [c02ee13c] SyS_execve+0x5c/0x80 [323294.690098] [c05a39867e30] [c0009204] system_call+0x38/0xb4 [323294.926994] INFO: rcu_sched self-detected stall on CPU [323294.927058] 113-...: (48720536 ticks this GP) idle=df7/141/0 softirq=3730603/3730614 fqs=48343855 [323294.927138](t=48734941 jiffies g=6962468 c=6962467 q=43612779) [323294.927210] Task dump for CPU 71: [323294.927241] fs_inod R running task0 151173 78575 0x00040004 [323294.927312] Call Trace:
[Kernel-packages] [Bug 1632471] Comment bridged from LTC Bugzilla
--- Comment From sarah.han...@us.ibm.com 2016-10-28 11:23 EDT--- What's the next step for this bug? --- Comment From s...@us.ibm.com 2016-10-28 11:28 EDT--- Thank you. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1632471 Title: Briggs: ISST-LTE:UbuntuKVM: system hangs, console shows all of these messages raw_spin_lock_irqsave, rcu_sched, rcu_bh detected stalls on CPUs #166 Status in linux package in Ubuntu: Fix Released Status in linux source package in Yakkety: Fix Released Bug description: == Comment: #0 - Chanh H. Nguyen- 2016-08-15 11:56:22 == We have the SuperMicro system "Briggs" that have 2 Qlogic cards on it (16Gb and 8Gb) connect to the V7000 storage. We install Ubuntu 16.04.1 kernel -34 on it and run test BASE/IO over weekend on the bare metal mode . System seems to hang now, it responses to ping only, nothing else. Open the console, it doesn't give out the login promt except all of these errors print out ... [323294.686996] INFO: rcu_bh detected stalls on CPUs/tasks: [323294.687105] 3-...: (1 GPs behind) idle=813/140/0 softirq=9880043/9935887 fqs=48656494 [323294.687187] 71-...: (1 GPs behind) idle=a99/140/0 softirq=9875483/9935684 fqs=48656494 [323294.687268] 153-...: (1 GPs behind) idle=321/140/0 softirq=3948104/3976836 fqs=48656494 [323294.687346] (detected by 75, t=48672447 jiffies, g=79, c=78, q=706) [323294.687427] Task dump for CPU 3: [323294.687462] gmond R running task0 16394 1 0x00040004 [323294.687542] Call Trace: [323294.687568] [c03fb3bdb700] [c03fb3bdb740] 0xc03fb3bdb740 (unreliable) [323294.687648] [c03fb3bdb8d0] [c03fec8de900] 0xc03fec8de900 [323294.687716] [c03fb3bdb920] [0020] 0x20 [323294.687773] [c03fb3bdb960] [c03fb3bdb9b0] 0xc03fb3bdb9b0 [323294.687842] [c03fb3bdb9b0] [c00f9d14] task_sched_runtime+0xc4/0x250 [323294.687922] [c03fb3bdba20] [c01003d8] thread_group_cputime+0xc8/0x1c0 [323294.688002] [c03fb3bdba80] [c0100720] thread_group_cputime_adjusted+0x40/0x80 [323294.688082] [c03fb3bdbae0] [c0385428] do_task_stat+0x2b8/0xaf0 [323294.688152] [c03fb3bdbc60] [c037c710] proc_single_show+0x80/0x100 [323294.688232] [c03fb3bdbcb0] [c0317808] seq_read+0xe8/0x530 [323294.688302] [c03fb3bdbd50] [c02e170c] __vfs_read+0x6c/0xe0 [323294.688412] [c03fb3bdbd90] [c02e2464] vfs_read+0xa4/0x1c0 [323294.688481] [c03fb3bdbde0] [c02e356c] SyS_read+0x6c/0x110 [323294.688550] [c03fb3bdbe30] [c0009204] system_call+0x38/0xb4 [323294.688618] Task dump for CPU 71: [323294.688653] fs_inod R running task0 151173 78575 0x00040004 [323294.688735] Call Trace: [323294.688760] [c03fbcd17890] [c05cc0adee00] 0xc05cc0adee00 (unreliable) [323294.688840] Task dump for CPU 153: [323294.688876] fs_inod D 3fffafd1efb8 0 151172 79296 0x00040004 [323294.688956] Call Trace: [323294.688981] [c05a398675e0] [004352ca] 0x4352ca (unreliable) [323294.689049] [c05a398677b0] [c03feee5e900] 0xc03feee5e900 [323294.689118] [c05a39867800] [c0ae8604] __schedule+0x314/0x990 [323294.689187] [c05a398678d0] [c0ae8cc8] schedule+0x48/0xc0 [323294.689257] [c05a39867900] [c0aecc08] rwsem_down_write_failed+0x2b8/0x410 [323294.689337] [c05a39867990] [c0aebdf8] down_write+0x78/0xa0 [323294.689407] [c05a398679c0] [c02797bc] unlink_file_vma+0x4c/0x90 [323294.689475] [c05a39867a00] [c0270110] free_pgtables+0x100/0x1c0 [323294.689543] [c05a39867a50] [c027d4e0] exit_mmap+0x100/0x1a0 [323294.689612] [c05a39867b10] [c00b5098] mmput+0xa8/0x1b0 [323294.689681] [c05a39867b40] [c02ec740] flush_old_exec+0x680/0x840 [323294.689792] [c05a39867bb0] [c036412c] load_elf_binary+0x43c/0xf90 [323294.689872] [c05a39867c90] [c02ecbb8] search_binary_handler+0xe8/0x2a0 [323294.689951] [c05a39867d20] [c02edad0] do_execveat_common.isra.14+0x600/0x850 [323294.690031] [c05a39867df0] [c02ee13c] SyS_execve+0x5c/0x80 [323294.690098] [c05a39867e30] [c0009204] system_call+0x38/0xb4 [323294.926994] INFO: rcu_sched self-detected stall on CPU [323294.927058] 113-...: (48720536 ticks this GP) idle=df7/141/0 softirq=3730603/3730614 fqs=48343855 [323294.927138](t=48734941 jiffies g=6962468 c=6962467 q=43612779) [323294.927210] Task dump for CPU 71: [323294.927241] fs_inod R running task0 151173