Fortunately, I was able to observe that this is not a regression from
3.2.0-23 to 3.2.0-24. We have a server which is running 3.2.0-23 which
output the same errors. Here is the output in dmesg:
[988120.548020] INFO: rcu_bh detected stall on CPU 1 (t=0 jiffies)
[988120.548041] sending NMI to all CPUs:
[988120.548054] NMI backtrace for cpu 3
[988120.548057] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548089]
[988120.548093] Pid: 29646, comm: svn Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548099] EIP: 0073:[<b6b8242b>] EFLAGS: 00000286 CPU: 3
[988120.548104] EIP is at 0xb6b8242b
[988120.548106] EAX: 00000001 EBX: b6ba4da8 ECX: 00000001 EDX: b6b8e880
[988120.548109] ESI: 08d04218 EDI: 00000001 EBP: b6b52f00 ESP: bff8feac
[988120.548111] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
[988120.548114] Process svn (pid: 29646, ti=c736a000 task=d22f8000
task.ti=c736a000)
[988120.548139]
[988120.548141] Call Trace:
[988120.548147] NMI backtrace for cpu 4
[988120.548151] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548183]
[988120.548186] Pid: 6836, comm: svn Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548193] EIP: 0073:[<b6b8dfa7>] EFLAGS: 00000286 CPU: 4
[988120.548198] EIP is at 0xb6b8dfa7
[988120.548201] EAX: 0916b670 EBX: b6bd0da8 ECX: 00000000 EDX: 00000001
[988120.548203] ESI: 0916b670 EDI: 00000001 EBP: b6b7ef00 ESP: bfe5442c
[988120.548206] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
[988120.548209] Process svn (pid: 6836, ti=d3232000 task=d3d1e500
task.ti=d3232000)
[988120.548235]
[988120.548236] Call Trace:
[988120.548243] NMI backtrace for cpu 0
[988120.548247] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548280]
[988120.548283] Pid: 12714, comm: svn Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548289] EIP: 0073:[<b74aeb8e>] EFLAGS: 00000287 CPU: 0
[988120.548294] EIP is at 0xb74aeb8e
[988120.548297] EAX: 00000000 EBX: b7609ff4 ECX: fffffff9 EDX: 00000000
[988120.548299] ESI: bfc2bd80 EDI: b6ba9f06 EBP: bfc2bd48 ESP: bfc2b7a0
[988120.548301] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
[988120.548304] Process svn (pid: 12714, ti=dc8e2000 task=dc3ecbc0
task.ti=dc8e2000)
[988120.548329]
[988120.548331] Call Trace:
[988120.548337] NMI backtrace for cpu 5
[988120.548341] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548372]
[988120.548375] Pid: 11057, comm: svn Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548382] EIP: 0073:[<b6bc19b0>] EFLAGS: 00000202 CPU: 5
[988120.548387] EIP is at 0xb6bc19b0
[988120.548390] EAX: 09043670 EBX: b6bb1ff4 ECX: 00000000 EDX: 00000001
[988120.548392] ESI: 09042980 EDI: 00000001 EBP: b6ba8f00 ESP: bfb63aac
[988120.548395] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
[988120.548398] Process svn (pid: 11057, ti=d5908000 task=df8b8000
task.ti=d5908000)
[988120.548425]
[988120.548427] Call Trace:
[988120.548434] NMI backtrace for cpu 2
[988120.548438] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548470]
[988120.548473] Pid: 0, comm: swapper/2 Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548480] EIP: 0060:[<c10356ea>] EFLAGS: 00000246 CPU: 2
[988120.548487] EIP is at native_safe_halt+0xa/0x10
[988120.548489] EAX: 00000000 EBX: f74e5f70 ECX: 00000000 EDX: 00000000
[988120.548492] ESI: c1875338 EDI: 34c39b81 EBP: f74e5f38 ESP: f74e5f38
[988120.548494] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[988120.548497] Process swapper/2 (pid: 0, ti=f74e4000 task=f74d4bc0
task.ti=f74e4000)
[988120.548523] Stack:
[988120.548531] f74e5f58 c101872a 00000000 ba1eec00 00000002 f74e5f70 c1875338
34c39b81
[988120.548539] f74e5f60 c101888f f74e5f7c c10188fd 00000002 f7883a40 00000000
00000002
[988120.548545] c1875338 f74e5f98 c1010388 411bec1c 34c39b81 6e3d7dff 00000000
00000001
[988120.548551] Call Trace:
[988120.548561] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.548565] [<c101888f>] default_idle+0x1f/0x40
[988120.548568] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.548572] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.548577] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.548579] Code: 00 55 89 e5 3e 8d 74 26 00 fa 5d c3 90 8d 74 26 00 55 89
e5 3e 8d 74 26 00 fb 5d c3 90 8d 74 26 00 55 89 e5 3e 8d 74 26 00 fb f4 <5d> c3
8d 74 26 00 55 89 e5 3e 8d 74 26 00 f4 5d c3 90 8d 74 26
[988120.548730] Call Trace:
[988120.548732] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.548735] [<c101888f>] default_idle+0x1f/0x40
[988120.548738] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.548741] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.548744] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.548747] NMI backtrace for cpu 1
[988120.548749] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.548781]
[988120.548784] Pid: 0, comm: swapper/1 Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.548790] EIP: 0060:[<c12b6011>] EFLAGS: 00000086 CPU: 1
[988120.548797] EIP is at __const_udelay+0x1/0x30
[988120.548799] EAX: 00418958 EBX: 00002710 ECX: c18111c0 EDX: fffff000
[988120.548802] ESI: 0eb83c81 EDI: c1820940 EBP: f74cfdd0 ESP: f74cfdc0
[988120.548804] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[988120.548807] Process swapper/1 (pid: 0, ti=f74ce000 task=f74d0ca0
task.ti=f74ce000)
[988120.548830] Stack:
[988120.548839] f74cfdd0 c102d11a c1743f07 c1820940 f74cfdf0 c10c5343 c1753978
c174c0c9
[988120.548846] 00000001 00000000 f7843bc0 c1820940 f74cfe04 c10c53ba 00000000
00000001
[988120.548852] f74d0ca0 f74cfe20 c10c5899 00000000 00000001 00000000 00000001
f74d0ca0
[988120.548858] Call Trace:
[988120.548870] [<c102d11a>] ? arch_trigger_all_cpu_backtrace+0x5a/0x80
[988120.548875] [<c10c5343>] check_cpu_stall.isra.36+0x93/0xe0
[988120.548878] [<c10c53ba>] __rcu_pending+0x2a/0x140
[988120.548881] [<c10c5899>] rcu_check_callbacks+0x199/0x1d0
[988120.548885] [<c1069fab>] update_process_times+0x3b/0x70
[988120.548890] [<c108b52e>] tick_sched_timer+0x5e/0xc0
[988120.548894] [<c107d480>] ? __remove_hrtimer+0x40/0xa0
[988120.548897] [<c107dbaf>] __run_hrtimer+0x6f/0x1b0
[988120.548900] [<c108b4d0>] ? tick_nohz_handler+0x100/0x100
[988120.548903] [<c107e525>] hrtimer_interrupt+0xe5/0x260
[988120.548907] [<c10800ea>] ? sched_clock_idle_wakeup_event+0x1a/0x20
[988120.548912] [<c15af924>] smp_apic_timer_interrupt+0x54/0x88
[988120.548917] [<c15a8569>] apic_timer_interrupt+0x31/0x38
[988120.548921] [<c10356ea>] ? native_safe_halt+0xa/0x10
[988120.548925] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.548928] [<c101888f>] default_idle+0x1f/0x40
[988120.548931] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.548935] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.548940] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.548942] Code: 00 00 00 8d bc 27 00 00 00 00 48 75 fd 48 5d c3 8d 76 00
8d bc 27 00 00 00 00 55 89 e5 3e 8d 74 26 00 ff 15 d0 fb 83 c1 5d c3 55 <89> e5
3e 8d 74 26 00 64 8b 15 5c 0d 93 c1 6b d2 3e c1 e0 02 f7
[988120.549143] Call Trace:
[988120.549146] [<c102d11a>] ? arch_trigger_all_cpu_backtrace+0x5a/0x80
[988120.549149] [<c10c5343>] check_cpu_stall.isra.36+0x93/0xe0
[988120.549152] [<c10c53ba>] __rcu_pending+0x2a/0x140
[988120.549155] [<c10c5899>] rcu_check_callbacks+0x199/0x1d0
[988120.549158] [<c1069fab>] update_process_times+0x3b/0x70
[988120.549161] [<c108b52e>] tick_sched_timer+0x5e/0xc0
[988120.549164] [<c107d480>] ? __remove_hrtimer+0x40/0xa0
[988120.549167] [<c107dbaf>] __run_hrtimer+0x6f/0x1b0
[988120.549170] [<c108b4d0>] ? tick_nohz_handler+0x100/0x100
[988120.549173] [<c107e525>] hrtimer_interrupt+0xe5/0x260
[988120.549176] [<c10800ea>] ? sched_clock_idle_wakeup_event+0x1a/0x20
[988120.549180] [<c15af924>] smp_apic_timer_interrupt+0x54/0x88
[988120.549183] [<c15a8569>] apic_timer_interrupt+0x31/0x38
[988120.549186] [<c10356ea>] ? native_safe_halt+0xa/0x10
[988120.549189] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.549192] [<c101888f>] default_idle+0x1f/0x40
[988120.549195] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.549198] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.549201] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.549206] NMI backtrace for cpu 6
[988120.549211] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.549242]
[988120.549245] Pid: 0, comm: swapper/6 Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.549252] EIP: 0060:[<c10356ea>] EFLAGS: 00000246 CPU: 6
[988120.549260] EIP is at native_safe_halt+0xa/0x10
[988120.549263] EAX: 00000000 EBX: f7561f70 ECX: 00000000 EDX: 00000000
[988120.549266] ESI: c1875338 EDI: 15fa3422 EBP: f7561f38 ESP: f7561f38
[988120.549268] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[988120.549271] Process swapper/6 (pid: 0, ti=f7560000 task=f752cbc0
task.ti=f7560000)
[988120.549355] Stack:
[988120.549390] f7561f58 c101872a 00000000 3bedc000 00000006 f7561f70 c1875338
15fa3422
[988120.549397] f7561f60 c101888f f7561f7c c10188fd 00000006 f7983a40 00000000
00000006
[988120.549404] c1875338 f7561f98 c1010388 6f348d83 15fa3422 98ae6eb6 00000000
00000001
[988120.549410] Call Trace:
[988120.549452] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.549456] [<c101888f>] default_idle+0x1f/0x40
[988120.549459] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.549464] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.549470] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.549472] Code: 00 55 89 e5 3e 8d 74 26 00 fa 5d c3 90 8d 74 26 00 55 89
e5 3e 8d 74 26 00 fb 5d c3 90 8d 74 26 00 55 89 e5 3e 8d 74 26 00 fb f4 <5d> c3
8d 74 26 00 55 89 e5 3e 8d 74 26 00 f4 5d c3 90 8d 74 26
[988120.549705] Call Trace:
[988120.549708] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.549711] [<c101888f>] default_idle+0x1f/0x40
[988120.549714] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.549717] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.549720] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.543148] NMI backtrace for cpu 7
[988120.543148] Modules linked in: tcp_diag inet_diag autofs4 nfsd nfs lockd
fscache auth_rpcgss nfs_acl binfmt_misc sunrpc nv_tco k10temp i2c_nforce2
psmouse mac_hid shpchp serio_raw raid10 raid456 async_raid6_recov async_pq
raid6_pq async_xor usbhid hid tg3 sata_nv pata_amd xor async_memcpy async_tx
raid1 raid0 multipath linear
[988120.543148]
[988120.543148] Pid: 0, comm: swapper/7 Not tainted 3.2.0-23-generic-pae
#36-Ubuntu Sun Microsystems Sun Fire X2200 M2 with Quad Core Processor/S39
[988120.543148] EIP: 0060:[<c10356ea>] EFLAGS: 00000246 CPU: 7
[988120.543148] EIP is at native_safe_halt+0xa/0x10
[988120.543148] EAX: 00000000 EBX: f756ff70 ECX: 00000000 EDX: 00000000
[988120.543148] ESI: c1875338 EDI: 56700a9b EBP: f756ff38 ESP: f756ff38
[988120.543148] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068
[988120.543148] Process swapper/7 (pid: 0, ti=f756e000 task=f7570ca0
task.ti=f756e000)
[988120.543148] Stack:
[988120.543148] f756ff58 c101872a 00000000 175d7200 00000007 f756ff70 c1875338
56700a9b
[988120.543148] f756ff60 c101888f f756ff7c c10188fd 00000007 f79c3a40 00000000
00000007
[988120.543148] c1875338 f756ff98 c1010388 abab4e8a 56700a9b 1b79b3ce 00000000
00000001
[988120.543148] Call Trace:
[988120.543148] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.543148] [<c101888f>] default_idle+0x1f/0x40
[988120.543148] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.543148] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.543148] [<c158b8d4>] start_secondary+0xe8/0xed
[988120.543148] Code: 00 55 89 e5 3e 8d 74 26 00 fa 5d c3 90 8d 74 26 00 55 89
e5 3e 8d 74 26 00 fb 5d c3 90 8d 74 26 00 55 89 e5 3e 8d 74 26 00 fb f4 <5d> c3
8d 74 26 00 55 89 e5 3e 8d 74 26 00 f4 5d c3 90 8d 74 26
[988120.543148] Call Trace:
[988120.543148] [<c101872a>] default_idle.part.4+0x4a/0x190
[988120.543148] [<c101888f>] default_idle+0x1f/0x40
[988120.543148] [<c10188fd>] amd_e400_idle+0x4d/0x100
[988120.543148] [<c1010388>] cpu_idle+0xa8/0xe0
[988120.543148] [<c158b8d4>] start_secondary+0xe8/0xed
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1003081
Title:
INFO: rcu_bh detected stall on CPU 3 (t=0 jiffies)
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1003081/+subscriptions
--
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs