Hello,
I experience frequent kernel crashes with the CentOS vzkernel provided
by OpenVZ. After installing the corresponding vzkernel-devel and
-debuginfo packages, I now have a crash coredump available for
debugging.
These are my first steps at debugging a kernel crash, so please bear
with me :)
The crash seems to happen in function start_secondary() of
arch/x86/kernel/smpboot.c. To be exact, in line 380, which is the
closing bracket of the function.
Here's the relevant log output:
[ 777.533212] [Hardware Error]: CPU 12: Machine Check Exception: 4 Bank
2: b200000000020005
[ 777.533248] [Hardware Error]: TSC 1c181a41de4
[ 777.533272] [Hardware Error]: PROCESSOR 0:206c0 TIME 1372805901
SOCKET 0 APIC 1
[ 777.533304] [Hardware Error]: CPU 0: Machine Check Exception: 4 Bank
2: b200000000020005
[ 777.533335] [Hardware Error]: TSC 1c181a41d64
[ 777.533358] [Hardware Error]: PROCESSOR 0:206c0 TIME 1372805901
SOCKET 0 APIC 0
[ 777.533387] [Hardware Error]: Machine check: Processor context
corrupt
[ 777.533413] Kernel panic - not syncing: Fatal Machine check
[ 777.533437] Pid: 0, comm: swapper veid: 0 Tainted: G M
--------------- 2.6.32-042stab078.27.debug #1
[ 777.533476] Call Trace:
[ 777.533487] <#MC> [<ffffffff81556011>] ? panic+0xac/0x179
[ 777.533523] [<ffffffff81026aaf>] ? mce_panic+0x20f/0x230
[ 777.533547] [<ffffffff810280f8>] ? do_machine_check+0xa38/0xa80
[ 777.533576] [<ffffffff8155b2a1>] ? machine_check+0x21/0x30
[ 777.533602] [<ffffffff813145e6>] ? intel_idle+0xb6/0x190
[ 777.533624] <<EOE>> [<ffffffff8155e39d>] ?
__atomic_notifier_call_chain+0x9d/0xc0
[ 777.533771] [<ffffffff8145ce68>] ? menu_select+0x178/0x360
[ 777.533850] [<ffffffff8145bce7>] ? cpuidle_idle_call+0xa7/0x170
[ 777.533934] [<ffffffff8100a06b>] ? cpu_idle+0xbb/0x110
[ 777.534012] [<ffffffff8154f783>] ? start_secondary+0x2cb/0x30e
I attached the full output of disassembled memory starting with address
ffffffff8154f783 ('dis -rl ffffffff8154f783') to this mail.
To be honest, I don't know whether the crash is related to the OpenVZ
patches in vzkernel at all. If I got it right, it happens when a
secondary processor is activated, i.e. when a cpu is booted in order to
take a process, right?.
As the crash happens on an OpenVZ kernel, I'm reporting it here first.
Unfortunately it's not an option to try either vanilla upstream or
CentOS mainline kernel. The server is a production system, and OpenVZ is
critical to the provided services.
Maybe the crash is related to hardware issues? I already replaced both
mainboard and CPUs, so at least broken chips are rather unlikely. Below
follow some details about the hardware:
Tyan S7025 board
2x Intel Xeon L5640 CPU
48GB Kingston Registered ECC Memory
LSI MegaRAID SAS 2108 RAID Controller with 29 physical drives in three
RAID10 arrays (with two Chenbro expander cards)
Issues with the particular used board or CPU are rather unlikely due to
the replacements. But I cannot exclude hardware bugs in the used series.
I hope that you have further advice for me on how to proceed with the
debugging. At the moment I'm rather lost :(
Kind regards,
jonas
crash> dis -rl ffffffff8154f783
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
311
0xffffffff8154f4b8 <start_secondary>: push %rbp
0xffffffff8154f4b9 <start_secondary+1>: mov %rsp,%rbp
0xffffffff8154f4bc <start_secondary+4>: sub $0x10,%rsp
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
330
0xffffffff8154f4c0 <start_secondary+8>: callq 0xffffffff8154b024 <cpu_init>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
331
0xffffffff8154f4c5 <start_secondary+13>: callq *0x3d5a1d(%rip) #
0xffffffff81924ee8
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/thread_info.h:
218
0xffffffff8154f4cb <start_secondary+19>: mov %gs:0xcc08,%rax
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
332
0xffffffff8154f4d4 <start_secondary+28>: addl $0x1,-0x1fbc(%rax)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
195
0xffffffff8154f4db <start_secondary+35>: mov 0x4b971e(%rip),%rax
# 0xffffffff81a08c00
0xffffffff8154f4e2 <start_secondary+42>: mov 0x118(%rax),%rax
0xffffffff8154f4e9 <start_secondary+49>: test %rax,%rax
0xffffffff8154f4ec <start_secondary+52>: je 0xffffffff8154f4f7
<start_secondary+63>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
196
0xffffffff8154f4ee <start_secondary+54>: mov $0xffffffff82108298,%rdi
0xffffffff8154f4f5 <start_secondary+61>: callq *%rax
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
201
0xffffffff8154f4f7 <start_secondary+63>: callq 0xffffffff8102ee70
<read_apic_id>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
202
0xffffffff8154f4fc <start_secondary+68>: mov %gs:0xe178,%ecx
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f504 <start_secondary+76>: mov 0xbb38fd(%rip),%rdx
# 0xffffffff82102e08
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
202
0xffffffff8154f50b <start_secondary+83>: mov %ecx,-0x4(%rbp)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f50e <start_secondary+86>: bt %ecx,(%rdx)
0xffffffff8154f511 <start_secondary+89>: sbb %edx,%edx
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
203
0xffffffff8154f513 <start_secondary+91>: test %edx,%edx
0xffffffff8154f515 <start_secondary+93>: je 0xffffffff8154f52e
<start_secondary+118>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
204
0xffffffff8154f517 <start_secondary+95>: mov %eax,%edx
0xffffffff8154f519 <start_secondary+97>: mov $0xffffffff81570b4e,%rsi
0xffffffff8154f520 <start_secondary+104>: mov $0xffffffff817161a0,%rdi
0xffffffff8154f527 <start_secondary+111>: xor %eax,%eax
0xffffffff8154f529 <start_secondary+113>: callq 0xffffffff81555f65
<panic>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
207
0xffffffff8154f52e <start_secondary+118>: testb $0x10,0x1e485b4(%rip)
# 0xffffffff83397ae9
0xffffffff8154f535 <start_secondary+125>: je 0xffffffff8154f54d
<start_secondary+149>
0xffffffff8154f537 <start_secondary+127>: testb $0x40,0x1e485b6(%rip)
# 0xffffffff83397af4
0xffffffff8154f53e <start_secondary+134>: je 0xffffffff8154f54d
<start_secondary+149>
0xffffffff8154f540 <start_secondary+136>: cmpb $0x0,0x481a30(%rip)
# 0xffffffff819d0f77
0xffffffff8154f547 <start_secondary+143>: jne 0xffffffff8154f785
<start_secondary+717>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
220
0xffffffff8154f54d <start_secondary+149>: mov 0x4c136c(%rip),%rcx
# 0xffffffff81a108c0
0xffffffff8154f554 <start_secondary+156>: add $0x7d0,%rcx
0xffffffff8154f55b <start_secondary+163>: jmp 0xffffffff8154f572
<start_secondary+186>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f55d <start_secondary+165>: mov -0x4(%rbp),%eax
0xffffffff8154f560 <start_secondary+168>: mov 0xbb38a9(%rip),%rdx
# 0xffffffff82102e10
0xffffffff8154f567 <start_secondary+175>: bt %eax,(%rdx)
0xffffffff8154f56a <start_secondary+178>: sbb %eax,%eax
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
225
0xffffffff8154f56c <start_secondary+180>: test %eax,%eax
0xffffffff8154f56e <start_secondary+182>: jne 0xffffffff8154f57e
<start_secondary+198>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/processor.h:
735
0xffffffff8154f570 <start_secondary+184>: pause
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
221
0xffffffff8154f572 <start_secondary+186>: mov 0x4c1347(%rip),%rax
# 0xffffffff81a108c0
0xffffffff8154f579 <start_secondary+193>: cmp %rcx,%rax
0xffffffff8154f57c <start_secondary+196>: js 0xffffffff8154f55d
<start_secondary+165>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
230
0xffffffff8154f57e <start_secondary+198>: mov 0x4c133b(%rip),%rax
# 0xffffffff81a108c0
0xffffffff8154f585 <start_secondary+205>: cmp %rcx,%rax
0xffffffff8154f588 <start_secondary+208>: js 0xffffffff8154f5a2
<start_secondary+234>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
231
0xffffffff8154f58a <start_secondary+210>: mov -0x4(%rbp),%edx
0xffffffff8154f58d <start_secondary+213>: mov $0xffffffff81570b4e,%rsi
0xffffffff8154f594 <start_secondary+220>: mov $0xffffffff817161d0,%rdi
0xffffffff8154f59b <start_secondary+227>: xor %eax,%eax
0xffffffff8154f59d <start_secondary+229>: callq 0xffffffff81555f65
<panic>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
242
0xffffffff8154f5a2 <start_secondary+234>: testb $0x10,0x1e48540(%rip)
# 0xffffffff83397ae9
0xffffffff8154f5a9 <start_secondary+241>: je 0xffffffff8154f5c1
<start_secondary+265>
0xffffffff8154f5ab <start_secondary+243>: testb $0x40,0x1e48542(%rip)
# 0xffffffff83397af4
0xffffffff8154f5b2 <start_secondary+250>: je 0xffffffff8154f5c1
<start_secondary+265>
0xffffffff8154f5b4 <start_secondary+252>: cmpb $0x0,0x481994(%rip)
# 0xffffffff819d0f4f
0xffffffff8154f5bb <start_secondary+259>: jne 0xffffffff8154f79c
<start_secondary+740>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
243
0xffffffff8154f5c1 <start_secondary+265>: mov 0x4b9638(%rip),%rax
# 0xffffffff81a08c00
0xffffffff8154f5c8 <start_secondary+272>: mov 0x120(%rax),%rax
0xffffffff8154f5cf <start_secondary+279>: test %rax,%rax
0xffffffff8154f5d2 <start_secondary+282>: je 0xffffffff8154f5d6
<start_secondary+286>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
244
0xffffffff8154f5d4 <start_secondary+284>: callq *%rax
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
245
0xffffffff8154f5d6 <start_secondary+286>: callq 0xffffffff8154feb3
<setup_local_APIC>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
246
0xffffffff8154f5db <start_secondary+291>: callq 0xffffffff8154fdbb
<end_local_APIC_setup>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
254
0xffffffff8154f5e0 <start_secondary+296>: mov -0x4(%rbp),%edi
0xffffffff8154f5e3 <start_secondary+299>: callq 0xffffffff8154f44e
<smp_store_cpu_info>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
265
0xffffffff8154f5e8 <start_secondary+304>: callq 0xffffffff810cb400
<trace_hardirqs_on>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/paravirt.h:
885
0xffffffff8154f5ed <start_secondary+309>: sti
0xffffffff8154f5ee <start_secondary+310>: nopw 0x0(%rax,%rax,1)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
266
0xffffffff8154f5f4 <start_secondary+316>: callq 0xffffffff8154863e
<calibrate_delay>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
267
0xffffffff8154f5f9 <start_secondary+321>: movslq -0x4(%rbp),%rdx
0xffffffff8154f5fd <start_secondary+325>: mov 0x328f6c(%rip),%rcx
# 0xffffffff81878570
0xffffffff8154f604 <start_secondary+332>: mov $0x1def00,%rax
0xffffffff8154f60b <start_secondary+339>: mov -0x7e5ff400(,%rdx,8),%rdx
0xffffffff8154f613 <start_secondary+347>: mov %rcx,0x98(%rax,%rdx,1)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/paravirt.h:
880
0xffffffff8154f61b <start_secondary+355>: cli
0xffffffff8154f61c <start_secondary+356>: nopw 0x0(%rax,%rax,1)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
268
0xffffffff8154f622 <start_secondary+362>: callq 0xffffffff810c79d0
<trace_hardirqs_off>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
269
0xffffffff8154f627 <start_secondary+367>: testb $0x10,0x1e484bb(%rip)
# 0xffffffff83397ae9
0xffffffff8154f62e <start_secondary+374>: je 0xffffffff8154f646
<start_secondary+398>
0xffffffff8154f630 <start_secondary+376>: testb $0x40,0x1e484bd(%rip)
# 0xffffffff83397af4
0xffffffff8154f637 <start_secondary+383>: je 0xffffffff8154f646
<start_secondary+398>
0xffffffff8154f639 <start_secondary+385>: cmpb $0x0,0x4818e7(%rip)
# 0xffffffff819d0f27
0xffffffff8154f640 <start_secondary+392>: jne 0xffffffff8154f7af
<start_secondary+759>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
71
0xffffffff8154f646 <start_secondary+398>: mov 0xbb37bb(%rip),%rax
# 0xffffffff82102e08
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
70
0xffffffff8154f64d <start_secondary+405>: mov -0x4(%rbp),%edx
0xffffffff8154f650 <start_secondary+408>: lock bts %edx,(%rax)
0xffffffff8154f654 <start_secondary+412>: jmp 0xffffffff8154f658
<start_secondary+416>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/processor.h:
735
0xffffffff8154f656 <start_secondary+414>: pause
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
279
0xffffffff8154f658 <start_secondary+416>: mov 0xbb37c9(%rip),%rax
# 0xffffffff82102e28
0xffffffff8154f65f <start_secondary+423>: mov -0x4(%rbp),%edi
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f662 <start_secondary+426>: bt %edi,(%rax)
0xffffffff8154f665 <start_secondary+429>: sbb %edx,%edx
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
279
0xffffffff8154f667 <start_secondary+431>: test %edx,%edx
0xffffffff8154f669 <start_secondary+433>: jne 0xffffffff8154f67b
<start_secondary+451>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f66b <start_secondary+435>: mov 0xbb379e(%rip),%rdx
# 0xffffffff82102e10
0xffffffff8154f672 <start_secondary+442>: bt %edi,(%rdx)
0xffffffff8154f675 <start_secondary+445>: sbb %edx,%edx
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
279
0xffffffff8154f677 <start_secondary+447>: test %edx,%edx
0xffffffff8154f679 <start_secondary+449>: jne 0xffffffff8154f656
<start_secondary+414>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
366
0xffffffff8154f67b <start_secondary+451>: bt %edi,(%rax)
0xffffffff8154f67e <start_secondary+454>: sbb %eax,%eax
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
285
0xffffffff8154f680 <start_secondary+456>: test %eax,%eax
0xffffffff8154f682 <start_secondary+458>: je 0xffffffff8154f699
<start_secondary+481>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
288
0xffffffff8154f684 <start_secondary+460>: callq 0xffffffff8155159b
<notify_cpu_starting>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
340
0xffffffff8154f689 <start_secondary+465>: callq 0xffffffff8154f91d
<check_tsc_sync_target>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
342
0xffffffff8154f68e <start_secondary+470>: cmpl $0x1,0xbd9cc3(%rip)
# 0xffffffff82129358
0xffffffff8154f695 <start_secondary+477>: jne 0xffffffff8154f6ff
<start_secondary+583>
0xffffffff8154f697 <start_secondary+479>: jmp 0xffffffff8154f6ec
<start_secondary+564>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
294
0xffffffff8154f699 <start_secondary+481>: callq 0xffffffff81550c19
<numa_remove_cpu>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
295
0xffffffff8154f69e <start_secondary+486>: mov -0x4(%rbp),%edi
0xffffffff8154f6a1 <start_secondary+489>: callq 0xffffffff8102f250
<remove_siblinginfo>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
297
0xffffffff8154f6a6 <start_secondary+494>: xor %edi,%edi
0xffffffff8154f6a8 <start_secondary+496>: callq 0xffffffff81030d60
<stop_apic_nmi_watchdog>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
298
0xffffffff8154f6ad <start_secondary+501>: callq 0xffffffff8102f770
<clear_local_APIC>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
108
0xffffffff8154f6b2 <start_secondary+506>: mov 0xbb375f(%rip),%rax
# 0xffffffff82102e18
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
107
0xffffffff8154f6b9 <start_secondary+513>: mov -0x4(%rbp),%edx
0xffffffff8154f6bc <start_secondary+516>: lock btr %edx,(%rax)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
108
0xffffffff8154f6c0 <start_secondary+520>: mov 0xbb3741(%rip),%rax
# 0xffffffff82102e08
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/bitops.h:
107
0xffffffff8154f6c7 <start_secondary+527>: mov -0x4(%rbp),%edx
0xffffffff8154f6ca <start_secondary+530>: lock btr %edx,(%rax)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/smp.h:
125
0xffffffff8154f6ce <start_secondary+534>: callq *0x331b2c(%rip) #
0xffffffff81881200
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
304
0xffffffff8154f6d4 <start_secondary+540>: mov -0x4(%rbp),%edx
0xffffffff8154f6d7 <start_secondary+543>: mov $0xffffffff81570b4e,%rsi
0xffffffff8154f6de <start_secondary+550>: mov $0xffffffff8170f719,%rdi
0xffffffff8154f6e5 <start_secondary+557>: xor %eax,%eax
0xffffffff8154f6e7 <start_secondary+559>: callq 0xffffffff81555f65
<panic>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
343
0xffffffff8154f6ec <start_secondary+564>: xor %edi,%edi
0xffffffff8154f6ee <start_secondary+566>: callq 0xffffffff8100fb50
<disable_8259A_irq>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
344
0xffffffff8154f6f3 <start_secondary+571>: callq 0xffffffff8154fac0
<enable_NMI_through_LVT0>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
345
0xffffffff8154f6f8 <start_secondary+576>: xor %edi,%edi
0xffffffff8154f6fa <start_secondary+578>: callq 0xffffffff8100faf0
<enable_8259A_irq>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
349
0xffffffff8154f6ff <start_secondary+583>: mov %gs:0xe178,%edi
0xffffffff8154f707 <start_secondary+591>: callq 0xffffffff8154f127
<set_cpu_sibling_map>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
350
0xffffffff8154f70c <start_secondary+596>: sfence
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
364
0xffffffff8154f70f <start_secondary+599>: callq 0xffffffff810d5160
<ipi_call_lock>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
365
0xffffffff8154f714 <start_secondary+604>: callq 0xffffffff81032270
<lock_vector_lock>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
366
0xffffffff8154f719 <start_secondary+609>: mov %gs:0xe178,%edi
0xffffffff8154f721 <start_secondary+617>: callq 0xffffffff81031800
<__setup_vector_irq>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
367
0xffffffff8154f726 <start_secondary+622>: mov $0x1,%esi
0xffffffff8154f72b <start_secondary+627>: mov %gs:0xe178,%edi
0xffffffff8154f733 <start_secondary+635>: callq 0xffffffff81079500
<set_cpu_online>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
368
0xffffffff8154f738 <start_secondary+640>: callq 0xffffffff81032290
<unlock_vector_lock>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
369
0xffffffff8154f73d <start_secondary+645>: callq 0xffffffff810d5140
<ipi_call_unlock>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
370
0xffffffff8154f742 <start_secondary+650>: mov %gs:0xe178,%edx
0xffffffff8154f74a <start_secondary+658>: movslq %edx,%rdx
0xffffffff8154f74d <start_secondary+661>: mov $0xe150,%rax
0xffffffff8154f754 <start_secondary+668>: mov -0x7e5ff400(,%rdx,8),%rdx
0xffffffff8154f75c <start_secondary+676>: movl $0x2,(%rdx,%rax,1)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
371
0xffffffff8154f763 <start_secondary+683>: callq *0x329837(%rip) #
0xffffffff81878fa0
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
374
0xffffffff8154f769 <start_secondary+689>: callq 0xffffffff810cb400
<trace_hardirqs_on>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/include/asm/paravirt.h:
885
0xffffffff8154f76e <start_secondary+694>: sti
0xffffffff8154f76f <start_secondary+695>: nopw 0x0(%rax,%rax,1)
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
376
0xffffffff8154f775 <start_secondary+701>: callq *0x3d5765(%rip) #
0xffffffff81924ee0
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
378
0xffffffff8154f77b <start_secondary+707>: sfence
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
379
0xffffffff8154f77e <start_secondary+710>: callq 0xffffffff81009fb0
<cpu_idle>
/usr/src/debug/kernel-2.6.32-358.6.2.el6/linux-2.6.32-042stab078.27/arch/x86/kernel/smpboot.c:
380
0xffffffff8154f783 <start_secondary+715>: leaveq
_______________________________________________
Users mailing list
[email protected]
https://lists.openvz.org/mailman/listinfo/users
