Hi all,
I'm seeing the following lockup pretty often while fuzzing with trinity:
[ 880.960250] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 447s!
[migration/1:14]
[ 880.960700] Modules linked in:
[ 880.960700] irq event stamp: 380954
[ 880.960700] hardirqs last enabled at (380953): restore_args
(arch/x86/kernel/entry_64.S:780)
[ 880.960700] hardirqs last disabled at (380954): apic_timer_interrupt
(arch/x86/kernel/entry_64.S:920)
[ 880.960700] softirqs last enabled at (380952): __do_softirq
(./arch/x86/include/asm/preempt.h:22 kernel/softirq.c:300)
[ 880.960700] softirqs last disabled at (380947): irq_exit
(kernel/softirq.c:350 kernel/softirq.c:391)
[ 880.960700] CPU: 1 PID: 14 Comm: migration/1 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880052cc8000 ti: ffff880052cd0000 task.ti:
ffff880052cd0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff880052cd7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: 0000000042506841 RCX: 1ffff1000a5992d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff880052cd7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff9315e211
[ 880.960700] R13: ffff880052cd7ae8 R14: ffffffff93220213 R15: ffff880052cd7ad8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880053200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002d88fd8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8805d4f67728
0000000000000282
[ 880.960700] ffff880000000000 00ff880052cc8000 ffff880052cd7bd8
dffffc0000000000
[ 880.960700] ffff880053218440 ffff8805d4f67778 ffff8805d4f67718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] sending NMI to other CPUs:
[ 881.290044] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took
too long to run: 1.336 msecs
[ 881.292380] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took
too long to run: 2.083 msecs
[ 881.297603] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took
too long to run: 7.423 msecs
[ 880.960700] NMI backtrace for cpu 0
[ 880.960700] CPU: 0 PID: 11 Comm: migration/0 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88000d6e3000 ti: ffff88000d6f0000 task.ti:
ffff88000d6f0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff88000d6f7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0007c21ee5 RCX: 1ffff10001adc8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff88000d6f7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88003e10f738 R14: 0000000000000001 R15: ffff88003e10f718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880029000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002d31fb0 CR3: 000000002082c000 CR4: 00000000000007b0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88003e10f728
0000000000000282
[ 880.960700] ffff880000000000 00ff88000d6e3000 ffff88000d6f7bd8
dffffc0000000000
[ 880.960700] ffff880029018440 ffff88003e10f778 ffff88003e10f718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 2
[ 880.960700] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802ccca0000 ti: ffff88000dee8000 task.ti:
ffff88000dee8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000deefd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000deefd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000deeffd8 R14: 0000000000000000 R15: ffff88000deeffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88007d200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007f6baacd10f8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000deefd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000deeffd8 0000000000000000 ffff88000deefd78
ffffffff931629ef
[ 880.960700] ffff88000deefe68 ffffffff934018e0 ffff88000deefde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 3
[ 880.960700] CPU: 3 PID: 32 Comm: migration/3 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8800a6cc0000 ti: ffff8800a6cc8000 task.ti:
ffff8800a6cc8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8800a6ccfb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0067e09ee5 RCX: 1ffff10014d982d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8800a6ccfbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88033f04f738 R14: 0000000000000001 R15: ffff88033f04f718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8800a7200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000001490fe8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88033f04f728
0000000000000282
[ 880.960700] ffff880000000000 00ff8800a6cc0000 ffff8800a6ccfbd8
dffffc0000000000
[ 880.960700] ffff8800a7218440 ffff88033f04f778 ffff88033f04f718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 4
[ 880.960700] CPU: 4 PID: 41 Comm: migration/4 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8800cacb3000 ti: ffff8800cacc0000 task.ti:
ffff8800cacc0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8800cacc7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed006e615ee5 RCX: 1ffff100195968d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8800cacc7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8803730af738 R14: 0000000000000001 R15: ffff8803730af718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8800cf200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 000000000189efd8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8803730af728
0000000000000282
[ 880.960700] ffff880000000000 00ff8800cacb3000 ffff8800cacc7bd8
dffffc0000000000
[ 880.960700] ffff8800cf218440 ffff8803730af778 ffff8803730af718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 5
[ 880.960700] CPU: 5 PID: 50 Comm: migration/5 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880128c6b000 ti: ffff880128c88000 task.ti:
ffff880128c88000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff880128c8fb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed008c0bbee5 RCX: 1ffff1002518d8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff880128c8fbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8804605df738 R14: 0000000000000001 R15: ffff8804605df718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880129000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002bf8ff0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8804605df728
0000000000000282
[ 880.960700] ffff880100000000 00ff880128c6b000 ffff880128c8fbd8
dffffc0000000000
[ 880.960700] ffff880129018440 ffff8804605df778 ffff8804605df718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 6
[ 880.960700] CPU: 6 PID: 59 Comm: migration/6 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880152cb3000 ti: ffff880152cc0000 task.ti:
ffff880152cc0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff880152cc7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0063d8cee5 RCX: 1ffff1002a5968d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff880152cc7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88031ec67738 R14: 0000000000000001 R15: ffff88031ec67718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880153200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002b54fa0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88031ec67728
0000000000000282
[ 880.960700] ffff880100000000 00ff880152cb3000 ffff880152cc7bd8
dffffc0000000000
[ 880.960700] ffff880153218440 ffff88031ec67778 ffff88031ec67718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 7
[ 880.960700] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8808dd0b0000 ti: ffff88000e2d0000 task.ti:
ffff88000e2d0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0000:ffff88000e2d7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000e2d7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000e2d7fd8 R14: 0000000000000000 R15: ffff88000e2d7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88017d200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000000000000 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000e2d7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000e2d7fd8 0000000000000000 ffff88000e2d7d78
ffffffff931629ef
[ 880.960700] ffff88000e2d7e68 ffffffff934018e0 0000000000000000
0000000000000000
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 8
[ 880.960700] CPU: 8 PID: 77 Comm: migration/8 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8801a6cc0000 ti: ffff8801a6cc8000 task.ti:
ffff8801a6cc8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8801a6ccfb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed003abaaee5 RCX: 1ffff10034d982d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8801a6ccfbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8801d5d57738 R14: 0000000000000001 R15: ffff8801d5d57718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8801a7200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000000e69fc8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8801d5d57728
0000000000000282
[ 880.960700] ffff880100000000 00ff8801a6cc0000 ffff8801a6ccfbd8
dffffc0000000000
[ 880.960700] ffff8801a7218440 ffff8801d5d57778 ffff8801d5d57718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 9
[ 880.960700] CPU: 9 PID: 86 Comm: migration/9 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8801d0c88000 ti: ffff8801d0c90000 task.ti:
ffff8801d0c90000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8801d0c97b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed007245bee5 RCX: 1ffff1003a1912d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8801d0c97bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8803922df738 R14: 0000000000000001 R15: ffff8803922df718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8801d1000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00000000029a8fb0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8803922df728
0000000000000282
[ 880.960700] ffff880100000000 00ff8801d0c88000 ffff8801d0c97bd8
dffffc0000000000
[ 880.960700] ffff8801d1018440 ffff8803922df778 ffff8803922df718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 10
[ 880.960700] CPU: 10 PID: 0 Comm: swapper/10 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880128c68000 ti: ffff88000e6c0000 task.ti:
ffff88000e6c0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000e6c7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000e6c7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000e6c7fd8 R14: 0000000000000000 R15: ffff88000e6c7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8801fb200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000000636668 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000e6c7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000e6c7fd8 0000000000000000 ffff88000e6c7d78
ffffffff931629ef
[ 880.960700] ffff88000e6c7e68 ffffffff934018e0 0000000000000000
0000000000000000
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 11
[ 880.960700] CPU: 11 PID: 0 Comm: swapper/11 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8801a6ca8000 ti: ffff88000e6c8000 task.ti:
ffff88000e6c8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000e6cfd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000e6cfd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000e6cffd8 R14: 0000000000000000 R15: ffff88000e6cffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880225200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00000000030db000 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000e6cfd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000e6cffd8 0000000000000000 ffff88000e6cfd78
ffffffff931629ef
[ 880.960700] ffff88000e6cfe68 ffffffff934018e0 ffff88000e6cfde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 12
[ 880.960700] CPU: 12 PID: 113 Comm: migration/12 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88024ecd0000 ti: ffff88024ecd8000 task.ti:
ffff88024ecd8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff88024ecdfb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0073a32ee5 RCX: 1ffff10049d9a2d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff88024ecdfbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88039d197738 R14: 0000000000000001 R15: ffff88039d197718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88024f200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002648fe0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88039d197728
0000000000000282
[ 880.960700] ffff880200000000 00ff88024ecd0000 ffff88024ecdfbd8
dffffc0000000000
[ 880.960700] ffff88024f218440 ffff88039d197778 ffff88039d197718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 13
[ 880.960700] CPU: 13 PID: 0 Comm: swapper/13 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802f6cc0000 ti: ffff88000e6d8000 task.ti:
ffff88000e6d8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000e6dfd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000e6dfd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000e6dffd8 R14: 0000000000000000 R15: ffff88000e6dffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880279000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 000000000063a69c CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000e6dfd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000e6dffd8 0000000000000000 ffff88000e6dfd78
ffffffff931629ef
[ 880.960700] ffff88000e6dfe68 ffffffff934018e0 ffff88000e6dfde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 14
[ 880.960700] CPU: 14 PID: 131 Comm: migration/14 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802a2cdb000 ti: ffff8802a2ce8000 task.ti:
ffff8802a2ce8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8802a2cefb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0059614ee5 RCX: 1ffff1005459b8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8802a2cefbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8802cb0a7738 R14: 0000000000000001 R15: ffff8802cb0a7718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8802a3200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002cc8ff8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8802cb0a7728
0000000000000282
[ 880.960700] ffff880200000000 00ff8802a2cdb000 ffff8802a2cefbd8
dffffc0000000000
[ 880.960700] ffff8802a3218440 ffff8802cb0a7778 ffff8802cb0a7718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 15
[ 880.960700] CPU: 15 PID: 140 Comm: migration/15 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802ccca3000 ti: ffff8802cccd0000 task.ti:
ffff8802cccd0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8802cccd7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0023834ee5 RCX: 1ffff100599948d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8802cccd7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88011c1a7738 R14: 0000000000000001 R15: ffff88011c1a7718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8802cd200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000001ad0a08 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88011c1a7728
0000000000000282
[ 880.960700] ffff880200000000 00ff8802ccca3000 ffff8802cccd7bd8
dffffc0000000000
[ 880.960700] ffff8802cd218440 ffff88011c1a7778 ffff88011c1a7718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 16
[ 880.960700] CPU: 16 PID: 149 Comm: migration/16 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802f6ce8000 ti: ffff8802f6cf0000 task.ti:
ffff8802f6cf0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8802f6cf7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed00149d5ee5 RCX: 1ffff1005ed9d2d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8802f6cf7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8800a4eaf738 R14: 0000000000000001 R15: ffff8800a4eaf718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8802f7200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000001f6afe8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8800a4eaf728
0000000000000282
[ 880.960700] ffff880200000000 00ff8802f6ce8000 ffff8802f6cf7bd8
dffffc0000000000
[ 880.960700] ffff8802f7218440 ffff8800a4eaf778 ffff8800a4eaf718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 17
[ 880.960700] CPU: 17 PID: 158 Comm: migration/17 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880320c7b000 ti: ffff880320c88000 task.ti:
ffff880320c88000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff880320c8fb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed000b451ee5 RCX: 1ffff1006418f8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff880320c8fbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88005a28f738 R14: 0000000000000001 R15: ffff88005a28f718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880321000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 000000000161bff8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88005a28f728
0000000000000282
[ 880.960700] ffff880300000000 00ff880320c7b000 ffff880320c8fbd8
dffffc0000000000
[ 880.960700] ffff880321018440 ffff88005a28f778 ffff88005a28f718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 18
[ 880.960700] CPU: 18 PID: 0 Comm: swapper/18 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8806ad0b0000 ti: ffff88000eac0000 task.ti:
ffff88000eac0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eac7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eac7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eac7fd8 R14: 0000000000000000 R15: ffff88000eac7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88034b200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000001692ac0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eac7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eac7fd8 0000000000000000 ffff88000eac7d78
ffffffff931629ef
[ 880.960700] ffff88000eac7e68 ffffffff934018e0 ffff88000eac7de8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 19
[ 880.960700] CPU: 19 PID: 0 Comm: swapper/19 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8807ed0c8000 ti: ffff88000eac8000 task.ti:
ffff88000eac8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eacfd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eacfd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eacffd8 R14: 0000000000000000 R15: ffff88000eacffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880375200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007ffe1ae26d00 CR3: 000000000660a000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eacfd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eacffd8 0000000000000000 ffff88000eacfd78
ffffffff931629ef
[ 880.960700] ffff88000eacfe68 ffffffff934018e0 ffff88000eacfde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 20
[ 880.960700] CPU: 20 PID: 185 Comm: migration/20 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88039ece0000 ti: ffff88039ece8000 task.ti:
ffff88039ece8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff88039ecefb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed008ddccee5 RCX: 1ffff10073d9c2d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff88039ecefbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88046ee67738 R14: 0000000000000001 R15: ffff88046ee67718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88039f200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00000000029aeff8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88046ee67728
0000000000000282
[ 880.960700] ffff880300000000 00ff88039ece0000 ffff88039ecefbd8
dffffc0000000000
[ 880.960700] ffff88039f218440 ffff88046ee67778 ffff88046ee67718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 21
[ 880.960700] CPU: 21 PID: 194 Comm: migration/21 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8803c8ca8000 ti: ffff8803c8cb0000 task.ti:
ffff8803c8cb0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8803c8cb7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed00149caee5 RCX: 1ffff100791952d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8803c8cb7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8800a4e57738 R14: 0000000000000001 R15: ffff8800a4e57718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8803c9000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002914fb0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8800a4e57728
0000000000000282
[ 880.960700] ffff880300000000 00ff8803c8ca8000 ffff8803c8cb7bd8
dffffc0000000000
[ 880.960700] ffff8803c9018440 ffff8800a4e57778 ffff8800a4e57718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 22
[ 880.960700] CPU: 22 PID: 203 Comm: migration/22 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8803f2cdb000 ti: ffff8803f2ce8000 task.ti:
ffff8803f2ce8000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8803f2cefb78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed008dde3ee5 RCX: 1ffff1007e59b8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8803f2cefbd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88046ef1f738 R14: 0000000000000001 R15: ffff88046ef1f718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8803f3200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000002e38b80 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88046ef1f728
0000000000000282
[ 880.960700] ffff880300000000 00ff8803f2cdb000 ffff8803f2cefbd8
dffffc0000000000
[ 880.960700] ffff8803f3218440 ffff88046ef1f778 ffff88046ef1f718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 23
[ 880.960700] CPU: 23 PID: 212 Comm: migration/23 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88041cc7b000 ti: ffff88041cce0000 task.ti:
ffff88041cce0000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff88041cce7b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed006926eee5 RCX: 1ffff1008398f8d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff88041cce7bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff880349377738 R14: 0000000000000001 R15: ffff880349377718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88041d200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007f9c055599d0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff880349377728
0000000000000282
[ 880.960700] ffff880400000000 00ff88041cc7b000 ffff88041cce7bd8
dffffc0000000000
[ 880.960700] ffff88041d218440 ffff880349377778 ffff880349377718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 24
[ 880.960700] CPU: 24 PID: 0 Comm: swapper/24 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8801d0c68000 ti: ffff88000eed0000 task.ti:
ffff88000eed0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eed7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eed7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eed7fd8 R14: 0000000000000000 R15: ffff88000eed7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880447200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00000000029e4220 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eed7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eed7fd8 0000000000000000 ffff88000eed7d78
ffffffff931629ef
[ 880.960700] ffff88000eed7e68 ffffffff934018e0 ffff88000eed7de8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 25
[ 880.960700] CPU: 25 PID: 12438 Comm: trinity-c68 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8802cb318000 ti: ffff8802cb3a8000 task.ti:
ffff8802cb3a8000
[ 880.960700] RIP: rwsem_down_write_failed
(./arch/x86/include/asm/processor.h:658 ./arch/x86/include/asm/processor.h:663
kernel/locking/rwsem-xadd.c:413 kernel/locking/rwsem-xadd.c:442)
[ 880.960700] RSP: 0018:ffff8802cb3afc08 EFLAGS: 00000286
[ 880.960700] RAX: ffffffff00000001 RBX: ffffffffa18e12a8 RCX: ffff8802cb318000
[ 880.960700] RDX: fffffffe00000001 RSI: fffffffeffffffff RDI: 0000000100000000
[ 880.960700] RBP: ffff8802cb3afd98 R08: 0000000000000000 R09: ffffffff00000001
[ 880.960700] R10: 0000000000000001 R11: 0000000000000001 R12: ffff8803f10c3000
[ 880.960700] R13: ffffffffa18e12a0 R14: ffff8802cb3afd68 R15: ffffffffa18e1250
[ 880.960700] FS: 00007f9c05559700(0000) GS:ffff880471000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 880.960700] CR2: 00007f9c0549b614 CR3: 00000002cb385000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffff9dbf3ced ffff8802cb318d00 0000000000000000
ffff8802cb318000
[ 880.960700] 00000000000004ff ffffffffa3ebf6b0 1ffff10059675f89
1ffff10059675f8d
[ 880.960700] 0000000041b58ab3 ffff8802cb3a8010 1ffff10059675002
ffff8802cb3a8000
[ 880.960700] Call Trace:
[ 880.960700] ? rwsem_down_write_failed (include/linux/rcupdate.h:912
kernel/locking/rwsem-xadd.c:306 kernel/locking/rwsem-xadd.c:381
kernel/locking/rwsem-xadd.c:442)
[ 880.960700] ? rwsem_down_read_failed (kernel/locking/rwsem-xadd.c:433)
[ 880.960700] ? trace_hardirqs_off (kernel/locking/lockdep.c:2647)
[ 880.960700] ? __acct_update_integrals (kernel/tsacct.c:125)
[ 880.960700] ? taskstats_exit (kernel/tsacct.c:125)
[ 880.960700] call_rwsem_down_write_failed (arch/x86/lib/rwsem.S:104)
[ 880.960700] ? down_write (kernel/locking/rwsem.h:4 kernel/locking/rwsem.c:52)
[ 880.960700] ? ipcget (ipc/util.c:349 ipc/util.c:646)
[ 880.960700] ipcget (ipc/util.c:349 ipc/util.c:646)
[ 880.960700] ? trace_hardirqs_on (kernel/locking/lockdep.c:2609)
[ 880.960700] ? syscall_trace_enter_phase1
(include/linux/context_tracking.h:27 arch/x86/kernel/ptrace.c:1486)
[ 880.960700] SyS_semget (ipc/sem.c:591 ipc/sem.c:572)
[ 880.960700] ? sem_exit_ns (ipc/sem.c:572)
[ 880.960700] ? trace_hardirqs_on_thunk (arch/x86/lib/thunk_64.S:42)
[ 880.960700] tracesys_phase2 (arch/x86/kernel/entry_64.S:347)
[ 880.960700] Code: 8d 0c 0a 48 89 d0 f0 49 0f b1 0f 48 39 c2 0f 84 2b 04 00 00
48 89 c2 48 8d 04 3a 48 85 f0 74 df 4d 85 e4 0f 84 50 04 00 00 f3 90 <e9> 57 ff
ff ff e8 02 62 87 f5 84 c0 0f 85 f5 fd ff ff 48 c7 c2
All code
========
0: 8d 0c 0a lea (%rdx,%rcx,1),%ecx
3: 48 89 d0 mov %rdx,%rax
6: f0 49 0f b1 0f lock cmpxchg %rcx,(%r15)
b: 48 39 c2 cmp %rax,%rdx
e: 0f 84 2b 04 00 00 je 0x43f
14: 48 89 c2 mov %rax,%rdx
17: 48 8d 04 3a lea (%rdx,%rdi,1),%rax
1b: 48 85 f0 test %rsi,%rax
1e: 74 df je 0xffffffffffffffff
20: 4d 85 e4 test %r12,%r12
23: 0f 84 50 04 00 00 je 0x479
29: f3 90 pause
2b:* e9 57 ff ff ff jmpq 0xffffffffffffff87 <--
trapping instruction
30: e8 02 62 87 f5 callq 0xfffffffff5876237
35: 84 c0 test %al,%al
37: 0f 85 f5 fd ff ff jne 0xfffffffffffffe32
3d: 48 rex.W
3e: c7 .byte 0xc7
3f: c2 .byte 0xc2
...
Code starting with the faulting instruction
===========================================
0: e9 57 ff ff ff jmpq 0xffffffffffffff5c
5: e8 02 62 87 f5 callq 0xfffffffff587620c
a: 84 c0 test %al,%al
c: 0f 85 f5 fd ff ff jne 0xfffffffffffffe07
12: 48 rex.W
13: c7 .byte 0xc7
14: c2 .byte 0xc2
...
[ 880.960700] NMI backtrace for cpu 26
[ 880.960700] CPU: 26 PID: 0 Comm: swapper/26 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8803c8c78000 ti: ffff88000eee0000 task.ti:
ffff88000eee0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eee7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eee7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eee7fd8 R14: 0000000000000000 R15: ffff88000eee7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88049b200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007f0f2bc1d5a8 CR3: 000000000678f000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eee7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eee7fd8 0000000000000000 ffff88000eee7d78
ffffffff931629ef
[ 880.960700] ffff88000eee7e68 ffffffff934018e0 ffff88000eee7de8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 27
[ 880.960700] CPU: 27 PID: 248 Comm: migration/27 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff8804c4cf8000 ti: ffff8804c3b00000 task.ti:
ffff8804c3b00000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff8804c3b07b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed0072423ee5 RCX: 1ffff1009899f2d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff8804c3b07bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff88039211f738 R14: 0000000000000001 R15: ffff88039211f718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8804c5200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00000000029c4ff8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff88039211f728
0000000000000282
[ 880.960700] ffff880400000000 00ff8804c4cf8000 ffff8804c3b07bd8
dffffc0000000000
[ 880.960700] ffff8804c5218440 ffff88039211f778 ffff88039211f718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 28
[ 880.960700] CPU: 28 PID: 0 Comm: swapper/28 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88065d0c0000 ti: ffff88000eef0000 task.ti:
ffff88000eef0000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eef7d38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eef7d38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eef7fd8 R14: 0000000000000000 R15: ffff88000eef7fd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff8804ef200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 0000000000b34fb8 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eef7d68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eef7fd8 0000000000000000 ffff88000eef7d78
ffffffff931629ef
[ 880.960700] ffff88000eef7e68 ffffffff934018e0 0000000000000000
0000000000000000
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 29
[ 880.960700] CPU: 29 PID: 0 Comm: swapper/29 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88079d0b0000 ti: ffff88000eef8000 task.ti:
ffff88000eef8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0018:ffff88000eeffd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000eeffd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000eefffd8 R14: 0000000000000000 R15: ffff88000eefffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880519000000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007f0f2b8e5210 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000eeffd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000eefffd8 0000000000000000 ffff88000eeffd78
ffffffff931629ef
[ 880.960700] ffff88000eeffe68 ffffffff934018e0 ffff88000eeffde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
[ 880.960700] NMI backtrace for cpu 30
[ 880.960700] CPU: 30 PID: 269 Comm: migration/30 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff880542cf8000 ti: ffff880541b00000 task.ti:
ffff880541b00000
[ 880.960700] RIP: multi_cpu_stop (kernel/stop_machine.c:192)
[ 880.960700] RSP: 0000:ffff880541b07b78 EFLAGS: 00000246
[ 880.960700] RAX: 0000000000000000 RBX: ffffed005ea54ee5 RCX: 1ffff100a859f2d5
[ 880.960700] RDX: 0000000000000000 RSI: ffffffff9e370ae0 RDI: ffffffffa31716b4
[ 880.960700] RBP: ffff880541b07bd8 R08: 0000000000000001 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: dffffc0000000000
[ 880.960700] R13: ffff8802f52a7738 R14: 0000000000000001 R15: ffff8802f52a7718
[ 880.960700] FS: 0000000000000000(0000) GS:ffff880543200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007f42552112c0 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffffffffa15a9540 ffffffff93532e90 ffff8802f52a7728
0000000000000282
[ 880.960700] ffff880500000000 00ff880542cf8000 ffff880541b07bd8
dffffc0000000000
[ 880.960700] ffff880543218440 ffff8802f52a7778 ffff8802f52a7718
ffffffff935335b0
[ 880.960700] Call Trace:
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? queue_stop_cpus_work (kernel/stop_machine.c:170)
[ 880.960700] cpu_stopper_thread (kernel/stop_machine.c:474)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] ? cpu_stop_should_run (include/linux/list.h:189
kernel/stop_machine.c:443)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? ikconfig_read_current (kernel/stop_machine.c:437)
[ 880.960700] ? trace_hardirqs_on_caller (kernel/locking/lockdep.c:2554
kernel/locking/lockdep.c:2601)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? cpu_stop_create (kernel/stop_machine.c:449)
[ 880.960700] smpboot_thread_fn (kernel/smpboot.c:161)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? schedule (./arch/x86/include/asm/bitops.h:311 (discriminator
1) kernel/sched/core.c:2824 (discriminator 1))
[ 880.960700] ? __kthread_parkme (kernel/kthread.c:164)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] ? sort_range (kernel/smpboot.c:105)
[ 880.960700] kthread (kernel/kthread.c:207)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] ret_from_fork (arch/x86/kernel/entry_64.S:565)
[ 880.960700] ? flush_kthread_work (kernel/kthread.c:176)
[ 880.960700] Code: eb 27 0f 1f 00 41 83 fe 03 75 0a 80 7d cf 00 0f 85 50 01 00
00 f0 41 ff 4f 24 74 71 41 83 fe 04 0f 84 d7 00 00 00 45 89 f0 f3 90 <4c> 89 e8
48 c1 e8 03 42 0f b6 04 20 84 c0 74 08 3c 03 0f 8e f5
All code
========
0: eb 27 jmp 0x29
2: 0f 1f 00 nopl (%rax)
5: 41 83 fe 03 cmp $0x3,%r14d
9: 75 0a jne 0x15
b: 80 7d cf 00 cmpb $0x0,-0x31(%rbp)
f: 0f 85 50 01 00 00 jne 0x165
15: f0 41 ff 4f 24 lock decl 0x24(%r15)
1a: 74 71 je 0x8d
1c: 41 83 fe 04 cmp $0x4,%r14d
20: 0f 84 d7 00 00 00 je 0xfd
26: 45 89 f0 mov %r14d,%r8d
29: f3 90 pause
2b:* 4c 89 e8 mov %r13,%rax <-- trapping
instruction
2e: 48 c1 e8 03 shr $0x3,%rax
32: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
37: 84 c0 test %al,%al
39: 74 08 je 0x43
3b: 3c 03 cmp $0x3,%al
3d: 0f .byte 0xf
3e: 8e f5 mov %ebp,%?
...
Code starting with the faulting instruction
===========================================
0: 4c 89 e8 mov %r13,%rax
3: 48 c1 e8 03 shr $0x3,%rax
7: 42 0f b6 04 20 movzbl (%rax,%r12,1),%eax
c: 84 c0 test %al,%al
e: 74 08 je 0x18
10: 3c 03 cmp $0x3,%al
12: 0f .byte 0xf
13: 8e f5 mov %ebp,%?
...
[ 880.960700] NMI backtrace for cpu 31
[ 880.960700] CPU: 31 PID: 0 Comm: swapper/31 Not tainted
4.0.0-rc1-next-20150227-sasha-00039-gae4a688-dirty #1971
[ 880.960700] task: ffff88000f2d0000 ti: ffff88000f2d8000 task.ti:
ffff88000f2d8000
[ 880.960700] RIP: native_safe_halt (./arch/x86/include/asm/irqflags.h:50)
[ 880.960700] RSP: 0000:ffff88000f2dfd38 EFLAGS: 00000282
[ 880.960700] RAX: dffffc0000000000 RBX: dffffc0000000000 RCX: 0000000000000000
[ 880.960700] RDX: 1ffffffff4115884 RSI: 0000000000000001 RDI: ffffffffa08ac420
[ 880.960700] RBP: ffff88000f2dfd38 R08: 0000000000000000 R09: 0000000000000000
[ 880.960700] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa31716b4
[ 880.960700] R13: ffff88000f2dffd8 R14: 0000000000000000 R15: ffff88000f2dffd8
[ 880.960700] FS: 0000000000000000(0000) GS:ffff88056d200000(0000)
knlGS:0000000000000000
[ 880.960700] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 880.960700] CR2: 00007fff144e2980 CR3: 000000002082c000 CR4: 00000000000007a0
[ 880.960700] Stack:
[ 880.960700] ffff88000f2dfd68 ffffffff93160774 dffffc0000000000
ffffffffa31716b4
[ 880.960700] ffff88000f2dffd8 0000000000000000 ffff88000f2dfd78
ffffffff931629ef
[ 880.960700] ffff88000f2dfe68 ffffffff934018e0 ffff88000f2dfde8
ffffffff9dbf7ec5
[ 880.960700] Call Trace:
[ 880.960700] default_idle (./arch/x86/include/asm/paravirt.h:111
arch/x86/kernel/process.c:314)
[ 880.960700] arch_cpu_idle (arch/x86/kernel/process.c:306)
[ 880.960700] cpu_startup_entry (./arch/x86/include/asm/thread_info.h:162
include/linux/sched.h:2880 kernel/sched/idle.c:189 kernel/sched/idle.c:250
kernel/sched/idle.c:298)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/paravirt.h:809 include/linux/spinlock_api_smp.h:162
kernel/locking/spinlock.c:191)
[ 880.960700] ? arch_cpu_idle_prepare (??:?)
[ 880.960700] ? _raw_spin_unlock_irqrestore
(./arch/x86/include/asm/preempt.h:95 include/linux/spinlock_api_smp.h:163
kernel/locking/spinlock.c:191)
[ 880.960700] ? clockevents_register_device (kernel/time/clockevents.c:481)
[ 880.960700] start_secondary (arch/x86/kernel/smpboot.c:219)
[ 880.960700] ? set_cpu_sibling_map (arch/x86/kernel/smpboot.c:219)
[ 880.960700] Code: 00 00 00 00 00 55 48 89 e5 fa 5d c3 66 0f 1f 84 00 00 00 00
00 55 48 89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f
1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84
All code
========
0: 00 00 add %al,(%rax)
2: 00 00 add %al,(%rax)
4: 00 55 48 add %dl,0x48(%rbp)
7: 89 e5 mov %esp,%ebp
9: fa cli
a: 5d pop %rbp
b: c3 retq
c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
13: 00 00
15: 55 push %rbp
16: 48 89 e5 mov %rsp,%rbp
19: fb sti
1a: 5d pop %rbp
1b: c3 retq
1c: 66 0f 1f 84 00 00 00 nopw 0x0(%rax,%rax,1)
23: 00 00
25: 55 push %rbp
26: 48 89 e5 mov %rsp,%rbp
29: fb sti
2a: f4 hlt
2b:* 5d pop %rbp <-- trapping instruction
2c: c3 retq
2d: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
34: 00
35: 55 push %rbp
36: 48 89 e5 mov %rsp,%rbp
39: f4 hlt
3a: 5d pop %rbp
3b: c3 retq
3c: 66 data16
3d: 0f .byte 0xf
3e: 1f (bad)
3f: 84 00 test %al,(%rax)
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: c3 retq
2: 0f 1f 84 00 00 00 00 nopl 0x0(%rax,%rax,1)
9: 00
a: 55 push %rbp
b: 48 89 e5 mov %rsp,%rbp
e: f4 hlt
f: 5d pop %rbp
10: c3 retq
11: 66 data16
12: 0f .byte 0xf
13: 1f (bad)
14: 84 00 test %al,(%rax)
Thanks,
Sasha
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
