On 22/10/25 1:52 pm, Venkat Rao Bagalkote wrote:
Greetings!!!
IBM CI has reported kernel boot warnings with next-20251022 kernel. I
see there are couple of warnings hit and eventually system boots to
emergency mode.
Traces:
[ 0.000000] stackdepot: allocating space for 8191 stack pools via
memblock
[ 0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=48,
Nodes=32
[ 0.000000] ------------[ cut here ]------------
[ 0.000000] WARNING: arch/powerpc/kernel/trace/ftrace.c:234 at
ftrace_init_ool_stub+0x188/0x3f4, CPU#0: swapper/0
[ 0.000000] Modules linked in:
[ 0.000000] CPU: 0 UID: 0 PID: 0 Comm: swapper Not tainted
6.18.0-rc2-next-20251022+ #1 VOLUNTARY
[ 0.000000] Hardware name: IBM,9080-HEX Power11 (architected)
0x820200 0xf000007 of:IBM,FW1110.01 (NH1110_069) hv:phyp pSeries
[ 0.000000] NIP: c000000000092430 LR: c000000000092414 CTR:
0000000000000000
[ 0.000000] REGS: c000000004ba7a70 TRAP: 0700 Not tainted
(6.18.0-rc2-next-20251022+)
[ 0.000000] MSR: 8000000002021033 <SF,VEC,ME,IR,DR,RI,LE> CR:
44022224 XER: 00000001
[ 0.000000] CFAR: c0000000008d7114 IRQMASK: 3
[ 0.000000] GPR00: c000000000508de0 c000000004ba7d10
c00000000248a400 c000000004ce9720
[ 0.000000] GPR04: c000000007335df8 00000000000000c0
c000000000092414 0000000000000000
[ 0.000000] GPR08: 0000000000000003 0000000000000001
0000000000000000 0000000000002000
[ 0.000000] GPR12: c00e0000008ce3a6 c0000000050b0000
0000000000000003 0000000000000001
[ 0.000000] GPR16: c000000007335df8 0000000000000000
c0000000045a8ac0 c000000004c2d450
[ 0.000000] GPR20: c0000000070e0108 c0000000070e0110
0000000000000013 000000000000c869
[ 0.000000] GPR24: c000000004ce9720 000000000000393f
c000000007335e08 c000000001879a78
[ 0.000000] GPR28: c000000001a10230 0000000000003940
0000000000000000 c000000007335df8
[ 0.000000] NIP [c000000000092430] ftrace_init_ool_stub+0x188/0x3f4
[ 0.000000] LR [c000000000092414] ftrace_init_ool_stub+0x16c/0x3f4
[ 0.000000] Call Trace:
[ 0.000000] [c000000004ba7d10] [c0000000000925c0]
ftrace_init_ool_stub+0x318/0x3f4 (unreliable)
[ 0.000000] [c000000004ba7de0] [c000000000508de0]
ftrace_process_locs+0x364/0x8e0
[ 0.000000] [c000000004ba7ee0] [c000000003060908]
ftrace_init+0x68/0x1c8
[ 0.000000] [c000000004ba7f50] [c00000000300ee6c]
start_kernel+0x1e4/0x4fc
[ 0.000000] [c000000004ba7fe0] [c00000000000e9a0]
start_here_common+0x1c/0x20
[ 0.000000] Code: 1d290018 7f9c4a14 3bbd0001 7f03c378 48844ca5
60000000 39400000 7f9dc800 39200001 7c1dc800 93b80000 7d29575e
<0b090000> 4181005c 7fe3fb78 3b3c0008
[ 0.000000] ---[ end trace 0000000000000000 ]---
[ 0.000000] ------------[ ftrace bug ]------------
[ 0.000000] ftrace failed to modify
[ 0.000000] [<c000000001879a78>] ip6mr_vif_seq_stop+0x0/0x8
[ 0.000000] actual: 00:00:00:60
[ 0.000000] Initializing ftrace call sites
[ 0.000000] ftrace record flags: 0
[ 0.000000] (0)
[ 0.000000] expected tramp: c000000000093490
[ 0.000000] ------------[ cut here ]------------
[ 0.000000] WARNING: kernel/trace/ftrace.c:2209 at
ftrace_bug+0x168/0x49c, CPU#0: swapper/0
[ 0.000000] Modules linked in:
[ 0.000000] CPU: 0 UID: 0 PID: 0 Comm: swapper Tainted: G W
6.18.0-rc2-next-20251022+ #1 VOLUNTARY
[ 0.000000] Tainted: [W]=WARN
[ 0.000000] Hardware name: IBM,9080-HEX Power11 (architected)
0x820200 0xf000007 of:IBM,FW1110.01 (NH1110_069) hv:phyp pSeries
[ 0.000000] NIP: c000000000508748 LR: c000000000508744 CTR:
0000000000000000
[ 0.000000] REGS: c000000004ba7a90 TRAP: 0700 Tainted: G W
(6.18.0-rc2-next-20251022+)
[ 0.000000] MSR: 8000000002021033 <SF,VEC,ME,IR,DR,RI,LE> CR:
28028220 XER: 00000001
[ 0.000000] CFAR: c0000000003880f8 IRQMASK: 3
[ 0.000000] GPR00: c000000000508744 c000000004ba7d30
c00000000248a400 0000000000000022
[ 0.000000] GPR04: 0000000000000004 0000000000000000
c00000000027abec 0000000000000001
[ 0.000000] GPR08: 0000000000000001 0000000000000000
0000000000000000 a80e000000000000
[ 0.000000] GPR12: c00e00000081c5d8 c0000000050b0000
0000000000000003 0000000000000001
[ 0.000000] GPR16: c000000007335df8 0000000000000000
c0000000045a8ac0 c000000004c2d450
[ 0.000000] GPR20: c0000000070e0108 c0000000070e0110
0000000000000013 000000000000c869
[ 0.000000] GPR24: 0000000000000000 0000000000000000
000000000000b93f 0000000000000000
[ 0.000000] GPR28: c000000001879a78 c000000001b93d20
c000000007335df8 c000000007335e00
[ 0.000000] NIP [c000000000508748] ftrace_bug+0x168/0x49c
[ 0.000000] LR [c000000000508744] ftrace_bug+0x164/0x49c
[ 0.000000] Call Trace:
[ 0.000000] [c000000004ba7d30] [c000000000508744]
ftrace_bug+0x164/0x49c (unreliable)
[ 0.000000] [c000000004ba7de0] [c000000000508dfc]
ftrace_process_locs+0x380/0x8e0
[ 0.000000] [c000000004ba7ee0] [c000000003060908]
ftrace_init+0x68/0x1c8
[ 0.000000] [c000000004ba7f50] [c00000000300ee6c]
start_kernel+0x1e4/0x4fc
[ 0.000000] [c000000004ba7fe0] [c00000000000e9a0]
start_here_common+0x1c/0x20
[ 0.000000] Code: 7fe3fb78 483cea79 60000000 e93e0008 75290800
40820164 7fc3f378 4bfffa19 7c641b78 387d0fe0 4be7f975 60000000
<0fe00000> 39000001 3ce2027a 3d22fdc1
[ 0.000000] ---[ end trace 0000000000000000 ]---
[ 0.000000] ftrace: allocating 51305 entries in 19 pages
Pasting the traces in more legible form.
[ 0.000000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[ 0.000000] stackdepot: allocating hash table via alloc_large_system_hash
[ 0.000000] stackdepot hash table entries: 1048576 (order: 8,
16777216 bytes, linear)
[ 0.000000] stackdepot: allocating space for 8191 stack pools via
memblock
[ 0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=48, Nodes=32
[ 0.000000] ------------[ cut here ]------------
[ 0.000000] WARNING: arch/powerpc/kernel/trace/ftrace.c:234 at
ftrace_init_ool_stub+0x188/0x3f4, CPU#0: swapper/0
[ 0.000000] Modules linked in:
[ 0.000000] CPU: 0 UID: 0 PID: 0 Comm: swapper Not tainted
6.18.0-rc2-next-20251022+ #1 VOLUNTARY
[ 0.000000] Hardware name: IBM,9080-HEX Power11 (architected)
0x820200 0xf000007 of:IBM,FW1110.01 (NH1110_069) hv:phyp pSeries
[ 0.000000] NIP: c000000000092430 LR: c000000000092414 CTR:
0000000000000000
[ 0.000000] REGS: c000000004ba7a70 TRAP: 0700 Not tainted
(6.18.0-rc2-next-20251022+)
[ 0.000000] MSR: 8000000002021033 <SF,VEC,ME,IR,DR,RI,LE> CR:
44022224 XER: 00000001
[ 0.000000] CFAR: c0000000008d7114 IRQMASK: 3
[ 0.000000] GPR00: c000000000508de0 c000000004ba7d10 c00000000248a400
c000000004ce9720
[ 0.000000] GPR04: c000000007335df8 00000000000000c0 c000000000092414
0000000000000000
[ 0.000000] GPR08: 0000000000000003 0000000000000001 0000000000000000
0000000000002000
[ 0.000000] GPR12: c00e0000008ce3a6 c0000000050b0000 0000000000000003
0000000000000001
[ 0.000000] GPR16: c000000007335df8 0000000000000000 c0000000045a8ac0
c000000004c2d450
[ 0.000000] GPR20: c0000000070e0108 c0000000070e0110 0000000000000013
000000000000c869
[ 0.000000] GPR24: c000000004ce9720 000000000000393f c000000007335e08
c000000001879a78
[ 0.000000] GPR28: c000000001a10230 0000000000003940 0000000000000000
c000000007335df8
[ 0.000000] NIP [c000000000092430] ftrace_init_ool_stub+0x188/0x3f4
[ 0.000000] LR [c000000000092414] ftrace_init_ool_stub+0x16c/0x3f4
[ 0.000000] Call Trace:
[ 0.000000] [c000000004ba7d10] [c0000000000925c0]
ftrace_init_ool_stub+0x318/0x3f4 (unreliable)
[ 0.000000] [c000000004ba7de0] [c000000000508de0]
ftrace_process_locs+0x364/0x8e0
[ 0.000000] [c000000004ba7ee0] [c000000003060908] ftrace_init+0x68/0x1c8
[ 0.000000] [c000000004ba7f50] [c00000000300ee6c]
start_kernel+0x1e4/0x4fc
[ 0.000000] [c000000004ba7fe0] [c00000000000e9a0]
start_here_common+0x1c/0x20
[ 0.000000] Code: 1d290018 7f9c4a14 3bbd0001 7f03c378 48844ca5
60000000 39400000 7f9dc800 39200001 7c1dc800 93b80000 7d29575e
<0b090000> 4181005c 7fe3fb78 3b3c0008
[ 0.000000] ---[ end trace 0000000000000000 ]---
[ 0.000000] ------------[ ftrace bug ]------------
[ 0.000000] ftrace failed to modify
[ 0.000000] [<c000000001879a78>] ip6mr_vif_seq_stop+0x0/0x8
[ 0.000000] actual: 00:00:00:60
[ 0.000000] Initializing ftrace call sites
[ 0.000000] ftrace record flags: 0
[ 0.000000] (0)
[ 0.000000] expected tramp: c000000000093490
[ 0.000000] ------------[ cut here ]------------
[ 0.000000] WARNING: kernel/trace/ftrace.c:2209 at
ftrace_bug+0x168/0x49c, CPU#0: swapper/0
[ 0.000000] Modules linked in:
[ 0.000000] CPU: 0 UID: 0 PID: 0 Comm: swapper Tainted: G W
6.18.0-rc2-next-20251022+ #1 VOLUNTARY
[ 0.000000] Tainted: [W]=WARN
[ 0.000000] Hardware name: IBM,9080-HEX Power11 (architected)
0x820200 0xf000007 of:IBM,FW1110.01 (NH1110_069) hv:phyp pSeries
[ 0.000000] NIP: c000000000508748 LR: c000000000508744 CTR:
0000000000000000
[ 0.000000] REGS: c000000004ba7a90 TRAP: 0700 Tainted: G W
(6.18.0-rc2-next-20251022+)
[ 0.000000] MSR: 8000000002021033 <SF,VEC,ME,IR,DR,RI,LE> CR:
28028220 XER: 00000001
[ 0.000000] CFAR: c0000000003880f8 IRQMASK: 3
[ 0.000000] GPR00: c000000000508744 c000000004ba7d30 c00000000248a400
0000000000000022
[ 0.000000] GPR04: 0000000000000004 0000000000000000 c00000000027abec
0000000000000001
[ 0.000000] GPR08: 0000000000000001 0000000000000000 0000000000000000
a80e000000000000
[ 0.000000] GPR12: c00e00000081c5d8 c0000000050b0000 0000000000000003
0000000000000001
[ 0.000000] GPR16: c000000007335df8 0000000000000000 c0000000045a8ac0
c000000004c2d450
[ 0.000000] GPR20: c0000000070e0108 c0000000070e0110 0000000000000013
000000000000c869
[ 0.000000] GPR24: 0000000000000000 0000000000000000 000000000000b93f
0000000000000000
[ 0.000000] GPR28: c000000001879a78 c000000001b93d20 c000000007335df8
c000000007335e00
[ 0.000000] NIP [c000000000508748] ftrace_bug+0x168/0x49c
[ 0.000000] LR [c000000000508744] ftrace_bug+0x164/0x49c
[ 0.000000] Call Trace:
[ 0.000000] [c000000004ba7d30] [c000000000508744]
ftrace_bug+0x164/0x49c (unreliable)
[ 0.000000] [c000000004ba7de0] [c000000000508dfc]
ftrace_process_locs+0x380/0x8e0
[ 0.000000] [c000000004ba7ee0] [c000000003060908] ftrace_init+0x68/0x1c8
[ 0.000000] [c000000004ba7f50] [c00000000300ee6c]
start_kernel+0x1e4/0x4fc
[ 0.000000] [c000000004ba7fe0] [c00000000000e9a0]
start_here_common+0x1c/0x20
[ 0.000000] Code: 7fe3fb78 483cea79 60000000 e93e0008 75290800
40820164 7fc3f378 4bfffa19 7c641b78 387d0fe0 4be7f975 60000000
<0fe00000> 39000001 3ce2027a 3d22fdc1
[ 0.000000] ---[ end trace 0000000000000000 ]---
[ 0.000000] ftrace: allocating 51305 entries in 19 pages
[ 0.000000] ftrace: allocated 19 pages with 3 groups
[ 0.000000] rcu: Hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
Attached is the config file.
If you happen to fix this, please add below tag.
Reported-by: Venkat Rao Bagalkote <[email protected]>
Regards,
Venkat.
