Re: Using Firefox hangs system
Excerpts from Paul Menzel's message of July 8, 2020 3:42 am: > Dear Nicholas, > > > Am 07.07.20 um 09:03 schrieb Nicholas Piggin: >> Excerpts from Paul Menzel's message of July 6, 2020 3:20 pm: > >>> Am 06.07.20 um 02:41 schrieb Nicholas Piggin: Excerpts from Paul Menzel's message of July 5, 2020 8:30 pm: >>> > Am 05.07.20 um 11:22 schrieb Paul Menzel: >> [ 572.253008] Oops: Exception in kernel mode, sig: 5 [#1] >> [ 572.253198] LE PAGE_SIZE=64K MMU=Hash SMP NR_CPUS=2048 NUMA PowerNV >> [ 572.253232] Modules linked in: tcp_diag inet_diag unix_diag >> xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 >> xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat >> nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink >> ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs >> kvm_hv kvm binfmt_misc joydev uas usb_storage vmx_crypto bnx2x >> crct10dif_vpmsum ofpart cmdlinepart powernv_flash mtd mdio ibmpowernv >> at24 ipmi_powernv ipmi_devintf ipmi_msghandler opal_prd powernv_rng >> sch_fq_codel parport_pc ppdev lp nfsd parport auth_rpcgss nfs_acl lockd >> grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c >> xor zstd_compress raid6_pq input_leds mac_hid hid_generic ast >> drm_vram_helper drm_ttm_helper i2c_algo_bit ttm drm_kms_helper >> syscopyarea sysfillrect sysimgblt fb_sys_fops drm ahci >> drm_panel_orientation_quirks libahci usbhid hid crc32c_vpmsum >> uio_pdrv_genirq uio >> [ 572.253639] CPU: 4 PID: 6728 Comm: Web Content Not tainted 5.8.0-rc3+ >> #1 >> [ 572.253659] NIP: c000ff5c LR: c001a8f8 CTR: >> c01d5f00 >> [ 572.253835] REGS: c07f31f0f420 TRAP: 1500 Not tainted >> (5.8.0-rc3+) >> [ 572.253854] MSR: 9290b033 >> CR: 28c48482 XER: 2000 >> [ 572.253888] CFAR: c000fecc IRQMASK: 1 >> [ 572.253888] GPR00: c001b228 c07f31f0f6b0 c1f9a900 >> c07f351544d0 >> [ 572.253888] GPR04: c07f31f0fe90 c07f351544f0 >> c07f32e522b0 >> [ 572.253888] GPR08: 2000 90009033 >> c07fbcd85800 >> [ 572.253888] GPR12: 8800 c07fb680 0005 >> 0004 >> [ 572.253888] GPR16: c07f35153800 c07f35154130 0005 >> 0001 >> [ 572.253888] GPR20: 0024 c07f32e51e68 c07f35154028 >> 007fd8da >> [ 572.253888] GPR24: 007fd8da c07f351544d0 c07e9a4024d0 >> c1665f18 >> [ 572.253888] GPR28: c07f351544d0 c07f35153800 9290f033 >> c07f35153800 >> [ 572.254079] NIP [c000ff5c] save_fpu+0xa8/0x2ac >> [ 572.254098] LR [c001a8f8] __giveup_fpu+0x28/0x80 >> [ 572.254114] Call Trace: >> [ 572.254128] [c07f31f0f6b0] [c07f35153980] 0xc07f35153980 >> (unreliable) >> [ 572.254156] [c07f31f0f6e0] [c001b228] >> giveup_all+0x128/0x150 >> [ 572.254327] [c07f31f0f710] [c001c124] >> __switch_to+0x104/0x490 >> [ 572.254352] [c07f31f0f770] [c10d2e34] >> __schedule+0x2e4/0xa10 >> [ 572.254374] [c07f31f0f840] [c10d35d4] schedule+0x74/0x140 >> [ 572.254397] [c07f31f0f870] [c10d9478] >> schedule_timeout+0x358/0x5d0 >> [ 572.254424] [c07f31f0f980] [c10d5638] >> wait_for_completion+0xc8/0x210 >> [ 572.254451] [c07f31f0fa00] [c0608ed4] >> do_coredump+0x3a4/0xd60 >> [ 572.254625] [c07f31f0fba0] [c018d1cc] >> get_signal+0x1dc/0xd00 >> [ 572.254648] [c07f31f0fcc0] [c001f088] >> do_notify_resume+0x158/0x450 >> [ 572.254672] [c07f31f0fda0] [c0037d04] >> interrupt_exit_user_prepare+0x1c4/0x230 >> [ 572.254699] [c07f31f0fe20] [c000f2b4] >> interrupt_return+0x14/0x1c0 >> [ 572.254720] Instruction dump: >> [ 572.254882] dae60170 db060180 db260190 db4601a0 db6601b0 db8601c0 >> dba601d0 dbc601e0 >> [ 572.254912] dbe601f0 48000204 3880 f250 <7c062798> f250 >> 38800010 f0210a50 >> [ 572.254946] ---[ end trace ba4452ee5c77d58e ]--- > > Please find all the messages attached. "Oops: Exception in kernel mode, sig: 5 [#1]" Unfortunately it's a very poor error message. I think it is a 0x1500 exception triggering in the kernel FP register saving. Do you have the CONFIG_PPC_DENORMALISATION config option set? >>> >>> Yes, as it’s set in the Ubuntu Linux kernel configuration, I have it set >>> too. >>> >>> $ grep DENORMALI /boot/config-* >>> /boot/config-4.15.0-23-generic:CONFIG_PPC_DENORMALISATION=y >>>
Re: Using Firefox hangs system
Dear Nicholas, Am 07.07.20 um 09:03 schrieb Nicholas Piggin: Excerpts from Paul Menzel's message of July 6, 2020 3:20 pm: Am 06.07.20 um 02:41 schrieb Nicholas Piggin: Excerpts from Paul Menzel's message of July 5, 2020 8:30 pm: Am 05.07.20 um 11:22 schrieb Paul Menzel: [ 572.253008] Oops: Exception in kernel mode, sig: 5 [#1] [ 572.253198] LE PAGE_SIZE=64K MMU=Hash SMP NR_CPUS=2048 NUMA PowerNV [ 572.253232] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm binfmt_misc joydev uas usb_storage vmx_crypto bnx2x crct10dif_vpmsum ofpart cmdlinepart powernv_flash mtd mdio ibmpowernv at24 ipmi_powernv ipmi_devintf ipmi_msghandler opal_prd powernv_rng sch_fq_codel parport_pc ppdev lp nfsd parport auth_rpcgss nfs_acl lockd grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds mac_hid hid_generic ast drm_vram_helper drm_ttm_helper i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm ahci drm_panel_orientation_quirks libahci usbhid hid crc32c_vpmsum uio_pdrv_genirq uio [ 572.253639] CPU: 4 PID: 6728 Comm: Web Content Not tainted 5.8.0-rc3+ #1 [ 572.253659] NIP: c000ff5c LR: c001a8f8 CTR: c01d5f00 [ 572.253835] REGS: c07f31f0f420 TRAP: 1500 Not tainted (5.8.0-rc3+) [ 572.253854] MSR: 9290b033 CR: 28c48482 XER: 2000 [ 572.253888] CFAR: c000fecc IRQMASK: 1 [ 572.253888] GPR00: c001b228 c07f31f0f6b0 c1f9a900 c07f351544d0 [ 572.253888] GPR04: c07f31f0fe90 c07f351544f0 c07f32e522b0 [ 572.253888] GPR08: 2000 90009033 c07fbcd85800 [ 572.253888] GPR12: 8800 c07fb680 0005 0004 [ 572.253888] GPR16: c07f35153800 c07f35154130 0005 0001 [ 572.253888] GPR20: 0024 c07f32e51e68 c07f35154028 007fd8da [ 572.253888] GPR24: 007fd8da c07f351544d0 c07e9a4024d0 c1665f18 [ 572.253888] GPR28: c07f351544d0 c07f35153800 9290f033 c07f35153800 [ 572.254079] NIP [c000ff5c] save_fpu+0xa8/0x2ac [ 572.254098] LR [c001a8f8] __giveup_fpu+0x28/0x80 [ 572.254114] Call Trace: [ 572.254128] [c07f31f0f6b0] [c07f35153980] 0xc07f35153980 (unreliable) [ 572.254156] [c07f31f0f6e0] [c001b228] giveup_all+0x128/0x150 [ 572.254327] [c07f31f0f710] [c001c124] __switch_to+0x104/0x490 [ 572.254352] [c07f31f0f770] [c10d2e34] __schedule+0x2e4/0xa10 [ 572.254374] [c07f31f0f840] [c10d35d4] schedule+0x74/0x140 [ 572.254397] [c07f31f0f870] [c10d9478] schedule_timeout+0x358/0x5d0 [ 572.254424] [c07f31f0f980] [c10d5638] wait_for_completion+0xc8/0x210 [ 572.254451] [c07f31f0fa00] [c0608ed4] do_coredump+0x3a4/0xd60 [ 572.254625] [c07f31f0fba0] [c018d1cc] get_signal+0x1dc/0xd00 [ 572.254648] [c07f31f0fcc0] [c001f088] do_notify_resume+0x158/0x450 [ 572.254672] [c07f31f0fda0] [c0037d04] interrupt_exit_user_prepare+0x1c4/0x230 [ 572.254699] [c07f31f0fe20] [c000f2b4] interrupt_return+0x14/0x1c0 [ 572.254720] Instruction dump: [ 572.254882] dae60170 db060180 db260190 db4601a0 db6601b0 db8601c0 dba601d0 dbc601e0 [ 572.254912] dbe601f0 48000204 3880 f250 <7c062798> f250 38800010 f0210a50 [ 572.254946] ---[ end trace ba4452ee5c77d58e ]--- Please find all the messages attached. "Oops: Exception in kernel mode, sig: 5 [#1]" Unfortunately it's a very poor error message. I think it is a 0x1500 exception triggering in the kernel FP register saving. Do you have the CONFIG_PPC_DENORMALISATION config option set? Yes, as it’s set in the Ubuntu Linux kernel configuration, I have it set too. $ grep DENORMALI /boot/config-* /boot/config-4.15.0-23-generic:CONFIG_PPC_DENORMALISATION=y /boot/config-5.4.0-40-generic:CONFIG_PPC_DENORMALISATION=y /boot/config-5.7.0-rc5+:CONFIG_PPC_DENORMALISATION=y /boot/config-5.8.0-rc3+:CONFIG_PPC_DENORMALISATION=y Ah thanks I was able to reproduce with a little denorm test case. The denorm interrupt handler got broken by some careless person. This patch should hopefully fix it for you? Yes, it does. Thank you. --- arch/powerpc/kernel/exceptions-64s.S | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/arch/powerpc/kernel/exceptions-64s.S b/arch/powerpc/kernel/exceptions-64s.S index fa080694e581..0fc8bad878b2 100644 --- a/arch/powerpc/kernel/exceptions-64s.S +++ b/arch/powerpc/kernel/exceptions-64s.S @@ -2551,7
Re: Using Firefox hangs system
Excerpts from Paul Menzel's message of July 6, 2020 3:20 pm: > Dear Nicholas, > > > Thank you for the quick response. > > > Am 06.07.20 um 02:41 schrieb Nicholas Piggin: >> Excerpts from Paul Menzel's message of July 5, 2020 8:30 pm: > >>> Am 05.07.20 um 11:22 schrieb Paul Menzel: [ 572.253008] Oops: Exception in kernel mode, sig: 5 [#1] [ 572.253198] LE PAGE_SIZE=64K MMU=Hash SMP NR_CPUS=2048 NUMA PowerNV [ 572.253232] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm binfmt_misc joydev uas usb_storage vmx_crypto bnx2x crct10dif_vpmsum ofpart cmdlinepart powernv_flash mtd mdio ibmpowernv at24 ipmi_powernv ipmi_devintf ipmi_msghandler opal_prd powernv_rng sch_fq_codel parport_pc ppdev lp nfsd parport auth_rpcgss nfs_acl lockd grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds mac_hid hid_generic ast drm_vram_helper drm_ttm_helper i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm ahci drm_panel_orientation_quirks libahci usbhid hid crc32c_vpmsum uio_pdrv_genirq uio [ 572.253639] CPU: 4 PID: 6728 Comm: Web Content Not tainted 5.8.0-rc3+ #1 [ 572.253659] NIP: c000ff5c LR: c001a8f8 CTR: c01d5f00 [ 572.253835] REGS: c07f31f0f420 TRAP: 1500 Not tainted (5.8.0-rc3+) [ 572.253854] MSR: 9290b033 CR: 28c48482 XER: 2000 [ 572.253888] CFAR: c000fecc IRQMASK: 1 [ 572.253888] GPR00: c001b228 c07f31f0f6b0 c1f9a900 c07f351544d0 [ 572.253888] GPR04: c07f31f0fe90 c07f351544f0 c07f32e522b0 [ 572.253888] GPR08: 2000 90009033 c07fbcd85800 [ 572.253888] GPR12: 8800 c07fb680 0005 0004 [ 572.253888] GPR16: c07f35153800 c07f35154130 0005 0001 [ 572.253888] GPR20: 0024 c07f32e51e68 c07f35154028 007fd8da [ 572.253888] GPR24: 007fd8da c07f351544d0 c07e9a4024d0 c1665f18 [ 572.253888] GPR28: c07f351544d0 c07f35153800 9290f033 c07f35153800 [ 572.254079] NIP [c000ff5c] save_fpu+0xa8/0x2ac [ 572.254098] LR [c001a8f8] __giveup_fpu+0x28/0x80 [ 572.254114] Call Trace: [ 572.254128] [c07f31f0f6b0] [c07f35153980] 0xc07f35153980 (unreliable) [ 572.254156] [c07f31f0f6e0] [c001b228] giveup_all+0x128/0x150 [ 572.254327] [c07f31f0f710] [c001c124] __switch_to+0x104/0x490 [ 572.254352] [c07f31f0f770] [c10d2e34] __schedule+0x2e4/0xa10 [ 572.254374] [c07f31f0f840] [c10d35d4] schedule+0x74/0x140 [ 572.254397] [c07f31f0f870] [c10d9478] schedule_timeout+0x358/0x5d0 [ 572.254424] [c07f31f0f980] [c10d5638] wait_for_completion+0xc8/0x210 [ 572.254451] [c07f31f0fa00] [c0608ed4] do_coredump+0x3a4/0xd60 [ 572.254625] [c07f31f0fba0] [c018d1cc] get_signal+0x1dc/0xd00 [ 572.254648] [c07f31f0fcc0] [c001f088] do_notify_resume+0x158/0x450 [ 572.254672] [c07f31f0fda0] [c0037d04] interrupt_exit_user_prepare+0x1c4/0x230 [ 572.254699] [c07f31f0fe20] [c000f2b4] interrupt_return+0x14/0x1c0 [ 572.254720] Instruction dump: [ 572.254882] dae60170 db060180 db260190 db4601a0 db6601b0 db8601c0 dba601d0 dbc601e0 [ 572.254912] dbe601f0 48000204 3880 f250 <7c062798> f250 38800010 f0210a50 [ 572.254946] ---[ end trace ba4452ee5c77d58e ]--- >>> >>> Please find all the messages attached. >> >> "Oops: Exception in kernel mode, sig: 5 [#1]" >> >> Unfortunately it's a very poor error message. I think it is a 0x1500 >> exception triggering in the kernel FP register saving. Do you have the >> CONFIG_PPC_DENORMALISATION config option set? > > Yes, as it’s set in the Ubuntu Linux kernel configuration, I have it set > too. > > $ grep DENORMALI /boot/config-* > /boot/config-4.15.0-23-generic:CONFIG_PPC_DENORMALISATION=y > /boot/config-5.4.0-40-generic:CONFIG_PPC_DENORMALISATION=y > /boot/config-5.7.0-rc5+:CONFIG_PPC_DENORMALISATION=y > /boot/config-5.8.0-rc3+:CONFIG_PPC_DENORMALISATION=y Ah thanks I was able to reproduce with a little denorm test case. The denorm interrupt handler got broken by some careless person. This
Re: Using Firefox hangs system
Dear Nicholas, Thank you for the quick response. Am 06.07.20 um 02:41 schrieb Nicholas Piggin: Excerpts from Paul Menzel's message of July 5, 2020 8:30 pm: Am 05.07.20 um 11:22 schrieb Paul Menzel: With an IBM S822LC with Ubuntu 20.04, after updating to Firefox 78.0, using Firefox seems to hang the system. This happened with self-built Linux 5.7-rc5+ and now with 5.8-rc3+. (At least I believe the Firefox update is causing this.) Log in is impossible, and using the Serial over LAN over IPMI shows the messages below. [ 2620.579187] watchdog: BUG: soft lockup - CPU#125 stuck for 22s! [swapper/125:0] [ 2620.579378] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm joydev binfmt_misc uas usb_storage vmx_crypto ofpart cmdlinepart bnx2x powernv_flash mtd mdio crct10dif_vpmsum at24 ibmpowernv ipmi_powernv ipmi_devintf powernv_rng ipmi_msghandler opal_prd sch_fq_codel parport_pc nfsd ppdev lp auth_rpcgss nfs_acl parport lockd grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds mac_hid hid_generic ast drm_vram_helper drm_ttm_helper i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm drm_panel_orientation_quirks ahci libahci usbhid hid crc32c_vpmsum uio_pdrv_genirq uio [ 2620.579537] CPU: 125 PID: 0 Comm: swapper/125 Tainted: G D W L 5.8.0-rc3+ #1 [ 2620.579552] NIP: c10dad38 LR: c10dad30 CTR: c0237830 [ 2620.579568] REGS: c0ffcb8c7600 TRAP: 0900 Tainted: G D W L (5.8.0-rc3+) [ 2620.579582] MSR: 90009033 CR: 44004228 XER: [ 2620.579599] CFAR: c10dad44 IRQMASK: 0 [ 2620.579599] GPR00: c023718c c0ffcb8c7890 c1f9a900 [ 2620.579599] GPR04: c1fce438 0078 00010008c1f2 [ 2620.579599] GPR08: 00ffd96a 8087 c1fd25e0 [ 2620.579599] GPR12: 4400 c072f680 c1ea36d8 c0ffcb859800 [ 2620.579599] GPR16: c166c880 c16f8e00 000a c0ffcb859800 [ 2620.579599] GPR20: 0100 c166c918 c1fd21e8 c0ffcb859800 [ 2620.579599] GPR24: 00ffd96a c1d44b80 c1d53780 0008 [ 2620.579599] GPR28: c1fd21e0 0001 c1d44b80 [ 2620.579711] NIP [c10dad38] _raw_spin_lock_irqsave+0x98/0x120 [ 2620.579724] LR [c10dad30] _raw_spin_lock_irqsave+0x90/0x120 [ 2620.579737] Call Trace: [ 2620.579746] [c0ffcb8c7890] [c13c84a0] ncsi_ops+0x209f50/0x2dc1d8 (unreliable) [ 2620.579763] [c0ffcb8c78d0] [c023718c] rcu_core+0xfc/0x7a0 [ 2620.579777] [c0ffcb8c7970] [c10db81c] __do_softirq+0x17c/0x534 [ 2620.579791] [c0ffcb8c7aa0] [c01786f4] irq_exit+0xd4/0x130 [ 2620.579805] [c0ffcb8c7ad0] [c0025eec] timer_interrupt+0x13c/0x370 [ 2620.579821] [c0ffcb8c7b40] [c00165c0] replay_soft_interrupts+0x320/0x3f0 [ 2620.579837] [c0ffcb8c7d30] [c00166d8] arch_local_irq_restore+0x48/0xa0 [ 2620.579853] [c0ffcb8c7d50] [c0de2fe0] cpuidle_enter_state+0x100/0x780 [snip] I have to warm reset the system to get it working again. I am unable to reproduce this with Ubuntu’s Linux Okay, not sure what that would be from, looks like RCU perhaps. Anyway if it comes up again, let us know. Ah, it’s a different trace. I think it’s just an effect of the first error (as below), as some CPUs lock up. I wasn’t able to capture the start of the trace above. In the attachment for the hang *below* you can also see [ 664.705193] watchdog: BUG: soft lockup - CPU#134 stuck for 26s! [swapper/134:0] after the first Oops. With Linux 5.8-rc3+, I got now the beginning of the Linux messages. [ 572.253008] Oops: Exception in kernel mode, sig: 5 [#1] [ 572.253198] LE PAGE_SIZE=64K MMU=Hash SMP NR_CPUS=2048 NUMA PowerNV [ 572.253232] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm binfmt_misc joydev uas usb_storage vmx_crypto bnx2x crct10dif_vpmsum ofpart cmdlinepart powernv_flash mtd mdio ibmpowernv at24 ipmi_powernv ipmi_devintf ipmi_msghandler opal_prd powernv_rng sch_fq_codel parport_pc ppdev lp nfsd parport auth_rpcgss nfs_acl lockd grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds mac_hid
Re: Using Firefox hangs system
Excerpts from Paul Menzel's message of July 5, 2020 8:30 pm: > [Removed Rafael from CC] > > Dear Linux folks, > > > Am 05.07.20 um 11:22 schrieb Paul Menzel: > >> With an IBM S822LC with Ubuntu 20.04, after updating to Firefox 78.0, >> using Firefox seems to hang the system. This happened with self-built >> Linux 5.7-rc5+ and now with 5.8-rc3+. >> >> (At least I believe the Firefox update is causing this.) >> >> Log in is impossible, and using the Serial over LAN over IPMI shows the >> messages below. >> >>> [ 2620.579187] watchdog: BUG: soft lockup - CPU#125 stuck for 22s! >>> [swapper/125:0] >>> [ 2620.579378] Modules linked in: tcp_diag inet_diag unix_diag >>> xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 >>> xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat >>> nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink >>> ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs >>> kvm_hv kvm joydev binfmt_misc uas usb_storage vmx_crypto ofpart >>> cmdlinepart bnx2x powernv_flash mtd mdio crct10dif_vpmsum at24 >>> ibmpowernv ipmi_powernv ipmi_devintf powernv_rng ipmi_msghandler >>> opal_prd sch_fq_codel parport_pc nfsd ppdev lp auth_rpcgss nfs_acl >>> parport lockd grace sunrpc ip_tables x_tables autofs4 btrfs >>> blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds >>> mac_hid hid_generic ast drm_vram_helper drm_ttm_helper i2c_algo_bit >>> ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm >>> drm_panel_orientation_quirks ahci libahci usbhid hid crc32c_vpmsum >>> uio_pdrv_genirq uio >>> [ 2620.579537] CPU: 125 PID: 0 Comm: swapper/125 Tainted: G D >>> W L 5.8.0-rc3+ #1 >>> [ 2620.579552] NIP: c10dad38 LR: c10dad30 CTR: >>> c0237830 >>> [ 2620.579568] REGS: c0ffcb8c7600 TRAP: 0900 Tainted: G D >>> W L (5.8.0-rc3+) >>> [ 2620.579582] MSR: 90009033 CR: >>> 44004228 XER: >>> [ 2620.579599] CFAR: c10dad44 IRQMASK: 0 [ 2620.579599] GPR00: >>> c023718c c0ffcb8c7890 c1f9a900 [ >>> 2620.579599] GPR04: c1fce438 0078 00010008c1f2 >>> [ 2620.579599] GPR08: 00ffd96a >>> 8087 c1fd25e0 [ 2620.579599] >>> GPR12: 4400 c072f680 c1ea36d8 >>> c0ffcb859800 [ 2620.579599] GPR16: c166c880 >>> c16f8e00 000a c0ffcb859800 [ 2620.579599] >>> GPR20: 0100 c166c918 c1fd21e8 >>> c0ffcb859800 [ 2620.579599] GPR24: 00ffd96a >>> c1d44b80 c1d53780 0008 [ 2620.579599] >>> GPR28: c1fd21e0 0001 >>> c1d44b80 [ 2620.579711] NIP [c10dad38] >>> _raw_spin_lock_irqsave+0x98/0x120 >>> [ 2620.579724] LR [c10dad30] _raw_spin_lock_irqsave+0x90/0x120 >>> [ 2620.579737] Call Trace: >>> [ 2620.579746] [c0ffcb8c7890] [c13c84a0] >>> ncsi_ops+0x209f50/0x2dc1d8 (unreliable) >>> [ 2620.579763] [c0ffcb8c78d0] [c023718c] rcu_core+0xfc/0x7a0 >>> [ 2620.579777] [c0ffcb8c7970] [c10db81c] >>> __do_softirq+0x17c/0x534 >>> [ 2620.579791] [c0ffcb8c7aa0] [c01786f4] irq_exit+0xd4/0x130 >>> [ 2620.579805] [c0ffcb8c7ad0] [c0025eec] >>> timer_interrupt+0x13c/0x370 >>> [ 2620.579821] [c0ffcb8c7b40] [c00165c0] >>> replay_soft_interrupts+0x320/0x3f0 >>> [ 2620.579837] [c0ffcb8c7d30] [c00166d8] >>> arch_local_irq_restore+0x48/0xa0 >>> [ 2620.579853] [c0ffcb8c7d50] [c0de2fe0] >>> cpuidle_enter_state+0x100/0x780 [snip] >> >> I have to warm reset the system to get it working again. > > I am unable to reproduce this with Ubuntu’s Linux Okay, not sure what that would be from, looks like RCU perhaps. Anyway if it comes up again, let us know. > With Linux 5.8-rc3+, I got now the beginning of the Linux messages. > >> [ 572.253008] Oops: Exception in kernel mode, sig: 5 [#1] >> [ 572.253198] LE PAGE_SIZE=64K MMU=Hash SMP NR_CPUS=2048 NUMA PowerNV >> [ 572.253232] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM >> xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp >> ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack >> nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables >> iptable_filter bridge stp llc overlay xfs kvm_hv kvm binfmt_misc joydev uas >> usb_storage vmx_crypto bnx2x crct10dif_vpmsum ofpart cmdlinepart >> powernv_flash mtd mdio ibmpowernv at24 ipmi_powernv ipmi_devintf >> ipmi_msghandler opal_prd powernv_rng sch_fq_codel parport_pc ppdev lp nfsd >> parport auth_rpcgss nfs_acl lockd grace sunrpc ip_tables x_tables autofs4 >> btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds >> mac_hid hid_generic ast drm_vram_helper drm_ttm_helper
Using Firefox hangs system
Dear Linux folks, With an IBM S822LC with Ubuntu 20.04, after updating to Firefox 78.0, using Firefox seems to hang the system. This happened with self-built Linux 5.7-rc5+ and now with 5.8-rc3+. (At least I believe the Firefox update is causing this.) Log in is impossible, and using the Serial over LAN over IPMI shows the messages below. [ 2620.579187] watchdog: BUG: soft lockup - CPU#125 stuck for 22s! [swapper/125:0] [ 2620.579378] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm joydev binfmt_misc uas usb_storage vmx_crypto ofpart cmdlinepart bnx2x powernv_flash mtd mdio crct10dif_vpmsum at24 ibmpowernv ipmi_powernv ipmi_devintf powernv_rng ipmi_msghandler opal_prd sch_fq_codel parport_pc nfsd ppdev lp auth_rpcgss nfs_acl parport lockd grace sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic libcrc32c xor zstd_compress raid6_pq input_leds mac_hid hid_generic ast drm_vram_helper drm_ttm_helper i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm drm_panel_orientation_quirks ahci libahci usbhid hid crc32c_vpmsum uio_pdrv_genirq uio [ 2620.579537] CPU: 125 PID: 0 Comm: swapper/125 Tainted: G D WL 5.8.0-rc3+ #1 [ 2620.579552] NIP: c10dad38 LR: c10dad30 CTR: c0237830 [ 2620.579568] REGS: c0ffcb8c7600 TRAP: 0900 Tainted: G D WL (5.8.0-rc3+) [ 2620.579582] MSR: 90009033 CR: 44004228 XER: [ 2620.579599] CFAR: c10dad44 IRQMASK: 0 [ 2620.579599] GPR00: c023718c c0ffcb8c7890 c1f9a900 [ 2620.579599] GPR04: c1fce438 0078 00010008c1f2 [ 2620.579599] GPR08: 00ffd96a 8087 c1fd25e0 [ 2620.579599] GPR12: 4400 c072f680 c1ea36d8 c0ffcb859800 [ 2620.579599] GPR16: c166c880 c16f8e00 000a c0ffcb859800 [ 2620.579599] GPR20: 0100 c166c918 c1fd21e8 c0ffcb859800 [ 2620.579599] GPR24: 00ffd96a c1d44b80 c1d53780 0008 [ 2620.579599] GPR28: c1fd21e0 0001 c1d44b80 [ 2620.579711] NIP [c10dad38] _raw_spin_lock_irqsave+0x98/0x120 [ 2620.579724] LR [c10dad30] _raw_spin_lock_irqsave+0x90/0x120 [ 2620.579737] Call Trace: [ 2620.579746] [c0ffcb8c7890] [c13c84a0] ncsi_ops+0x209f50/0x2dc1d8 (unreliable) [ 2620.579763] [c0ffcb8c78d0] [c023718c] rcu_core+0xfc/0x7a0 [ 2620.579777] [c0ffcb8c7970] [c10db81c] __do_softirq+0x17c/0x534 [ 2620.579791] [c0ffcb8c7aa0] [c01786f4] irq_exit+0xd4/0x130 [ 2620.579805] [c0ffcb8c7ad0] [c0025eec] timer_interrupt+0x13c/0x370 [ 2620.579821] [c0ffcb8c7b40] [c00165c0] replay_soft_interrupts+0x320/0x3f0 [ 2620.579837] [c0ffcb8c7d30] [c00166d8] arch_local_irq_restore+0x48/0xa0 [ 2620.579853] [c0ffcb8c7d50] [c0de2fe0] cpuidle_enter_state+0x100/0x780 [ 2620.579869] [c0ffcb8c7dd0] [c0de36fc] cpuidle_enter+0x4c/0x70 [ 2620.579883] [c0ffcb8c7e10] [c01c6bb4] do_idle+0x3c4/0x590 [ 2620.579896] [c0ffcb8c7ee0] [c01c6fcc] cpu_startup_entry+0x3c/0x50 [ 2620.579911] [c0ffcb8c7f10] [c00615f4] start_secondary+0x2d4/0x3b0 [ 2620.579927] [c0ffcb8c7f90] [c000c454] start_secondary_prolog+0x10/0x14 [ 2620.579941] Instruction dump: [ 2620.579950] 6000 6000 7c0802a6 fba10028 fbe10038 7c7f1b78 f8010050 8bad0988 [ 2620.579967] 7fc3f378 4af3b96d 6000 7c210b78 <6000> 813f 2c29 4082fff0 [ 2645.907192] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 2660.067201] watchdog: CPU 0 detected hard LOCKUP on other CPUs 113 [ 2660.067385] watchdog: CPU 0 TB:1390608252047, last SMP heartbeat TB:1382840188990 (15171ms ago) [ 2708.927190] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 2724.067205] watchdog: CPU 0 detected hard LOCKUP on other CPUs 87 [ 2724.067396] watchdog: CPU 0 TB:1423376252137, last SMP heartbeat TB:1415618427864 (15152ms ago) [ 2771.947188] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: 5:0] [ 2620.579378] Modules linked in: tcp_diag inet_diag unix_diag xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bridge stp llc overlay xfs kvm_hv kvm joydev binfmt_misc uas usb_storage vmx_crypto ofpart cmdlinepart bnx2x powernv_flash mtd mdio crct10dif_vpmsum at24 ibmpowernv ipmi_powernv ipmi_devintf
