[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Tags added: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Released Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20: c1389700
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu) Status: Confirmed = Fix Released ** Tags removed: kernel-bug-break-fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Fix Released Status in linux source package in Utopic: Fix Released Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Tags removed: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Released Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20: c1389700
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
This bug was fixed in the package linux - 3.16.0-31.41 --- linux (3.16.0-31.41) utopic; urgency=low [ Seth Forshee ] * Release Tracking Bug - LP: #1419961 [ Andy Whitcroft ] * [Debian] arm64 -- build ubuntu drivers - LP: #1411284 * hyper-v -- fix comment handing in /etc/network/interfaces - LP: #1413020 [ Ben Hutchings ] * SAUCE: rtsx_usb_ms: Use msleep_interruptible() in polling loop - LP: #1413149 [ Brad Figg ] * SAUCE: Config IWLWIFI_UAPSD=N [ Kamal Mostafa ] * [Packaging] force dpkg-source -I -i behavior [ Kukjin Kim ] * SAUCE: (no-up) ARM: SAMSUNG: fix the CPU_ID for EXYNOS5440 - LP: #1411062 [ Leann Ogasawara ] * ubuntu: AUFS -- Resolve build failure union has no member named 'd_child' [ Ming Lei ] * SAUCE: (no-up) ARM: EXYNOS: fix booting oops on exynos5440 - LP: #1411062 * SAUCE: (no-up) ARM: exynos5440-sd5v1: switch to fixed-link DT binding - LP: #1417339 * SAUCE: (no-up) net: stmmac: add fixed_phy support via fixed-link DT binding - LP: #1417339 [ Upstream Kernel Changes ] * Revert [SCSI] mpt2sas: Remove phys on topology change. - LP: #1419125 * Revert [SCSI] mpt3sas: Remove phys on topology change - LP: #1419125 * Revert ARM: 7830/1: delay: don't bother reporting bogomips in /proc/cpuinfo - LP: #1419125 * powerpc/powernv: Don't call generic code on offline cpus - LP: #1400411 * powerpc/powernv: Return to cpu offline loop when finished in KVM guest - LP: #1400411 * powerpc/powernv: Switch off MMU before entering nap/sleep/rvwinkle mode - LP: #1400411 * powerpc/powernv: Enable Offline CPUs to enter deep idle states - LP: #1400411 * powernv/cpuidle: Redesign idle states management - LP: #1400411 * powernv/powerpc: Add winkle support for offline cpus - LP: #1400411 * powerpc/kdump: Ignore failure in enabling big endian exception during crash - LP: #1410817 * powerpc/perf/hv-24x7: Use kmem_cache_free - LP: #1410519 * powerpc/perf/hv-24x7: use kmem_cache instead of aligned stack allocations - LP: #1410519 * powerpc/perf/hv-24x7: Use per-cpu page buffer - LP: #1410519 * power/perf/hv-24x7: Use kmem_cache_free() instead of kfree - LP: #1410519 * KVM: x86: SYSENTER emulation is broken - LP: #1414651 - CVE-2015-0239 * powerpc/xmon: Fix another endiannes issue in RTAS call from xmon - LP: #1415919 * HID: i2c-hid: call the hid driver's suspend and resume callbacks - LP: #1417363 * HID: i2c-hid: Do not free buffers in i2c_hid_stop() - LP: #1417363 * ALSA: hda - add mic mute led hook for dell machines - LP: #1418832 * ALSA: hda - move DELL_WMI_MIC_MUTE_LED to the tail in the quirk chain - LP: #1381856, #1418832 * ALSA: hda - fix the mic mute led problem for Latitude E5550 - LP: #1381856, #1418832 * drm/i915: don't warn if backlight unexpectedly enabled - LP: #1419125 * drm/i915/dp: only use training pattern 3 on platforms that support it - LP: #1419125 * udptunnel: Add SKB_GSO_UDP_TUNNEL during gro_complete. - LP: #1419125 * s390/3215: fix hanging console issue - LP: #1419125 * s390/3215: fix tty output containing tabs - LP: #1419125 * btrfs: don't go readonly on existing qgroup items - LP: #1419125 * regulator: anatop: Set default voltage selector for vddpu - LP: #1419125 * KVM: s390: Fix size of monitor-class number field - LP: #1419125 * [media] smiapp: Take mutex during PLL update in sensor initialisation - LP: #1419125 * [media] smiapp-pll: Correct clock debug prints - LP: #1419125 * Bluetooth: Fix LE connection timeout deadlock - LP: #1419125 * [media] sound: simplify au0828 quirk table - LP: #1419125 * [media] sound: Update au0828 quirks table - LP: #1419125 * [media] af9005: fix kernel panic on init if compiled without IR - LP: #1419125 * writeback: fix a subtle race condition in I_DIRTY clearing - LP: #1419125 * usb: renesas_usbhs: gadget: fix NULL pointer dereference in ep_disable() - LP: #1419125 * KVM: s390: Fix ipte locking - LP: #1419125 * KVM: s390: flush CPU on load control - LP: #1419125 * UBI: Fix double free after do_sync_erase() - LP: #1419125 * UBI: Fix invalid vfree() - LP: #1419125 * Drivers: hv: vmbus: Fix a race condition when unregistering a device - LP: #1419125 * misc: genwqe: check for error from get_user_pages_fast() - LP: #1419125 * driver core: Fix unbalanced device reference in drivers_probe - LP: #1419125 * drbd: merge_bvec_fn: properly remap bvm-bi_bdev - LP: #1419125 * PCI: Restore detection of read-only BARs - LP: #1419125 * scsi: correct return values for .eh_abort_handler implementations - LP: #1419125 * drm/radeon: fix typo in CI dpm disable - LP: #1419125 * ARM: tegra: Re-add removed SoC id macro to tegra_resume() - LP: #1419125 * arm64: Add
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
Actually I see that you've verified with 3.18 kernels, can someone verify with the 3.16 kernel as mentioned in comment #6? Thanks ** Tags removed: verification-done-utopic ** Tags added: verification-needed-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
--- Comment From ss...@in.ibm.com 2015-02-20 15:33 EDT--- (In reply to comment #19) Actually I see that you've verified with 3.18 kernels, can someone verify with the 3.16 kernel as mentioned in comment #6? Thanks I have verified the problem with 3.16 kernel (3.16.0-31-generic) from utopic proposed and confirm that the problem is resolved. ** Tags removed: verification-needed-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
Thanks! ** Tags added: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
--- Comment From ss...@in.ibm.com 2015-02-20 04:11 EDT--- I have verified the defect with latest 15.04 daily ISO builds. The problem is fixed. ** Tags removed: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Tags added: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20: c1389700
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
Thanks for verifying this, I confused PowerKVM with PowerVM. ** Tags added: verification-done-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
--- Comment From s...@us.ibm.com 2015-02-19 02:09 EDT--- (In reply to comment #14) I can't verify this with a utopic host running a vivid guest. Is there additional information on how to reproduce this issue in this environment? Perf doesn't seem to find the hv_24x7 event. Well, 24x7 counters are not supported on PowerKVM. I was able to verify on a 15.04 PowerVM guest while running the kernel from linux-image-3.18.0-13-generic. Both the test scripts from the submitter's report passed and system stayed up. ** Tags removed: verification-needed-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
I can't verify this with a utopic host running a vivid guest. Is there additional information on how to reproduce this issue in this environment? Perf doesn't seem to find the hv_24x7 event. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed- utopic' to 'verification-done-utopic'. If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you! ** Tags added: verification-needed-utopic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu) Status: Fix Committed = Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Description changed: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: - d658972 - 48bee8a - f34b6c7 - ec2aef5 + d658972 + 48bee8a + f34b6c7 + ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20: c1389700 0001 GPR28: c1420a68 013d30d0 0001 [ 4657.362758] NIP [c006a37c] icp_hv_cause_ipi+0x3c/0xc0 [ 4657.362762] LR [c00865a8] pSeries_cause_ipi_mux+0x88/0xc0 [ 4657.362765] Call Trace: 0 (unreliable) [
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu Utopic) Status: In Progress = Fix Committed ** Changed in: linux (Ubuntu) Status: Triaged = Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu) Assignee: Andy Whitcroft (apw) = (unassigned) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu) Status: Confirmed = Fix Committed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Fix Committed Status in linux source package in Utopic: Fix Committed Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00 0001 GPR20:
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
Thanks Suka, Chris, Our major concern is regarding 15.04 for this bug, so, if you see any problem with this patch for 14.10, we can skip it and fix it in 15.04 only. Thank you, Breno -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Triaged Status in linux source package in Utopic: In Progress Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
SRU sent for 3.16 to the k-team mailing list. The fix for vivid will be picked up when we rebase to 3.19. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Triaged Status in linux source package in Utopic: In Progress Bug description: [Impact] Using perf with hv_24x7 events can cause a kernel BUG. [Fix] The following upstream commits: d658972 48bee8a f34b6c7 ec2aef5 [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries [ 4657.362695] CPU: 12 PID: 7 Comm: rcu_sched Tainted: G D 3.16.0-25- [ 4657.362699] task: c000eb581540 ti: c000eb604000 task.ti: c000eb60 [ 4657.362703] NIP: c006a37c LR: c00865a8 CTR: c006a340 [ 4657.362706] REGS: c000eb607800 TRAP: 0300 Tainted: G D (3.16.0-25-generic) [ 4657.362718] CFAR: c00865a4 DAR: c00b35515048 DSISR: 4000 SOFTE: 0 GPR00: c00865a8 c000eb607a80 c13d50f0 013d30d0 GPR08: 00cc c00b35515000 ce9a GPR12: c006a340 ce9a6c00
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Also affects: linux (Ubuntu Utopic) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Utopic) Assignee: (unassigned) = Chris J Arges (arges) ** Changed in: linux (Ubuntu) Assignee: Chris J Arges (arges) = (unassigned) ** Changed in: linux (Ubuntu Utopic) Importance: Undecided = Medium ** Changed in: linux (Ubuntu) Importance: Medium = Undecided ** Changed in: linux (Ubuntu Utopic) Status: New = In Progress ** Description changed: + [Impact] + Using perf with hv_24x7 events can cause a kernel BUG. + + [Fix] + The following upstream commits: + d658972 + 48bee8a + f34b6c7 + ec2aef5 + + [Test Case] Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do - EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ + EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ - perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e + perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls - count=) + count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do - EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ + EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ - perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e + perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls - offset=) + offset=) done After few iterations I hit the following BUG. - tt2.sh tt.sh - tt2.sh tt.sh - tt2.sh tt.sh - 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% - tt2.sh tt.sh + tt2.sh tt.sh + tt2.sh tt.sh + tt2.sh tt.sh + 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% + tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem - pt_count 0100, exited with bfff? - [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! - [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] - [ 4657.314740] Modules linked in: rtc_generic pseries_rng + pt_count 0100, exited with bfff? + [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! + [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] + [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a - [ 4657.314782] CFAR: c001fe6c SOFTE: 0 - GPR04: 0010 009c c1424a98 0002 - GPR12: 80009033 ce9a 06a3fcd0 0060 - GPR16: 0020 c0e57c00 - GPR20: c1595dca c1595478 0001 - GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 - [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 - [ 4657.314841] Call Trace: - 4000 (unreliable) - [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 + [ 4657.314782] CFAR: c001fe6c SOFTE: 0 + GPR04: 0010 009c c1424a98 0002 + GPR12: 80009033 ce9a 06a3fcd0 0060 + GPR16: 0020 c0e57c00 + GPR20: c1595dca c1595478 0001 + GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 + [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 + [ 4657.314841] Call Trace: + 4000 (unreliable) + [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 - [ 4657.314884] --- Exception: 901 at
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Changed in: linux (Ubuntu) Assignee: (unassigned) = Chris J Arges (arges) ** Changed in: linux (Ubuntu) Importance: Undecided = Medium ** Changed in: linux (Ubuntu) Status: Confirmed = In Progress -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: In Progress Bug description: Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
Suka, If patches [3] and [4] would make kernel 3.19, we will not need to backport them, since this bug is target for 15.04 (and 15.04 will ship probably with 3.19 kernel) On the other side, if we miss 3.19 window, I would ask you to backport them and attach the backport over 3.19 vivid git repository. Canonical, correct me if I am wrong, please. Thanks Breno ** Changed in: linux (Ubuntu) Status: New = Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Bug description: Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224]
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Tags added: kernel-da-key -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: Confirmed Bug description: Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA pSeries
[Kernel-packages] [Bug 1410519] Re: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters
** Package changed: ubuntu = linux (Ubuntu) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1410519 Title: [PowerVM] Kernel BUG @ kernel/irq_work.c:157! - 24x7 hw counters Status in linux package in Ubuntu: New Bug description: Steps to recreate the problem: 1. Install Ubuntu 15.04 as a PowerVM guest. 2. Install perf tool 3. Run following scripts to test 24/7 Power8 hardware counter event with perf. tool === Script 1 #!/bin/bash count=0; offset=0x128 PERF_ARGS=-r 10 -C 0 while [ $count -lt 100 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls count=) done Script 2 #!/bin/bash offset=0; PERF_ARGS=-r 10 -C 0 while [ $offset -lt 8192 ]; do EVENT=hv_24x7/domain=0x2,offset=$offset,starting_index=10/ perf stat $PERF_ARGS -x ' ' perf stat $PERF_ARGS -x ' ' -e $EVENT ls offset=) done After few iterations I hit the following BUG. tt2.sh tt.sh tt2.sh tt.sh tt2.sh tt.sh 275679187521558 hv_24x7/domain=0x2,offset=6848,starting_index=10/ 0.00% tt2.sh tt.sh [ 4657.314709] softirq: huh, entered softirq 7 SCHED c010abc0 with preem pt_count 0100, exited with bfff? [ 4657.314727] kernel BUG at /build/buildd/linux-3.16.0/kernel/irq_work.c:157! [ 4657.314732] Oops: Exception in kernel mode, sig: 5 [#1] [ 4657.314740] Modules linked in: rtc_generic pseries_rng [ 4657.314749] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-25-generic #33-U [ 4657.314755] task: c1375e00 ti: c13d task.ti: c13d [ 4657.314759] NIP: c01e8ffc LR: c001fe70 CTR: c0002800ic) [ 4657.314770] MSR: 80029033 SF,EE,ME,IR,DR,RI,LE CR: 28042024 XER: 000a [ 4657.314782] CFAR: c001fe6c SOFTE: 0 GPR04: 0010 009c c1424a98 0002 GPR12: 80009033 ce9a 06a3fcd0 0060 GPR16: 0020 c0e57c00 GPR20: c1595dca c1595478 0001 GPR28: c0e40380 c0e40300 c13d3590 c0e56f08 [ 4657.314832] NIP [c01e8ffc] irq_work_run+0x1c/0x30 [ 4657.314841] Call Trace: 4000 (unreliable) [ 4657.314861] [c13d34f0] [c001ff90] timer_interrupt+0xa0/0xe0 [ 4657.314871] [c13d3520] [c0002914] decrementer_common+0x114/0x180 [ 4657.314884] --- Exception: 901 at arch_local_irq_restore+0x14/0x90 [ 4657.314896] [c13d3810] [c012ed08] vprintk_emit+0x3b8/0x660 (u [ 4657.314908] [c13d38e0] [c0a02650] printk+0x84/0x98 [ 4657.314918] [c13d3910] [c00b51b4] __do_softirq+0x1e4/0x410 [ 4657.314927] [c13d3a00] [c00b57b8] irq_exit+0xf8/0x1400 [ 4657.314948] [c13d3a60] [c0002c14] doorbell_super_common+0x114/0x180 [ 4657.314963] --- Exception: a01 at plpar_hcall_norets+0x8c/0xdc [ 4657.314963] LR = check_and_cede_processor+0x34/0x5020/0x50 (unreliable) [ 4657.314997] [c13d3df0] [c084077c] cpuidle_enter_state+0x6c/0x140c0 [ 4657.315030] [c13d3f00] [c0d63ea8] start_kernel+0x500/0x51c [ 4657.315047] Instruction dump: [ 4657.315052] eba1ffe8 7c0803a6 ebc1fff0 ebe1fff8 4e800020 3c4c011f 3842c110 78290464 [ 4657.315068] 81290014 752a000f 7d380026 55291ffe 0b09 4bfffec8 6000 6000 [ 4657.315090] ---[ end trace ee202cccd2211e5d ]--- [ 4657.320224] [ 4657.362675] Unable to handle kernel paging request for data at address 0xc000 000b35515048 [ 4657.362680] Faulting instruction address: 0xc006a37c [ 4657.362684] Oops: Kernel access of bad area, sig: 11 [#2] [ 4657.362686] SMP NR_CPUS=2048 NUMA
