[Kernel-packages] [Bug 1481357] Comment bridged from LTC Bugzilla
--- Comment From ye...@us.ibm.com 2016-03-07 19:07 EDT--- (In reply to comment #35) > Provided 3.19.0-50-generic linux kernel image is not bootable in my > machine, as it does not have the ipr module in initramfs, hence failing to > find the root disk. > .. ... > > Regards, > -Satheesh. I hit similar problem when I installed 3.19.0-51-generic, but this problem can be fixed by installing the extra package:" linux-image- extra-3.19.0-51-generic" -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1481357 Title: [LTCTest][Kernel][OP810]Ubuntu14.04.3: kernel call trace while continuously switching between smt on/off and changing subcores Status in linux package in Ubuntu: Fix Released Status in linux source package in Vivid: Fix Released Status in linux source package in Wily: Fix Released Status in linux source package in Xenial: Fix Released Bug description: == Comment: #0 - Satheesh Rajendran - 2015-07-14 02:32:22 == While running the below script, and nothing else was running in the system, host got the kernel call traces after around 15~20 mins #!/bin/bash -x while true; do for i in 1 2 4; do ppc64_cpu --subcores-per-core=$i; ppc64_cpu --info ppc64_cpu --smt=off; ppc64_cpu --info sleep 1; lscpu ppc64_cpu --smt=on; ppc64_cpu --info sleep 1; lscpu done; sleep 1; done Environment: -- $ cat /etc/issue Ubuntu 14.04.2 LTS \n \l $ uname -a Linux tul8fp 3.19.0-22-generic #22~14.04.1-Ubuntu SMP Wed Jun 17 10:03:39 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux $ lscpu Architecture: ppc64le Byte Order:Little Endian CPU(s):160 On-line CPU(s) list: 0,4,8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 Off-line CPU(s) list: 1-3,5-7,9-11,13-15,17-19,21-23,25-27,29-31,33-35,37-39,41-43,45-47,49-51,53-55,57-59,61-63,65-67,69-71,73-75,77-79,81-83,85-87,89-91,93-95,97-99,101-103,105-107,109-111,113-115,117-119,121-123,125-127,129-131,133-135,137 Thread(s) per core:2 Core(s) per socket:10 Socket(s): 2 NUMA node(s): 2 Model: 8335-GTA L1d cache: 64K L1i cache: 32K L2 cache: 512K L3 cache: 8192K NUMA node0 CPU(s): 0,4,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 NUMA node8 CPU(s): 8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84 $ tail -10 /proc/cpuinfo processor : 159 cpu : POWER8 (raw), altivec supported clock : 2693.00MHz revision : 2.0 (pvr 004d 0200) timebase : 51200 platform : PowerNV model : 8335-GTA machine : PowerNV 8335-GTA firmware : OPAL v3 Logs:- - # dmesg [79081.074088] INFO: task irqbalance:1897 blocked for more than 120 seconds. [79081.074333] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074388] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081.074449] irqbalance D 3fff9ac39d3c 0 1897 1 0x0004 [79081.074454] Call Trace: [79081.074470] [c007e8d035f0] [3fff9af5] 0x3fff9af5 (unreliable) [79081.074477] [c007e8d037c0] [c0015934] __switch_to+0x204/0x350 [79081.074482] [c007e8d03820] [c0a11508] __schedule+0x368/0x8d0 [79081.074486] --- interrupt: 1000ba30 at 0xc007e8d039f0 [79081.074486] LR = 0x10026a6c1d0 [79081.074490] [c007e8d03a40] [c0a120a0] schedule_preempt_disabled+0x20/0x30 (unreliable) [79081.074494] [c007e8d03a60] [c0a1420c] __mutex_lock_slowpath+0xfc/0x1f0 [79081.074497] [c007e8d03ae0] [c0a1436c] mutex_lock+0x6c/0x70 [79081.074501] [c007e8d03b10] [c064488c] online_show+0x3c/0x90 [79081.074503] [c007e8d03b90] [c0644fec] dev_attr_show+0x5c/0xc0 [79081.074508] [c007e8d03bd0] [c035b7f4] sysfs_kf_seq_show+0x114/0x200 [79081.074511] [c007e8d03c20] [c03591e4] kernfs_seq_show+0x54/0x70 [79081.074515] [c007e8d03c50] [c02e74fc] seq_read+0xec/0x500 [79081.074519] [c007e8d03cf0] [c035a474] kernfs_fop_read+0x184/0x220 [79081.074523] [c007e8d03d50] [c02b520c] __vfs_read+0x6c/0x120 [79081.074527] [c007e8d03d90] [c02b5364] vfs_read+0xa4/0x1c0 [79081.074530] [c007e8d03de0] [c02b54ec] SyS_read+0x6c/0x110 [79081.074534] [c007e8d03e30] [c0009258] system_call+0x38/0xd0 [79081.074546] INFO: task ppc64_cpu:111047 blocked for more than 120 seconds. [79081.074597] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074802] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081
[Kernel-packages] [Bug 1481357] Comment bridged from LTC Bugzilla
--- Comment From bren...@br.ibm.com 2016-02-29 13:19 EDT--- (In reply to comment #35) > Provided 3.19.0-50-generic linux kernel image is not bootable in my > machine, as it does not have the ipr module in initramfs, hence failing to > find the root disk. I just double check and kernel 3.19 (Ubuntu 14.04.3) is still supported until August. So, we need to have this fixed. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1481357 Title: [LTCTest][Kernel][OP810]Ubuntu14.04.3: kernel call trace while continuously switching between smt on/off and changing subcores Status in linux package in Ubuntu: Fix Released Status in linux source package in Vivid: Fix Released Status in linux source package in Wily: Fix Released Status in linux source package in Xenial: Fix Released Bug description: == Comment: #0 - Satheesh Rajendran - 2015-07-14 02:32:22 == While running the below script, and nothing else was running in the system, host got the kernel call traces after around 15~20 mins #!/bin/bash -x while true; do for i in 1 2 4; do ppc64_cpu --subcores-per-core=$i; ppc64_cpu --info ppc64_cpu --smt=off; ppc64_cpu --info sleep 1; lscpu ppc64_cpu --smt=on; ppc64_cpu --info sleep 1; lscpu done; sleep 1; done Environment: -- $ cat /etc/issue Ubuntu 14.04.2 LTS \n \l $ uname -a Linux tul8fp 3.19.0-22-generic #22~14.04.1-Ubuntu SMP Wed Jun 17 10:03:39 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux $ lscpu Architecture: ppc64le Byte Order:Little Endian CPU(s):160 On-line CPU(s) list: 0,4,8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 Off-line CPU(s) list: 1-3,5-7,9-11,13-15,17-19,21-23,25-27,29-31,33-35,37-39,41-43,45-47,49-51,53-55,57-59,61-63,65-67,69-71,73-75,77-79,81-83,85-87,89-91,93-95,97-99,101-103,105-107,109-111,113-115,117-119,121-123,125-127,129-131,133-135,137 Thread(s) per core:2 Core(s) per socket:10 Socket(s): 2 NUMA node(s): 2 Model: 8335-GTA L1d cache: 64K L1i cache: 32K L2 cache: 512K L3 cache: 8192K NUMA node0 CPU(s): 0,4,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 NUMA node8 CPU(s): 8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84 $ tail -10 /proc/cpuinfo processor : 159 cpu : POWER8 (raw), altivec supported clock : 2693.00MHz revision : 2.0 (pvr 004d 0200) timebase : 51200 platform : PowerNV model : 8335-GTA machine : PowerNV 8335-GTA firmware : OPAL v3 Logs:- - # dmesg [79081.074088] INFO: task irqbalance:1897 blocked for more than 120 seconds. [79081.074333] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074388] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081.074449] irqbalance D 3fff9ac39d3c 0 1897 1 0x0004 [79081.074454] Call Trace: [79081.074470] [c007e8d035f0] [3fff9af5] 0x3fff9af5 (unreliable) [79081.074477] [c007e8d037c0] [c0015934] __switch_to+0x204/0x350 [79081.074482] [c007e8d03820] [c0a11508] __schedule+0x368/0x8d0 [79081.074486] --- interrupt: 1000ba30 at 0xc007e8d039f0 [79081.074486] LR = 0x10026a6c1d0 [79081.074490] [c007e8d03a40] [c0a120a0] schedule_preempt_disabled+0x20/0x30 (unreliable) [79081.074494] [c007e8d03a60] [c0a1420c] __mutex_lock_slowpath+0xfc/0x1f0 [79081.074497] [c007e8d03ae0] [c0a1436c] mutex_lock+0x6c/0x70 [79081.074501] [c007e8d03b10] [c064488c] online_show+0x3c/0x90 [79081.074503] [c007e8d03b90] [c0644fec] dev_attr_show+0x5c/0xc0 [79081.074508] [c007e8d03bd0] [c035b7f4] sysfs_kf_seq_show+0x114/0x200 [79081.074511] [c007e8d03c20] [c03591e4] kernfs_seq_show+0x54/0x70 [79081.074515] [c007e8d03c50] [c02e74fc] seq_read+0xec/0x500 [79081.074519] [c007e8d03cf0] [c035a474] kernfs_fop_read+0x184/0x220 [79081.074523] [c007e8d03d50] [c02b520c] __vfs_read+0x6c/0x120 [79081.074527] [c007e8d03d90] [c02b5364] vfs_read+0xa4/0x1c0 [79081.074530] [c007e8d03de0] [c02b54ec] SyS_read+0x6c/0x110 [79081.074534] [c007e8d03e30] [c0009258] system_call+0x38/0xd0 [79081.074546] INFO: task ppc64_cpu:111047 blocked for more than 120 seconds. [79081.074597] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074802] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081.074865] ppc64_cpu D 3fff82892d08 0 111047 109995 0x0004
[Kernel-packages] [Bug 1481357] Comment bridged from LTC Bugzilla
--- Comment From sathe...@in.ibm.com 2016-02-18 03:18 EDT--- Provided 3.19.0-50-generic linux kernel image is not bootable in my machine, as it does not have the ipr module in initramfs, hence failing to find the root disk. Steps: 1. Installed 3.19.0-50-generic kernel 2. reboot, choose the above kernel/ kexec to the above kernel > both result in below error Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Gave up waiting for root device. Common problems: - Boot args (cat /proc/cmdline) - Check rootdelay= (did the system wait long enough?) - Check root= (did the system wait for the right device?) - Missing modules (cat /proc/modules; ls /dev) ALERT! /dev/disk/by-uuid/1e999814-80ae-4ef9-89a0-c7fda8d968c5 does not exist. Dropping to a shell! BusyBox v1.21.1 (Ubuntu 1:1.21.0-1ubuntu1) built-in shell (ash) Enter 'help' for a list of built-in commands. (initramfs) 3. Tried boot back to 4.2 kernel, it is working fine 4. extracted and compared the initramfs content and found 4.2 kernel has ipr in modules.dep whereas 3.19.0-50-generic does not have. Pls provide updated kernel image to proceed with tests. Thanks inadvance. output of extracted initramfs # grep -r ipr 4.2/* Binary file 4.2/bin/busybox matches Binary file 4.2/initrd.img-4.2.0-27-generic matches Binary file 4.2/initrd.img-4.2.0-27-generic.bk matches Binary file 4.2/lib/powerpc64le-linux-gnu/libtinfo.so.5 matches Binary file 4.2/lib/powerpc64le-linux-gnu/libc.so.6 matches 4.2/lib/modules/4.2.0-27-generic/modules.dep:kernel/drivers/scsi/ipr.ko: Binary file 4.2/lib/modules/4.2.0-27-generic/modules.dep.bin matches 4.2/lib/modules/4.2.0-27-generic/modules.alias:alias pci:v1014d034Asv1014sd04C9bc*sc*i* ipr ... 4.2/lib/modules/4.2.0-27-generic/modules.alias:alias pci:v1069dB166sv1014sd0266bc*sc*i* ipr Binary file 4.2/lib/modules/4.2.0-27-generic/kernel/drivers/scsi/megaraid/megaraid_sas.ko matches Binary file 4.2/lib/modules/4.2.0-27-generic/kernel/drivers/scsi/libsas/libsas.ko matches Binary file 4.2/lib/modules/4.2.0-27-generic/kernel/drivers/scsi/ipr.ko matches Binary file 4.2/lib/modules/4.2.0-27-generic/kernel/drivers/net/ethernet/jme.ko matches 4.2/lib/modules/4.2.0-27-generic/modules.order:kernel/drivers/scsi/ipr.ko 4.2/lib/modules/4.2.0-27-generic/modules.order:kernel/drivers/mtd/chips/chipreg.ko 4.2/lib/modules/4.2.0-27-generic/modules.order:kernel/net/netfilter/xt_iprange.ko Binary file 4.2/lib/modules/4.2.0-27-generic/modules.alias.bin matches ? # grep -r ipr 3.19/* Binary file 3.19/bin/busybox matches Binary file 3.19/initrd.img-3.19.0-50-generic matches Binary file 3.19/lib/powerpc64le-linux-gnu/libtinfo.so.5 matches Binary file 3.19/lib/powerpc64le-linux-gnu/libc.so.6 matches Binary file 3.19/lib/modules/3.19.0-50-generic/kernel/drivers/scsi/libsas/libsas.ko matches 3.19/lib/modules/3.19.0-50-generic/modules.order:kernel/drivers/scsi/ipr.ko 3.19/lib/modules/3.19.0-50-generic/modules.order:kernel/drivers/mtd/chips/chipreg.ko 3.19/lib/modules/3.19.0-50-generic/modules.order:kernel/net/netfilter/xt_iprange.ko #lsscsi ... [1:2:0:0]diskIBM IPR-0 5EC29900 /dev/sdc [1:2:1:0]diskIBM IPR-0 5EC2A800 /dev/sdd Regards, -Satheesh. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1481357 Title: [LTCTest][Kernel][OP810]Ubuntu14.04.3: kernel call trace while continuously switching between smt on/off and changing subcores Status in linux package in Ubuntu: Fix Released Status in linux source package in Vivid: Fix Committed Status in linux source package in Wily: Fix Released Status in linux source package in Xenial: Fix Released Bug description: == Comment: #0 - Satheesh Rajendran - 2015-07-14 02:32:22 == While running the below script, and nothing else was running in the system, host got the kernel call traces after around 15~20 mins #!/bin/bash -x while true; do for i in 1 2 4; do ppc64_cpu --subcores-per-core=$i; ppc64_cpu --info ppc64_cpu --smt=off; ppc64_cpu --info sleep 1; lscpu ppc64_cpu --smt=on; ppc64_cpu --info sleep 1; lscpu done; sleep 1; done Environment: -- $ cat /etc/issue Ubuntu 14.04.2 LTS \n \l $ uname -a Linux tul8fp 3.19.0-22-generic #22~14.04.1-Ubuntu SMP Wed Jun 17 10:03:39 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux $ lscpu Architecture: ppc64le Byte Order:Little Endian CPU(s):160 On-line CPU(s) list: 0,4,8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 Off-line CPU(s) list: 1-3,5-7,9-11,13-15,17-19,21-23,25-27,29-31,33-35,37-39,41-43,45-47,49-51,53-55,57-59,61-63,65-67,69-71,73-75,77-79,81-83,85-87,89-91,93-95,97-99,101-103,105-107,109-111,113-115,117-119,121-123,125-127,129-131
[Kernel-packages] [Bug 1481357] Comment bridged from LTC Bugzilla
--- Comment From bren...@br.ibm.com 2016-02-08 13:16 EDT--- You need to get this kernel from the -proposed archive, please enable the proposed repository and download kernel 3.19 specifically, as: # apt-get install linux-image-3.19.0-50-generic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1481357 Title: [LTCTest][Kernel][OP810]Ubuntu14.04.3: kernel call trace while continuously switching between smt on/off and changing subcores Status in linux package in Ubuntu: Fix Released Status in linux source package in Vivid: Fix Committed Status in linux source package in Wily: Fix Released Status in linux source package in Xenial: Fix Released Bug description: == Comment: #0 - Satheesh Rajendran - 2015-07-14 02:32:22 == While running the below script, and nothing else was running in the system, host got the kernel call traces after around 15~20 mins #!/bin/bash -x while true; do for i in 1 2 4; do ppc64_cpu --subcores-per-core=$i; ppc64_cpu --info ppc64_cpu --smt=off; ppc64_cpu --info sleep 1; lscpu ppc64_cpu --smt=on; ppc64_cpu --info sleep 1; lscpu done; sleep 1; done Environment: -- $ cat /etc/issue Ubuntu 14.04.2 LTS \n \l $ uname -a Linux tul8fp 3.19.0-22-generic #22~14.04.1-Ubuntu SMP Wed Jun 17 10:03:39 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux $ lscpu Architecture: ppc64le Byte Order:Little Endian CPU(s):160 On-line CPU(s) list: 0,4,8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 Off-line CPU(s) list: 1-3,5-7,9-11,13-15,17-19,21-23,25-27,29-31,33-35,37-39,41-43,45-47,49-51,53-55,57-59,61-63,65-67,69-71,73-75,77-79,81-83,85-87,89-91,93-95,97-99,101-103,105-107,109-111,113-115,117-119,121-123,125-127,129-131,133-135,137 Thread(s) per core:2 Core(s) per socket:10 Socket(s): 2 NUMA node(s): 2 Model: 8335-GTA L1d cache: 64K L1i cache: 32K L2 cache: 512K L3 cache: 8192K NUMA node0 CPU(s): 0,4,88,92,96,100,104,108,112,116,120,124,128,132,136,138-159 NUMA node8 CPU(s): 8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84 $ tail -10 /proc/cpuinfo processor : 159 cpu : POWER8 (raw), altivec supported clock : 2693.00MHz revision : 2.0 (pvr 004d 0200) timebase : 51200 platform : PowerNV model : 8335-GTA machine : PowerNV 8335-GTA firmware : OPAL v3 Logs:- - # dmesg [79081.074088] INFO: task irqbalance:1897 blocked for more than 120 seconds. [79081.074333] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074388] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081.074449] irqbalance D 3fff9ac39d3c 0 1897 1 0x0004 [79081.074454] Call Trace: [79081.074470] [c007e8d035f0] [3fff9af5] 0x3fff9af5 (unreliable) [79081.074477] [c007e8d037c0] [c0015934] __switch_to+0x204/0x350 [79081.074482] [c007e8d03820] [c0a11508] __schedule+0x368/0x8d0 [79081.074486] --- interrupt: 1000ba30 at 0xc007e8d039f0 [79081.074486] LR = 0x10026a6c1d0 [79081.074490] [c007e8d03a40] [c0a120a0] schedule_preempt_disabled+0x20/0x30 (unreliable) [79081.074494] [c007e8d03a60] [c0a1420c] __mutex_lock_slowpath+0xfc/0x1f0 [79081.074497] [c007e8d03ae0] [c0a1436c] mutex_lock+0x6c/0x70 [79081.074501] [c007e8d03b10] [c064488c] online_show+0x3c/0x90 [79081.074503] [c007e8d03b90] [c0644fec] dev_attr_show+0x5c/0xc0 [79081.074508] [c007e8d03bd0] [c035b7f4] sysfs_kf_seq_show+0x114/0x200 [79081.074511] [c007e8d03c20] [c03591e4] kernfs_seq_show+0x54/0x70 [79081.074515] [c007e8d03c50] [c02e74fc] seq_read+0xec/0x500 [79081.074519] [c007e8d03cf0] [c035a474] kernfs_fop_read+0x184/0x220 [79081.074523] [c007e8d03d50] [c02b520c] __vfs_read+0x6c/0x120 [79081.074527] [c007e8d03d90] [c02b5364] vfs_read+0xa4/0x1c0 [79081.074530] [c007e8d03de0] [c02b54ec] SyS_read+0x6c/0x110 [79081.074534] [c007e8d03e30] [c0009258] system_call+0x38/0xd0 [79081.074546] INFO: task ppc64_cpu:111047 blocked for more than 120 seconds. [79081.074597] Not tainted 3.19.0-22-generic #22~14.04.1-Ubuntu [79081.074802] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [79081.074865] ppc64_cpu D 3fff82892d08 0 111047 109995 0x0004 [79081.074868] Call Trace: [79081.074871] [c00f1c67f680] [c00f1c67f710] 0xc00f1c67f710 (unreliable) [79081.
