[Kernel-packages] [Bug 1882669] Re: Focal Azure AMD64 instances crash with ftrace/test.d/00basic/basic2.tc in ubuntu_kselftests_ftrace and ubuntu_ftrace_smoke_test

2023-09-04 Thread Po-Hsu Lin
For ftrace related issues found with c3.xlarge on AWS cloud, let track
it in bug 2034057.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux-azure in Ubuntu.
https://bugs.launchpad.net/bugs/1882669

Title:
  Focal Azure AMD64 instances crash with ftrace/test.d/00basic/basic2.tc
  in ubuntu_kselftests_ftrace and ubuntu_ftrace_smoke_test

Status in ubuntu-kernel-tests:
  New
Status in linux-aws package in Ubuntu:
  Fix Released
Status in linux-azure package in Ubuntu:
  Confirmed
Status in linux-azure source package in Focal:
  Confirmed
Status in linux-azure source package in Groovy:
  Fix Released

Bug description:
  Issue found on 5.4.0-1013.13

  The ftrace in ubuntu_kernel_selftests failed on the second test:
  # === Ftrace unit tests ===
  # [1] Basic trace file check  [PASS]
  # [2] Basic test for tracers
  (System hang here)

  Syslog:
  kernel: [ 2234.408225] in mmio_trace_init
  kernel: [ 2234.988256] mmiotrace: Disabling non-boot CPUs...
  kernel: [ 2235.028451] mmiotrace: Error taking CPU1 down: -16
  kernel: [ 2235.052564] mmiotrace: Error taking CPU2 down: -16
  kernel: [ 2235.076593] mmiotrace: Error taking CPU3 down: -16
  kernel: [ 2235.096576] mmiotrace: Error taking CPU4 down: -16
  kernel: [ 2235.116487] mmiotrace: Error taking CPU5 down: -16
  kernel: [ 2235.132446] mmiotrace: Error taking CPU6 down: -16
  kernel: [ 2235.152488] mmiotrace: Error taking CPU7 down: -16
  kernel: [ 2235.172526] mmiotrace: Error taking CPU8 down: -16
  kernel: [ 2235.192486] mmiotrace: Error taking CPU9 down: -16
  kernel: [ 2235.212455] mmiotrace: Error taking CPU10 down: -16
  kernel: [ 2235.233020] mmiotrace: Error taking CPU11 down: -16
  kernel: [ 2235.256355] mmiotrace: Error taking CPU12 down: -16
  kernel: [ 2235.272473] mmiotrace: Error taking CPU13 down: -16
  kernel: [ 2235.292393] mmiotrace: Error taking CPU14 down: -16
  kernel: [ 2235.312426] mmiotrace: Error taking CPU15 down: -16
  kernel: [ 2235.344407] mmiotrace: Error taking CPU16 down: -16
  kernel: [ 2235.380494] mmiotrace: Error taking CPU17 down: -16
  kernel: [ 2235.400319] mmiotrace: Error taking CPU18 down: -16
  kernel: [ 2235.432631] mmiotrace: Error taking CPU19 down: -16
  kernel: [ 2235.456453] mmiotrace: Error taking CPU20 down: -16
  kernel: [ 2235.480432] mmiotrace: Error taking CPU21 down: -16
  kernel: [ 2235.496501] mmiotrace: Error taking CPU22 down: -16
  kernel: [ 2235.516442] mmiotrace: Error taking CPU23 down: -16
  kernel: [ 2235.536394] mmiotrace: Error taking CPU24 down: -16
  kernel: [ 2235.556489] mmiotrace: Error taking CPU25 down: -16
  kernel: [ 2235.573759] smpboot: CPU 26 is now offline
  kernel: [ 2235.575071] mmiotrace: CPU26 is down.
  kernel: [ 2235.585643] smpboot: CPU 27 is now offline
  kernel: [ 2235.586699] mmiotrace: CPU27 is down.
  kernel: [ 2235.609679] smpboot: CPU 28 is now offline
  kernel: [ 2235.610788] mmiotrace: CPU28 is down.
  kernel: [ 2235.633530] smpboot: CPU 29 is now offline
  kernel: [ 2235.634511] mmiotrace: CPU29 is down.
  kernel: [ 2235.653652] smpboot: CPU 30 is now offline
  kernel: [ 2235.655415] mmiotrace: CPU30 is down.
  kernel: [ 2235.678126] smpboot: CPU 31 is now offline
  kernel: [ 2235.679061] mmiotrace: CPU31 is down.
  kernel: [ 2235.679062] mmiotrace: multiple CPUs still online, may miss events.
  kernel: [ 2235.679063] mmiotrace: enabled.
  kernel: [ 2235.679128] in mmio_trace_reset
  kernel: [ 2235.696163] mmiotrace: Re-enabling CPUs...
  kernel: [ 2235.732157] mmiotrace: enabled CPU1.
  kernel: [ 2235.772207] mmiotrace: enabled CPU2.
  kernel: [ 2235.812216] mmiotrace: enabled CPU3.
  kernel: [ 2235.844220] mmiotrace: enabled CPU4.
  kernel: [ 2235.876211] mmiotrace: enabled CPU5.
  kernel: [ 2235.916159] mmiotrace: enabled CPU6.
  kernel: [ 2235.956214] mmiotrace: enabled CPU7.
  kernel: [ 2235.988145] mmiotrace: enabled CPU8.
  kernel: [ 2236.020214] mmiotrace: enabled CPU9.
  kernel: [ 2236.060207] mmiotrace: enabled CPU10.
  kernel: [ 2236.096208] mmiotrace: enabled CPU11.
  kernel: [ 2236.128205] mmiotrace: enabled CPU12.
  /usr/sbin/irqbalance: WARNING, didn't collect load info for all cpus, 
balancing is broken
  kernel: [ 2236.168204] mmiotrace: enabled CPU13.
  kernel: [ 2236.200206] mmiotrace: enabled CPU14.
  kernel: [ 2236.232207] mmiotrace: enabled CPU15.
  kernel: [ 2236.264224] mmiotrace: enabled CPU16.
  kernel: [ 2236.300207] mmiotrace: enabled CPU17.
  kernel: [ 2236.332210] mmiotrace: enabled CPU18.
  kernel: [ 2236.372224] mmiotrace: enabled CPU19.
  kernel: [ 2236.404147] mmiotrace: enabled CPU20.
  kernel: [ 2236.452153] mmiotrace: enabled CPU21.
  kernel: [ 2236.492152] mmiotrace: enabled CPU22.
  kernel: [ 2236.524153] mmiotrace: enabled CPU23.
  kernel: [ 2236.564211] mmiotrace: enabled CPU24.
  kernel: [ 2236.612204] mmiotrace: enabled CPU25.
  kernel: [ 2236.644353] smpboot: Booting Node 0 Processor 26 APIC 0x1a
  kernel: [ 2236.645769] mmiotrace: enabled CPU26.
  

[Kernel-packages] [Bug 1882669] Re: Focal Azure AMD64 instances crash with ftrace/test.d/00basic/basic2.tc in ubuntu_kselftests_ftrace and ubuntu_ftrace_smoke_test

2023-07-28 Thread Magali Lemes do Sacramento
Seems to still be found on f:linux-aws-fips, cycle 2023-07-10

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux-azure in Ubuntu.
https://bugs.launchpad.net/bugs/1882669

Title:
  Focal Azure AMD64 instances crash with ftrace/test.d/00basic/basic2.tc
  in ubuntu_kselftests_ftrace and ubuntu_ftrace_smoke_test

Status in ubuntu-kernel-tests:
  New
Status in linux-aws package in Ubuntu:
  Fix Released
Status in linux-azure package in Ubuntu:
  Confirmed
Status in linux-azure source package in Focal:
  Confirmed
Status in linux-azure source package in Groovy:
  Fix Released

Bug description:
  Issue found on 5.4.0-1013.13

  The ftrace in ubuntu_kernel_selftests failed on the second test:
  # === Ftrace unit tests ===
  # [1] Basic trace file check  [PASS]
  # [2] Basic test for tracers
  (System hang here)

  Syslog:
  kernel: [ 2234.408225] in mmio_trace_init
  kernel: [ 2234.988256] mmiotrace: Disabling non-boot CPUs...
  kernel: [ 2235.028451] mmiotrace: Error taking CPU1 down: -16
  kernel: [ 2235.052564] mmiotrace: Error taking CPU2 down: -16
  kernel: [ 2235.076593] mmiotrace: Error taking CPU3 down: -16
  kernel: [ 2235.096576] mmiotrace: Error taking CPU4 down: -16
  kernel: [ 2235.116487] mmiotrace: Error taking CPU5 down: -16
  kernel: [ 2235.132446] mmiotrace: Error taking CPU6 down: -16
  kernel: [ 2235.152488] mmiotrace: Error taking CPU7 down: -16
  kernel: [ 2235.172526] mmiotrace: Error taking CPU8 down: -16
  kernel: [ 2235.192486] mmiotrace: Error taking CPU9 down: -16
  kernel: [ 2235.212455] mmiotrace: Error taking CPU10 down: -16
  kernel: [ 2235.233020] mmiotrace: Error taking CPU11 down: -16
  kernel: [ 2235.256355] mmiotrace: Error taking CPU12 down: -16
  kernel: [ 2235.272473] mmiotrace: Error taking CPU13 down: -16
  kernel: [ 2235.292393] mmiotrace: Error taking CPU14 down: -16
  kernel: [ 2235.312426] mmiotrace: Error taking CPU15 down: -16
  kernel: [ 2235.344407] mmiotrace: Error taking CPU16 down: -16
  kernel: [ 2235.380494] mmiotrace: Error taking CPU17 down: -16
  kernel: [ 2235.400319] mmiotrace: Error taking CPU18 down: -16
  kernel: [ 2235.432631] mmiotrace: Error taking CPU19 down: -16
  kernel: [ 2235.456453] mmiotrace: Error taking CPU20 down: -16
  kernel: [ 2235.480432] mmiotrace: Error taking CPU21 down: -16
  kernel: [ 2235.496501] mmiotrace: Error taking CPU22 down: -16
  kernel: [ 2235.516442] mmiotrace: Error taking CPU23 down: -16
  kernel: [ 2235.536394] mmiotrace: Error taking CPU24 down: -16
  kernel: [ 2235.556489] mmiotrace: Error taking CPU25 down: -16
  kernel: [ 2235.573759] smpboot: CPU 26 is now offline
  kernel: [ 2235.575071] mmiotrace: CPU26 is down.
  kernel: [ 2235.585643] smpboot: CPU 27 is now offline
  kernel: [ 2235.586699] mmiotrace: CPU27 is down.
  kernel: [ 2235.609679] smpboot: CPU 28 is now offline
  kernel: [ 2235.610788] mmiotrace: CPU28 is down.
  kernel: [ 2235.633530] smpboot: CPU 29 is now offline
  kernel: [ 2235.634511] mmiotrace: CPU29 is down.
  kernel: [ 2235.653652] smpboot: CPU 30 is now offline
  kernel: [ 2235.655415] mmiotrace: CPU30 is down.
  kernel: [ 2235.678126] smpboot: CPU 31 is now offline
  kernel: [ 2235.679061] mmiotrace: CPU31 is down.
  kernel: [ 2235.679062] mmiotrace: multiple CPUs still online, may miss events.
  kernel: [ 2235.679063] mmiotrace: enabled.
  kernel: [ 2235.679128] in mmio_trace_reset
  kernel: [ 2235.696163] mmiotrace: Re-enabling CPUs...
  kernel: [ 2235.732157] mmiotrace: enabled CPU1.
  kernel: [ 2235.772207] mmiotrace: enabled CPU2.
  kernel: [ 2235.812216] mmiotrace: enabled CPU3.
  kernel: [ 2235.844220] mmiotrace: enabled CPU4.
  kernel: [ 2235.876211] mmiotrace: enabled CPU5.
  kernel: [ 2235.916159] mmiotrace: enabled CPU6.
  kernel: [ 2235.956214] mmiotrace: enabled CPU7.
  kernel: [ 2235.988145] mmiotrace: enabled CPU8.
  kernel: [ 2236.020214] mmiotrace: enabled CPU9.
  kernel: [ 2236.060207] mmiotrace: enabled CPU10.
  kernel: [ 2236.096208] mmiotrace: enabled CPU11.
  kernel: [ 2236.128205] mmiotrace: enabled CPU12.
  /usr/sbin/irqbalance: WARNING, didn't collect load info for all cpus, 
balancing is broken
  kernel: [ 2236.168204] mmiotrace: enabled CPU13.
  kernel: [ 2236.200206] mmiotrace: enabled CPU14.
  kernel: [ 2236.232207] mmiotrace: enabled CPU15.
  kernel: [ 2236.264224] mmiotrace: enabled CPU16.
  kernel: [ 2236.300207] mmiotrace: enabled CPU17.
  kernel: [ 2236.332210] mmiotrace: enabled CPU18.
  kernel: [ 2236.372224] mmiotrace: enabled CPU19.
  kernel: [ 2236.404147] mmiotrace: enabled CPU20.
  kernel: [ 2236.452153] mmiotrace: enabled CPU21.
  kernel: [ 2236.492152] mmiotrace: enabled CPU22.
  kernel: [ 2236.524153] mmiotrace: enabled CPU23.
  kernel: [ 2236.564211] mmiotrace: enabled CPU24.
  kernel: [ 2236.612204] mmiotrace: enabled CPU25.
  kernel: [ 2236.644353] smpboot: Booting Node 0 Processor 26 APIC 0x1a
  kernel: [ 2236.645769] mmiotrace: enabled CPU26.
  kernel: [ 2236.684537] smpboot: