[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
** Changed in: linux (Ubuntu) Importance: Critical => High ** Summary changed: - using perf as root locks up focal kernel + using perf can crash kernel with a stack overflow -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf can crash kernel with a stack overflow Status in Linux: Unknown Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
Appears to be a stack overflow: Top of stack dump (attached) shows it's a stack overflow [ 22.163398] BUG: stack guard page was hit at (ptrval) (stack is (ptrval)..(ptrval)) [ 22.165204] kernel stack overflow (double-fault): [#1] SMP PTI [ 22.166729] CPU: 3 PID: 935 Comm: perf Not tainted 5.4.0-28-generic #32-Ubuntu [ 22.168813] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1ubuntu1 04/01/2014 [ 22.171263] RIP: 0010:perf_trace_x86_exceptions+0x44/0xf0 [ 22.172769] Code: 83 ec 18 48 8b 5f 78 65 48 8b 04 25 28 00 00 00 48 89 45 d0 31 c0 65 48 03 1d 00 0c f9 68 48 8b 87 80 00 00 00 48 85 c0 75 08 <48> 8b 03 48 85 c0 74 74 bf 24 00 00 00 48 8d 55 c4 48 8d 75 c8 e8 [ 22.176573] RSP: 0018:978f00838020 EFLAGS: 00010046 [ 22.177569] RAX: RBX: b78effdcab70 RCX: [ 22.178800] RDX: 978f008380b8 RSI: b78effdcab70 RDI: 9863e620 [ 22.179993] RBP: 978f00838060 R08: R09: [ 22.181188] R10: R11: R12: 9863e620 [ 22.182698] R13: R14: b78effdcab70 R15: 978f008380b8 [ 22.184019] FS: 7ff4818af780() GS:892b7db8() knlGS: [ 22.185592] CS: 0010 DS: ES: CR0: 80050033 [ 22.186732] CR2: 978f00837ff8 CR3: 7d5d8000 CR4: 06e0 [ 22.188100] Call Trace: [ 22.188689] do_page_fault+0xca/0xe0 [ 22.189493] do_async_page_fault+0x39/0x70 [ 22.190388] async_page_fault+0x34/0x40 [ 22.191233] RIP: 0010:perf_trace_x86_exceptions+0x44/0xf0 ** Attachment added: "full stack dump" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+attachment/5363960/+files/stackdump.txt -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in Linux: Unknown Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
** Bug watch added: Linux Kernel Bug Tracker #207519 https://bugzilla.kernel.org/show_bug.cgi?id=207519 ** Also affects: linux via https://bugzilla.kernel.org/show_bug.cgi?id=207519 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in Linux: Unknown Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
OK, this seems to only happen when using exceptions/page_fault_user, exceptions/page_fault_kernel and tlb/tlb_flush together. One can reproduce this with perf: sudo perf record -e exceptions:page_fault_user,exceptions:page_fault_kernel,tlb:tlb_flush sleep 1 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in Linux: Unknown Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
Attaching strace, managed to capture this crash report before a the hang. ** Attachment added: "image" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+attachment/5363910/+files/Screenshot%20from%202020-04-30%2009-25-01.png -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
The TLB tlb/tlb_flush perf event tickles this bug, disabling it won't trip the issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
Tried this on 5.5.19, 5.6.7 and 5.7-rc3 and it's still an issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 1875941] Re: using perf as root locks up focal kernel
This commit is revertable against the current focal head and resolves this issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1875941 Title: using perf as root locks up focal kernel Status in linux package in Ubuntu: In Progress Status in linux source package in Focal: New Bug description: running sudo stress-ng --perf --cpu 1 -t 10 will cause the recent 5.4.0-25-generic kernel to lock up with no information on the console showing where it is locked up. Bisected this back to: commit d44d71bbb9618c526820b39fe1cd0673582dc8c4 (refs/bisect/bad) Author: Joerg Roedel Date: Sat Mar 21 18:22:41 2020 -0700 x86/mm: split vmalloc_sync_all() BugLink: https://bugs.launchpad.net/bugs/1869061 commit 763802b53a427ed3cbd419dbba255c414fdd9e7c upstream. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1875941/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
