Re: F32: System hangs when using mock
On Tue, Apr 07, 2020 09:53:18 +0100, Ankur Sinha wrote: > > On Mon, Apr 06, 2020 09:37:01 +0200, Pavel Raiskup wrote: > > On Sunday, April 5, 2020 12:44:38 PM CEST Ankur Sinha wrote: > > > On Sat, Apr 04, 2020 21:37:05 -, Artem Tim wrote: > > > > https://bugzilla.redhat.com/show_bug.cgi?id=1754807 > > > > > > That does look like it. I'll go through the comments and see if I can > > > help with more info. > > > > Note also this bug [1] where's kernel traceback in bfq kernel code. > > I have never reproduced the problem on my box (ssd nvme disk), so I can't > > tell.. but those are possible workarounds for those who use bfq scheduler: > > > > - per Zbyszek, switching back to deadline > > - per Vitaly, systemd.unified_cgroup_hierarchy=0 kernel parameter > > Thanks Pavel, > > Would someone have instructions on how to make these changes? I can test > both of these out. For the scheduler, the steps here work: https://wiki.archlinux.org/index.php/improving_performance#Input/output_schedulers Testing it out now. -- Thanks, Regards, Ankur Sinha "FranciscoD" (He / Him / His) | https://fedoraproject.org/wiki/User:Ankursinha Time zone: Europe/London signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
On Mon, Apr 06, 2020 09:37:01 +0200, Pavel Raiskup wrote: > On Sunday, April 5, 2020 12:44:38 PM CEST Ankur Sinha wrote: > > On Sat, Apr 04, 2020 21:37:05 -, Artem Tim wrote: > > > https://bugzilla.redhat.com/show_bug.cgi?id=1754807 > > > > That does look like it. I'll go through the comments and see if I can > > help with more info. > > Note also this bug [1] where's kernel traceback in bfq kernel code. > I have never reproduced the problem on my box (ssd nvme disk), so I can't > tell.. but those are possible workarounds for those who use bfq scheduler: > > - per Zbyszek, switching back to deadline > - per Vitaly, systemd.unified_cgroup_hierarchy=0 kernel parameter Thanks Pavel, Would someone have instructions on how to make these changes? I can test both of these out. I also have kernel hangs while trying rooted Podman commands, so perhaps that's also the same issue. The system had hung and I hadn't been able to get any more information there either. > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1767097 -- Thanks, Regards, Ankur Sinha "FranciscoD" (He / Him / His) | https://fedoraproject.org/wiki/User:Ankursinha Time zone: Europe/London signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
On Sunday, April 5, 2020 12:44:38 PM CEST Ankur Sinha wrote: > On Sat, Apr 04, 2020 21:37:05 -, Artem Tim wrote: > > https://bugzilla.redhat.com/show_bug.cgi?id=1754807 > > That does look like it. I'll go through the comments and see if I can > help with more info. Note also this bug [1] where's kernel traceback in bfq kernel code. I have never reproduced the problem on my box (ssd nvme disk), so I can't tell.. but those are possible workarounds for those who use bfq scheduler: - per Zbyszek, switching back to deadline - per Vitaly, systemd.unified_cgroup_hierarchy=0 kernel parameter [1] https://bugzilla.redhat.com/show_bug.cgi?id=1767097 Pavel ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
On Sat, Apr 04, 2020 21:37:05 -, Artem Tim wrote: > https://bugzilla.redhat.com/show_bug.cgi?id=1754807 That does look like it. I'll go through the comments and see if I can help with more info. -- Thanks, Regards, Ankur Sinha "FranciscoD" (He / Him / His) | https://fedoraproject.org/wiki/User:Ankursinha Time zone: Europe/London signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
On Sat, Apr 04, 2020 15:33:57 -0600, Chris Murphy wrote: > On Sat, Apr 4, 2020 at 3:13 PM Ankur Sinha wrote: > > > > Hello, > > > > I've had my system hang up a few times when running mock this evening. > > I've got to power it off and restart it using the switch. Is anyone else > > seeing this? > > After the hang, are you able to switch to a vt or login remotely via ssh? I wasn't able to switch to a vt. I'll test ssh the next time it happens. > If not, two options for getting more information: remotely login via > ssh, and use 'journalctl -fk' to follow kernel messages as they > happen; it might get out by sshd before it gets committed to disk. > More likely successful is switching to a vt, and running mock there, > and seeing if you get a stack trace. Capture with a cell phone. > *shrug* > > What's the exact command? I might try to reproduce if I get a moment, > I have those same versions. It's just a standard mock build for a new package I'm working on: https://pagure.io/neuro-sig/steps So, something simply like: mock -r fedora-rawhide-x86_64 rebuild steps-3.5.0-1.fc32.src.rpm -- Thanks, Regards, Ankur Sinha "FranciscoD" (He / Him / His) | https://fedoraproject.org/wiki/User:Ankursinha Time zone: Europe/London signature.asc Description: PGP signature ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
https://bugzilla.redhat.com/show_bug.cgi?id=1754807 ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: F32: System hangs when using mock
On Sat, Apr 4, 2020 at 3:13 PM Ankur Sinha wrote: > > Hello, > > I've had my system hang up a few times when running mock this evening. > I've got to power it off and restart it using the switch. Is anyone else > seeing this? After the hang, are you able to switch to a vt or login remotely via ssh? If not, two options for getting more information: remotely login via ssh, and use 'journalctl -fk' to follow kernel messages as they happen; it might get out by sshd before it gets committed to disk. More likely successful is switching to a vt, and running mock there, and seeing if you get a stack trace. Capture with a cell phone. *shrug* What's the exact command? I might try to reproduce if I get a moment, I have those same versions. -- Chris Murphy ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
F32: System hangs when using mock
Hello, I've had my system hang up a few times when running mock this evening. I've got to power it off and restart it using the switch. Is anyone else seeing this? $ rpm -q systemd mock systemd-245.4-1.fc32.x86_64 mock-2.2-1.fc32.noarch $ uname -r 5.6.2-300.fc32.x86_64 This is all I found in the journal. Any ideas? Apr 04 22:03:36 ankur userhelper[28439]: running '/usr/libexec/mock/mock -r fedora-rawhide-x86_64 rebuild ./steps-3.5.0-1.fc32.src.rpm' with root privileges on behalf of 'asinha' Apr 04 22:03:38 ankur systemd[1071]: Starting Tracker metadata database store and lookup manager... Apr 04 22:03:38 ankur systemd[1071]: Started Tracker metadata database store and lookup manager. Apr 04 22:03:40 ankur systemd-machined[786]: New machine 661c10ac41c549e9a064fe8e9cac3dbe. Apr 04 22:03:40 ankur audit: BPF prog-id=99 op=LOAD Apr 04 22:03:40 ankur systemd[1]: Started Container 661c10ac41c549e9a064fe8e9cac3dbe. Apr 04 22:03:40 ankur systemd[1]: machine-661c10ac41c549e9a064fe8e9cac3dbe.scope: Succeeded. Apr 04 22:03:40 ankur systemd-machined[786]: Machine 661c10ac41c549e9a064fe8e9cac3dbe terminated. Apr 04 22:03:40 ankur audit: BPF prog-id=99 op=UNLOAD Apr 04 22:03:40 ankur systemd-machined[786]: New machine 9ccd5c6b58ab49de84e726e5d651e895. Apr 04 22:03:40 ankur audit: BPF prog-id=100 op=LOAD Apr 04 22:03:40 ankur systemd[1]: Started Container 9ccd5c6b58ab49de84e726e5d651e895. Apr 04 22:03:41 ankur systemd[1]: machine-9ccd5c6b58ab49de84e726e5d651e895.scope: Succeeded. Apr 04 22:03:41 ankur systemd-machined[786]: Machine 9ccd5c6b58ab49de84e726e5d651e895 terminated. Apr 04 22:03:41 ankur audit: BPF prog-id=100 op=UNLOAD Apr 04 22:03:41 ankur systemd-machined[786]: New machine e1c44a4151034f3c8b0afa982fd3418f. Apr 04 22:03:41 ankur audit: BPF prog-id=101 op=LOAD Apr 04 22:03:41 ankur systemd[1]: Started Container e1c44a4151034f3c8b0afa982fd3418f. Apr 04 22:03:41 ankur systemd[1]: machine-e1c44a4151034f3c8b0afa982fd3418f.scope: Succeeded. Apr 04 22:03:41 ankur systemd-machined[786]: Machine e1c44a4151034f3c8b0afa982fd3418f terminated. Apr 04 22:03:41 ankur audit: BPF prog-id=101 op=UNLOAD Apr 04 22:03:41 ankur systemd-machined[786]: New machine 2fd8e69cb3aa421786a30a58c5666afe. Apr 04 22:03:41 ankur audit: BPF prog-id=102 op=LOAD Apr 04 22:03:41 ankur systemd[1]: Started Container 2fd8e69cb3aa421786a30a58c5666afe. Apr 04 22:03:41 ankur systemd[1]: machine-2fd8e69cb3aa421786a30a58c5666afe.scope: Succeeded. Apr 04 22:03:41 ankur systemd-machined[786]: Machine 2fd8e69cb3aa421786a30a58c5666afe terminated. Apr 04 22:03:41 ankur audit: BPF prog-id=102 op=UNLOAD Apr 04 22:03:42 ankur systemd-machined[786]: New machine 87d23d4848bc4ea8bd4a08d14c8cd273. Apr 04 22:03:42 ankur audit: BPF prog-id=103 op=LOAD Apr 04 22:03:42 ankur systemd[1]: Started Container 87d23d4848bc4ea8bd4a08d14c8cd273. Apr 04 22:03:44 ankur systemd[1]: machine-87d23d4848bc4ea8bd4a08d14c8cd273.scope: Succeeded. Apr 04 22:03:44 ankur systemd-machined[786]: Machine 87d23d4848bc4ea8bd4a08d14c8cd273 terminated. Apr 04 22:03:44 ankur systemd[1]: machine-87d23d4848bc4ea8bd4a08d14c8cd273.scope: Consumed 1.491s CPU time. Apr 04 22:03:44 ankur audit: BPF prog-id=103 op=UNLOAD Apr 04 22:03:44 ankur systemd[1071]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-dev-pts.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1071]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-dev-shm.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-dev-pts.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-dev-shm.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1071]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-sys.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-sys.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1071]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-proc.mount: Succeeded. Apr 04 22:03:44 ankur systemd[1]: var-lib-mock-fedora\x2drawhide\x2dx86_64-root-proc.mount: Succeeded. Apr 04 22:03:44 ankur systemd-machined[786]: New machine 8e61483fc8194441bc938f807f64196f. Apr 04 22:03:44 ankur audit: BPF prog-id=104 op=LOAD Apr 04 22:03:44 ankur systemd[1]: Started Container 8e61483fc8194441bc938f807f64196f. Apr 04 22:03:44 ankur systemd[1]: machine-8e61483fc8194441bc938f807f64196f.scope: Succeeded. Apr 04 22:03:44 ankur systemd-machined[786]: Machine 8e61483fc8194441bc938f807f64196f terminated. Apr 04 22:03:44 ankur audit: BPF prog-id=104 op=UNLOAD Apr 04 22:03:44 ankur systemd-machined[786]: New machine ff052ace0b8d48c8baf135434a7dc259. Apr 04 22:03:44 ankur audit: BPF prog-id=105 op=LOAD Apr 04 22:03:44 ankur systemd[1]: Started Container ff052ace0b8d48c8baf135434a7dc259. Apr 04 22:03:45 ankur systemd[1]: machine-ff052ace0b8d48c8baf135434a7dc259.scope: Succeeded. Apr 04 22:03:45 ankur systemd-machined[786]: Machine ff052ace0b8d48c8baf135434a7dc259 terminated. Apr 04 22:03:45 ankur audit: