[Kernel-packages] [Bug 2026229] Re: Crashing issue with 5.15 kernel
[Expired for linux (Ubuntu) because there has been no activity for 60 days.] ** Changed in: linux (Ubuntu) Status: Incomplete => Expired -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/2026229 Title: Crashing issue with 5.15 kernel Status in linux package in Ubuntu: Expired Bug description: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be with the kernel. The github-runner charm is a machine charm that runs on virtual machines. The charm creates a LXD virtual machine inside the juju unit/machine and runs the GitHub self-hosted runner application. The self-hosted runner can be used on GitHub to run GitHub Actions. The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. For the last week, the team has been experimenting with upgrading the kernel to the HWE version which is 5.19. Since then we have not encountered crashes in the virtual machine hosting the juju machine. This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2026229/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 2026229] Re: Crashing issue with 5.15 kernel
@kleber-souza do you have any reference for which kind of bugs were resolved between 5.15.0-73-generic and 5.15.0-76.83 that might have addressed this? Our testing indicates that the newer kernel version is stable. It would be good to know what specifically caused this issue -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/2026229 Title: Crashing issue with 5.15 kernel Status in linux package in Ubuntu: New Bug description: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be with the kernel. The github-runner charm is a machine charm that runs on virtual machines. The charm creates a LXD virtual machine inside the juju unit/machine and runs the GitHub self-hosted runner application. The self-hosted runner can be used on GitHub to run GitHub Actions. The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. For the last week, the team has been experimenting with upgrading the kernel to the HWE version which is 5.19. Since then we have not encountered crashes in the virtual machine hosting the juju machine. This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2026229/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 2026229] Re: Crashing issue with 5.15 kernel
Thanks, we are trying out the jammy kernel to confirm it resolves the issue. Will report back -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/2026229 Title: Crashing issue with 5.15 kernel Status in linux package in Ubuntu: New Bug description: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be with the kernel. The github-runner charm is a machine charm that runs on virtual machines. The charm creates a LXD virtual machine inside the juju unit/machine and runs the GitHub self-hosted runner application. The self-hosted runner can be used on GitHub to run GitHub Actions. The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. For the last week, the team has been experimenting with upgrading the kernel to the HWE version which is 5.19. Since then we have not encountered crashes in the virtual machine hosting the juju machine. This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2026229/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 2026229] Re: Crashing issue with 5.15 kernel
Hello @jdkandersson, I see on the logs that the machines are running kernel 5.15.0-73-generic, can you please first try the jammy kernel currently in -updates (5.15.0-76.83)? If that doesn't solve, I would suggest trying the kernel in -proposed as well (currently 5.15.0-77.84). These kernels carry several fixes from upstream stable updates, so there's a chance the issue has been already fixed. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/2026229 Title: Crashing issue with 5.15 kernel Status in linux package in Ubuntu: New Bug description: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be with the kernel. The github-runner charm is a machine charm that runs on virtual machines. The charm creates a LXD virtual machine inside the juju unit/machine and runs the GitHub self-hosted runner application. The self-hosted runner can be used on GitHub to run GitHub Actions. The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. For the last week, the team has been experimenting with upgrading the kernel to the HWE version which is 5.19. Since then we have not encountered crashes in the virtual machine hosting the juju machine. This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2026229/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
[Kernel-packages] [Bug 2026229] Re: Crashing issue with 5.15 kernel
** Description changed: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be - with the kernel. This is a doc with more details: - https://docs.google.com/document/d/1E00rlT12Cu-h99do80Qge- - MKyQARFDY6hxSjhFFfPvA/edit?usp=sharing + with the kernel. + + The github-runner charm is a machine charm that runs on virtual + machines. The charm creates a LXD virtual machine inside the juju + unit/machine and runs the GitHub self-hosted runner application. The + self-hosted runner can be used on GitHub to run GitHub Actions. + + The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: + Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 + The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ + Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ + The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. + + For the last week, the team has been experimenting with upgrading the + kernel to the HWE version which is 5.19. Since then we have not + encountered crashes in the virtual machine hosting the juju machine. + + This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: + https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/2026229 Title: Crashing issue with 5.15 kernel Status in linux package in Ubuntu: New Bug description: We have been working on making self-hosted GitHub actions runners available in Canonical and have encountered an issue which seems to be with the kernel. The github-runner charm is a machine charm that runs on virtual machines. The charm creates a LXD virtual machine inside the juju unit/machine and runs the GitHub self-hosted runner application. The self-hosted runner can be used on GitHub to run GitHub Actions. The deployment of github-runner charm consists of about 15 units/machines (one unit per machine). In the past, we would see about one machine going into “down” state about every 1-3 days. From the openstack hosting the machine, it seems the machine has crashed. The syslog includes the following entry: Jun 8 21:15:58 juju-e4d256-prod-github-runner-66 kernel: [27199.579882] BUG: kernel NULL pointer dereference, address: 0008 The syslog: https://pastebin.canonical.com/p/gYy3Z9XGkN/ Log on openstack: https://pastebin.canonical.com/p/fbGcmQv9JW/ The deployment of the charm was on the jammy series (22.04). This series uses the Linux kernel 5.15. For the last week, the team has been experimenting with upgrading the kernel to the HWE version which is 5.19. Since then we have not encountered crashes in the virtual machine hosting the juju machine. This mattermost thread includes our team’s discussion of this issue and the reason we decide to upgrade the kernel: https://chat.canonical.com/canonical/pl/h8wrrmcnh3d17dtjmg56zf5pwy To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2026229/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
