[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Ubuntu 20.10 (Groovy Gorilla) reached its End of Life on July 22 2021, hence I'm updating the groovy entry of this ticket - and with that the overall ticket status. ** Changed in: glibc (Ubuntu Groovy) Status: Fix Committed => Won't Fix ** Changed in: ubuntu-z-systems Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Changed in: glibc (Ubuntu Groovy) Assignee: Balint Reczey (rbalint) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Tags removed: block-proposed-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Thx, I'm updating the tags accordingly ... ** Tags removed: verification-needed verification-needed-groovy ** Tags added: verification-done verification-done-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Hello bugproxy, or anyone else affected, Accepted glibc into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.32-0ubuntu3.2 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed- groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification- failed-groovy. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping! N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days. ** Tags removed: verification-done verification-done-groovy ** Tags added: verification-needed verification-needed-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Tags added: block-proposed-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Thx for the verification, I'm adjusting the tags accordingly. ** Tags removed: verification-needed verification-needed-groovy ** Tags added: verification-done verification-done-groovy ** Changed in: ubuntu-z-systems Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Hello bugproxy, or anyone else affected, Accepted glibc into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.32-0ubuntu3.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed- groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification- failed-groovy. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping! N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days. ** Changed in: glibc (Ubuntu Groovy) Status: In Progress => Fix Committed ** Tags added: verification-needed verification-needed-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Changed in: ubuntu-z-systems Status: Triaged => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Changed in: glibc (Ubuntu Groovy) Status: New => In Progress ** Changed in: glibc (Ubuntu Groovy) Assignee: Canonical Foundations Team (canonical-foundations) => Balint Reczey (rbalint) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Ok, just wanted to be sure - this will justify a glibc SRU. (clicking the bug number earlier opened it as LP bug, which is wrong and is usually an indicator for me that it's an internal IBM BZ number - but I've found the glibc upstream BZs now thx ...) I've created a first SRU justification based on upstream info and added it to the bug description above. And I've also marked this bug as 'regression' (add it as tag) and such regressions are usually marked (in LP) as critical as well. ** Tags added: regression ** Changed in: ubuntu-z-systems Importance: High => Critical ** Description changed: + SRU Justification: + + [Impact] + + * The glibc version 2.32 in groovy has some regressions with the + following impact: + + * A regression that got introduced by commit + ffd178c651b827f24acead02284abbb12f3f723b can lead to a crash, because + __shmctl calls shmid_to_shmid64 on the input buffer even when cmd is + IPC_INFO. If SHM_INFO is immediately followed by unmapped memory, + shmid_to_shmid64 will read past its end into unmapped memory and will + crash. + + * Starting with glibc-2.31.9000-687-g3283f71113 (glibc-2.32~83) IPC_INFO + and MSG_INFO commands of __msgctl and __msgctl64 return garbage because + a pointer to an internal buffer on the stack is passed to the kernel. + The buffer specified by the user remains unchanged after IPC_INFO and + MSG_INFO commands. + + * semctl SEM_STAT_ANY fails to pass the buffer specified by the caller + to the kernel. The kernel receives garbage instead of union semun.buf + address specified by the caller. + + [ Fix ] + + * a49d7fd4f764e97ccaf922e433046590ae52fce9 "32-bit shmctl(IPC_INFO) + crashes when shminfo struct is at the end of a memory mapping" + + * 20a00dbefca5695cccaa44846a482db8ccdd85ab "msgctl IPC_INFO and MSG_INFO + return garbage" + + * 574500a108be1d2a6a0dc97a075c9e0a98371aba "semctl SEM_STAT_ANY fails to + pass the buffer specified by the caller to the kernel" + + [ Test Case ] + + Execute test script available upstream (1) here: + https://sourceware.org/bugzilla/show_bug.cgi?id=26636#c0 + + And run the test suite with the newly introduced test-cases that came + with the commits. + + [ Where problems could occur ] + + * glibc modification are usually quite sensitive. + + * Erroneous modifications (1) in the area of IPC and SHM (i.e. IPC_INFO + and MSG_INFO) and it's control may lead to an even bigger impact - and + in worst case the crashes go beyond the case where shminfo is + immediately followed by unmapped memory and could happen always (which + would break the system entirely). + + * Returning (3) or passing over and pointing to wrong buffers (2), or in worst case to other unwanted areas, can cause virtually any unforeseen consequences. + Returning garbage is only one aspect, returning wrong data and even modifying it would be even worse. + + [Other Info] + + * All fixes are upstream accepted and are part of glibc 2.33. + + __ + The current libc6-2.32-0ubuntu3 package lacks some of the upstream glibc commits on the "release/2.32/master" branch (see http://sourceware.org/git/?p=glibc.git;a=shortlog;h=refs/heads/release/2.32/master). Does Ubuntu automatically pick the commits from this release branch? Otherwise, please update to the latest commits on this branch, especially for: - 2dfa659a66 resolv: Handle transaction ID collisions in parallel queries (bug 26600) - 0b9460d22e sysvipc: Fix IPC_INFO and SHM_INFO handling [BZ #26636] - c4aeedea59 sysvipc: Fix IPC_INFO and MSG_INFO handling [BZ #26639] - 9b139b6b81 sysvipc: Fix SEM_STAT_ANY kernel argument pass [BZ #26637] - ... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
--- Comment From s...@de.ibm.com 2020-12-11 10:43 EDT--- It has nothing to do with a performance improvement. It's just broken. Thus your Ubuntu 20.10 has a regression compared to Ubuntu 20.04! The issues were reported via glibc-upstream bugzillas: - "Bug 26636 - 32-bit shmctl(IPC_INFO) crashes when shminfo struct is at the end of a memory mapping ": ... Compile attached test program: gcc -m32 -o ~/tmp/test ~/tmp/test.c It should print something like "max=2147483647". With the above glibc commit, it crashes. ... This causes an rr test failure: https://github.com/mozilla/rr/issues/2681 - "Bug 26639 - msgctl IPC_INFO and MSG_INFO return garbage " Starting with commit glibc-2.31.9000-687-g3283f71113 aka glibc-2.32~83, both IPC_INFO and MSG_INFO commands of msgctl return garbage because their argument of type "struct msginfo" is converted using kmsqid64_to_msqid64. This bug was found by strace test suite. - "Bug 26637 - semctl SEM_STAT_ANY fails to pass the buffer specified by the caller to the kernel" The kernel receives garbage instead of union semun.buf address specified by the caller. ... (As Dimitry has reported this bug on the same day as Bug 26639, I assume he also found it by strace test suite.) The glibc-commits have added new testcaes which are run with "make check" while building the libc6 package. I assume you are monitoring those testfails. ** Bug watch added: github.com/mozilla/rr/issues #2681 https://github.com/mozilla/rr/issues/2681 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Ok, so the following two topics remain: 1) "Fixing unneeded extra conversion of IPC_INFO and SHM_INFO for __IPC_TIME64, since their information does not contain any time related fields." Fixed with: commit "sysvipc: Fix IPC_INFO and SHM_INFO handling [BZ #26636]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=0b9460d22e285432d232f42c7442a3226e1bf830) "Bug 26636 - 32-bit shmctl(IPC_INFO) crashes when shminfo struct is at the end of a memory mapping " (https://sourceware.org/bugzilla/show_bug.cgi?id=26636) and commit "sysvipc: Fix IPC_INFO and MSG_INFO handling [BZ #26639]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=c4aeedea598a1bd80f52ca9ebd07fe447680d491) "Bug 26639 - msgctl IPC_INFO and MSG_INFO return garbage " (https://sourceware.org/bugzilla/show_bug.cgi?id=26639) 2) With SEM_STAT_ANY the buffer argument is not properly passed over (in contrast to just SEM_STAT). Fixed with: commit "sysvipc: Fix SEM_STAT_ANY kernel argument pass [BZ #26637]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=9b139b6b81a5def91bec01f30301acc95fbf0289) "Bug 26637 - semctl SEM_STAT_ANY fails to pass the buffer specified by the caller to the kernel " (https://sourceware.org/bugzilla/show_bug.cgi?id=26637) (skipping resolv) Since the integration of such patches in Ubuntu require that an SRU justification is provided; https://wiki.ubuntu.com/StableReleaseUpdates#SRU_Bug_Template I'm wondering what the real impact is? And if there is a known reproducer available? For 1) is it just performance improvements due to the unneeded conversion or did something broke (particularly on s390x) ? For 2) again is it just an improved performance due to the fact that the buffer was not properly passed over or did the erroneous passing over of the buffer led to errors and broke something? How were these issues identified - due to code analysis or by users that raised bugs? >From the commits I noticed that there are regression test cases mentioned. But I'm not sure if that's sufficient for the needed SRU TestCase section (https://wiki.ubuntu.com/StableReleaseUpdates#SRU_Bug_Template). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
But we don't use nss_resolve from libc6 by default, we use systemd- resolved. Do we need the resolv fixes? (i.e. transaction IDs are handled by resolved) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
--- Comment From s...@de.ibm.com 2020-12-10 10:23 EDT--- The sysvipc related bugs were introduced with glibc 2.32 and are fixed upstream and will be included in upcoming glibc 2.33 release. In addition those commits were also cherry-picked to the release/2.32/master branch. Therefore no updates required for focal. As mentioned earlier, the hirsute libc6 2.32-0ubuntu5 package contains those commits (see debian/patches/git-updates.diff). Only the groovy libc6 2.32-0ubuntu3 package is affected. Those bugs are observable with the strace testsuite or the rr testsuite: commit "sysvipc: Fix IPC_INFO and SHM_INFO handling [BZ #26636]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=0b9460d22e285432d232f42c7442a3226e1bf830) "Bug 26636 - 32-bit shmctl(IPC_INFO) crashes when shminfo struct is at the end of a memory mapping " (https://sourceware.org/bugzilla/show_bug.cgi?id=26636) commit "sysvipc: Fix IPC_INFO and MSG_INFO handling [BZ #26639]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=c4aeedea598a1bd80f52ca9ebd07fe447680d491) "Bug 26639 - msgctl IPC_INFO and MSG_INFO return garbage " (https://sourceware.org/bugzilla/show_bug.cgi?id=26639) commit "sysvipc: Fix SEM_STAT_ANY kernel argument pass [BZ #26637]" (https://sourceware.org/git/?p=glibc.git;a=commit;h=9b139b6b81a5def91bec01f30301acc95fbf0289) "Bug 26637 - semctl SEM_STAT_ANY fails to pass the buffer specified by the caller to the kernel " (https://sourceware.org/bugzilla/show_bug.cgi?id=26637) The DNS lookup can be slow downed as the A and queries times out after 5s before retrying. This is fixed upstream and will be included in upcoming glibc 2.33 release and it is also cherry-picked to the release/2.32/master branch. As mentioned earlier, the hirsute libc6 2.32-0ubuntu5 package contains this commit (see debian/patches/git-updates.diff). commit "resolv: Handle transaction ID collisions in parallel queries (bug 26600)" (https://sourceware.org/git/gitweb.cgi?p=glibc.git;h=2dfa659a66f20facc4082207884c20e986ddecee) "Bug 26600 - Transaction ID collisions cause slow DNS lookups in getaddrinfo" (https://sourceware.org/bugzilla/show_bug.cgi?id=26600) "Bug 1868106 - glibc: Transaction ID collisions cause slow DNS lookups in getaddrinfo" (https://bugzilla.redhat.com/show_bug.cgi?id=1868106) ** Bug watch added: Sourceware.org Bugzilla #26636 https://sourceware.org/bugzilla/show_bug.cgi?id=26636 ** Bug watch added: Sourceware.org Bugzilla #26639 https://sourceware.org/bugzilla/show_bug.cgi?id=26639 ** Bug watch added: Sourceware.org Bugzilla #26637 https://sourceware.org/bugzilla/show_bug.cgi?id=26637 ** Bug watch added: Sourceware.org Bugzilla #26600 https://sourceware.org/bugzilla/show_bug.cgi?id=26600 ** Bug watch added: Red Hat Bugzilla #1868106 https://bugzilla.redhat.com/show_bug.cgi?id=1868106 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
Regarding the original question we don't automatically follow the release branches in stable releases especially not in interim releases which have only 9 months of support. I'm collecting patches for an upcoming SRU for Focal and Groovy, and the patches listed here can be included as well, but to go through the SRU process this bug needs more information. Could you please fill out the SRU template for the fixes? https://wiki.ubuntu.com/StableReleaseUpdates ** Changed in: glibc (Ubuntu Hirsute) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1904419] Re: Upgrade glibc 2.32 by required upstream patches
** Summary changed: - Ugrade glibc 2.32 by required upstream patches + Upgrade glibc 2.32 by required upstream patches -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1904419 Title: Upgrade glibc 2.32 by required upstream patches To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1904419/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
