[Touch-packages] [Bug 1945205] Re: [FFe] Add zstd support
** Changed in: python-debian (Ubuntu) Status: Confirmed => Fix Released -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to python-debian in Ubuntu. https://bugs.launchpad.net/bugs/1945205 Title: [FFe] Add zstd support Status in python-debian package in Ubuntu: Fix Released Bug description: [Feature Freeze Exception] Now that dpkg-deb defaults to compressing with zstd, python-debian can no longer decompress the compressed data into the binary package archive [1]. The proposed change, created as an MP at [2], introduces zstd support to python-debian 0.1.39 by adding a dependency to zstd to the package and by extending the python-debian xz support for python < 3.3, where xz was still not supported by tarfile, to also support the zstd compression. It is also important to note that, for python-debian 0.1.40, the relevant (here patched) code was re-worked (python < 3.3 support was dropped) and this proposed patch, along with the relevant proposed unit test, will need to be re-written. This re-writing effort is already an ongoing work proposed upstream in [3]. Once [3] is merged, this patch can be dropped and python-debian can be sync'd from upstream again. If there is a need to merge python-debian before [3] is accepted and released upstream, the next version of python-debian will need to drop the proposed patch and apply [3] instead, for the reasons listed above. While python-debian is not completely broken without this FFe patch, some of its features will not work properly on Ubuntu packages now they are compressed with zstd. For instance, any packages or scripts that try to use python-debian for extracting data from deb packages will no longer work. Namely, dh-cmake FTBFS when trying to decompress a deb package during its unit test run step [4]. A PPA with the proposed fix is available at [5], along with the build logs. I ran the dep8 test suite locally with the following results: autopkgtest [20:04:02]: summary python3-debian PASS I am also attaching the logs for installation, removal and upgrades of the patched package. [1] https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1923845 [2] https://code.launchpad.net/~athos-ribeiro/ubuntu/+source/python-debian/+git/python-debian/+merge/407413 [3] https://salsa.debian.org/python-debian-team/python-debian/-/merge_requests/65 [4] https://launchpadlibrarian.net/552708462/buildlog_ubuntu-impish-amd64.dh-cmake_0.6.1_BUILDING.txt.gz [5] https://launchpad.net/~athos-ribeiro/+archive/ubuntu/lp-1923845-python-debian/+packages To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1945205/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1945205] Re: [FFe] Add zstd support
As an effort to verify this is not triggered by this upload, I was able to reproduce the failure locally with $ autopkgtest-buildvm-ubuntu-cloud -r impish -v $ autopkgtest autopkgtest -U -- qemu ./autopkgtest-impish-amd64.img and $ autopkgtest autopkgtest -U --apt-pocket=proposed -- qemu ./autopkgtest-impish-amd64.img Output is attached.?field.comment=As an effort to verify this is not triggered by this upload, I was able to reproduce the failure locally with $ autopkgtest-buildvm-ubuntu-cloud -r impish -v $ autopkgtest autopkgtest -U -- qemu ./autopkgtest-impish-amd64.img and $ autopkgtest autopkgtest -U --apt-pocket=proposed -- qemu ./autopkgtest-impish-amd64.img Output is attached. ** Attachment added: "autopktest.log" https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1945205/+attachment/5529155/+files/autopktest.log -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to python-debian in Ubuntu. https://bugs.launchpad.net/bugs/1945205 Title: [FFe] Add zstd support Status in python-debian package in Ubuntu: Confirmed Bug description: [Feature Freeze Exception] Now that dpkg-deb defaults to compressing with zstd, python-debian can no longer decompress the compressed data into the binary package archive [1]. The proposed change, created as an MP at [2], introduces zstd support to python-debian 0.1.39 by adding a dependency to zstd to the package and by extending the python-debian xz support for python < 3.3, where xz was still not supported by tarfile, to also support the zstd compression. It is also important to note that, for python-debian 0.1.40, the relevant (here patched) code was re-worked (python < 3.3 support was dropped) and this proposed patch, along with the relevant proposed unit test, will need to be re-written. This re-writing effort is already an ongoing work proposed upstream in [3]. Once [3] is merged, this patch can be dropped and python-debian can be sync'd from upstream again. If there is a need to merge python-debian before [3] is accepted and released upstream, the next version of python-debian will need to drop the proposed patch and apply [3] instead, for the reasons listed above. While python-debian is not completely broken without this FFe patch, some of its features will not work properly on Ubuntu packages now they are compressed with zstd. For instance, any packages or scripts that try to use python-debian for extracting data from deb packages will no longer work. Namely, dh-cmake FTBFS when trying to decompress a deb package during its unit test run step [4]. A PPA with the proposed fix is available at [5], along with the build logs. I ran the dep8 test suite locally with the following results: autopkgtest [20:04:02]: summary python3-debian PASS I am also attaching the logs for installation, removal and upgrades of the patched package. [1] https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1923845 [2] https://code.launchpad.net/~athos-ribeiro/ubuntu/+source/python-debian/+git/python-debian/+merge/407413 [3] https://salsa.debian.org/python-debian-team/python-debian/-/merge_requests/65 [4] https://launchpadlibrarian.net/552708462/buildlog_ubuntu-impish-amd64.dh-cmake_0.6.1_BUILDING.txt.gz [5] https://launchpad.net/~athos-ribeiro/+archive/ubuntu/lp-1923845-python-debian/+packages To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1945205/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1945205] Re: [FFe] Add zstd support
Held back in proposed migration: https://autopkgtest.ubuntu.com/results/autopkgtest-impish/impish/amd64/a/autopkgtest/20210929_062309_c71f0@/log.gz That test fail can't be reproduced in local autopkgtest (LXD init is different in the autopkgtest infra compared to a "normal" cloudimage) nor does it seem to be triggered by this upload. Most likely a regression-in-release due to image/lxd changes but one will have to do the homework to verify and then fix or test-hint this. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to python-debian in Ubuntu. https://bugs.launchpad.net/bugs/1945205 Title: [FFe] Add zstd support Status in python-debian package in Ubuntu: Confirmed Bug description: [Feature Freeze Exception] Now that dpkg-deb defaults to compressing with zstd, python-debian can no longer decompress the compressed data into the binary package archive [1]. The proposed change, created as an MP at [2], introduces zstd support to python-debian 0.1.39 by adding a dependency to zstd to the package and by extending the python-debian xz support for python < 3.3, where xz was still not supported by tarfile, to also support the zstd compression. It is also important to note that, for python-debian 0.1.40, the relevant (here patched) code was re-worked (python < 3.3 support was dropped) and this proposed patch, along with the relevant proposed unit test, will need to be re-written. This re-writing effort is already an ongoing work proposed upstream in [3]. Once [3] is merged, this patch can be dropped and python-debian can be sync'd from upstream again. If there is a need to merge python-debian before [3] is accepted and released upstream, the next version of python-debian will need to drop the proposed patch and apply [3] instead, for the reasons listed above. While python-debian is not completely broken without this FFe patch, some of its features will not work properly on Ubuntu packages now they are compressed with zstd. For instance, any packages or scripts that try to use python-debian for extracting data from deb packages will no longer work. Namely, dh-cmake FTBFS when trying to decompress a deb package during its unit test run step [4]. A PPA with the proposed fix is available at [5], along with the build logs. I ran the dep8 test suite locally with the following results: autopkgtest [20:04:02]: summary python3-debian PASS I am also attaching the logs for installation, removal and upgrades of the patched package. [1] https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1923845 [2] https://code.launchpad.net/~athos-ribeiro/ubuntu/+source/python-debian/+git/python-debian/+merge/407413 [3] https://salsa.debian.org/python-debian-team/python-debian/-/merge_requests/65 [4] https://launchpadlibrarian.net/552708462/buildlog_ubuntu-impish-amd64.dh-cmake_0.6.1_BUILDING.txt.gz [5] https://launchpad.net/~athos-ribeiro/+archive/ubuntu/lp-1923845-python-debian/+packages To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1945205/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1945205] Re: [FFe] Add zstd support
>From my perspective, this is a bugfix, not a new feature, since it's required to maintain compatibility with current .deb packages as shipped in the corresponding Ubuntu release. ** Changed in: python-debian (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to python-debian in Ubuntu. https://bugs.launchpad.net/bugs/1945205 Title: [FFe] Add zstd support Status in python-debian package in Ubuntu: Confirmed Bug description: [Feature Freeze Exception] Now that dpkg-deb defaults to compressing with zstd, python-debian can no longer decompress the compressed data into the binary package archive [1]. The proposed change, created as an MP at [2], introduces zstd support to python-debian 0.1.39 by adding a dependency to zstd to the package and by extending the python-debian xz support for python < 3.3, where xz was still not supported by tarfile, to also support the zstd compression. It is also important to note that, for python-debian 0.1.40, the relevant (here patched) code was re-worked (python < 3.3 support was dropped) and this proposed patch, along with the relevant proposed unit test, will need to be re-written. This re-writing effort is already an ongoing work proposed upstream in [3]. Once [3] is merged, this patch can be dropped and python-debian can be sync'd from upstream again. If there is a need to merge python-debian before [3] is accepted and released upstream, the next version of python-debian will need to drop the proposed patch and apply [3] instead, for the reasons listed above. While python-debian is not completely broken without this FFe patch, some of its features will not work properly on Ubuntu packages now they are compressed with zstd. For instance, any packages or scripts that try to use python-debian for extracting data from deb packages will no longer work. Namely, dh-cmake FTBFS when trying to decompress a deb package during its unit test run step [4]. A PPA with the proposed fix is available at [5], along with the build logs. I ran the dep8 test suite locally with the following results: autopkgtest [20:04:02]: summary python3-debian PASS I am also attaching the logs for installation, removal and upgrades of the patched package. [1] https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1923845 [2] https://code.launchpad.net/~athos-ribeiro/ubuntu/+source/python-debian/+git/python-debian/+merge/407413 [3] https://salsa.debian.org/python-debian-team/python-debian/-/merge_requests/65 [4] https://launchpadlibrarian.net/552708462/buildlog_ubuntu-impish-amd64.dh-cmake_0.6.1_BUILDING.txt.gz [5] https://launchpad.net/~athos-ribeiro/+archive/ubuntu/lp-1923845-python-debian/+packages To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/python-debian/+bug/1945205/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp