Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Le 23/10/2021 à 22:02, Dimitri John Ledkov a écrit : > > > On Sat, 23 Oct 2021, 19:49 Sylvestre Ledru, wrote: > > Hello > > Le 20/10/2021 à 18:05, Dimitri John Ledkov a écrit : >> Hi, >> >> I've tried to reproduce this more > Thanks, I appreciate it! >> and I have a few questions: >> >> 1) what is the version of debootstrap ? > 1.0.123 (bullseye & sid) > > > > Impish support is only available in experimental at the moment in the > 1.0.124. can you please try that? oh, thanks :) It fixed the issue indeed! Thanks again S
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
On Sat, 23 Oct 2021, 19:49 Sylvestre Ledru, wrote: > Hello > Le 20/10/2021 à 18:05, Dimitri John Ledkov a écrit : > > Hi, > > I've tried to reproduce this more > > Thanks, I appreciate it! > > and I have a few questions: > > 1) what is the version of debootstrap ? > > 1.0.123 (bullseye & sid) > Impish support is only available in experimental at the moment in the 1.0.124. can you please try that? I need to add jammy and upload it to unstable sooner rather than later. Given that archive is unfrozen now. > 2) do any config files divert as to which debootstrap's `functions` > file is used ? > > > https://github.com/opencollab/llvm-jenkins.debian.net/blob/master/pbuilderrc > > A few hooks but nothing relevant I think: > > > https://github.com/opencollab/llvm-jenkins.debian.net/tree/master/pbuilder-hookdir > > 3) what settings do you have in /tmp/configfile ? > > Nothing relevant I think: > > # pbuilder config file generated by jenkins-debian-glue on Mon Oct 11 > 21:54:58 UTC 2021 > CCACHEDIR="/var/cache/pbuilder/ccache" > # Building for Ubuntu detected, enabling universe repository component to > work around cowdancer issue: > COMPONENTS="main universe" > > I'm trying to eliminate a case where new scripts/impish is used that > sets AR extractor, and yet old functions file is used which doesn't > know how to zstdcat in the AR extractor. > > ie. > ``` > $ grep zstdcat /usr/share/debootstrap/functions > control.tar.zst) cat_cmd=zstdcat ;; > data.tar.zst) cat_cmd=zstdcat ;; > ``` > I'm not sure what in your case is listed in /tmp/configfile. I assume > that one thing is pointer to the custom mirror. > > Thanks for the infos! > > The full log is available here: > > > https://llvm-jenkins.debian.net/view/Ubuntu%20Impish/job/llvm-toolchain-impish-12-binaries/architecture=amd64,distribution=impish,label=amd64/5/console > > or > > > https://llvm-jenkins.debian.net/view/Ubuntu%20Impish/job/llvm-toolchain-impish-13-binaries/architecture=amd64,distribution=impish,label=amd64/10/ > > Please let me know if there is anything I can do to test :) > > Cheers, > > Sylvestre > > >
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Hello Le 20/10/2021 à 18:05, Dimitri John Ledkov a écrit : > Hi, > > I've tried to reproduce this more Thanks, I appreciate it! > and I have a few questions: > > 1) what is the version of debootstrap ? 1.0.123 (bullseye & sid) > 2) do any config files divert as to which debootstrap's `functions` > file is used ? https://github.com/opencollab/llvm-jenkins.debian.net/blob/master/pbuilderrc A few hooks but nothing relevant I think: https://github.com/opencollab/llvm-jenkins.debian.net/tree/master/pbuilder-hookdir > 3) what settings do you have in /tmp/configfile ? Nothing relevant I think: # pbuilder config file generated by jenkins-debian-glue on Mon Oct 11 21:54:58 UTC 2021 CCACHEDIR="/var/cache/pbuilder/ccache" # Building for Ubuntu detected, enabling universe repository component to work around cowdancer issue: COMPONENTS="main universe" > > I'm trying to eliminate a case where new scripts/impish is used that > sets AR extractor, and yet old functions file is used which doesn't > know how to zstdcat in the AR extractor. > > ie. > ``` > $ grep zstdcat /usr/share/debootstrap/functions > control.tar.zst) cat_cmd=zstdcat ;; > data.tar.zst) cat_cmd=zstdcat ;; > ``` > I'm not sure what in your case is listed in /tmp/configfile. I assume > that one thing is pointer to the custom mirror. Thanks for the infos! The full log is available here: https://llvm-jenkins.debian.net/view/Ubuntu%20Impish/job/llvm-toolchain-impish-12-binaries/architecture=amd64,distribution=impish,label=amd64/5/console or https://llvm-jenkins.debian.net/view/Ubuntu%20Impish/job/llvm-toolchain-impish-13-binaries/architecture=amd64,distribution=impish,label=amd64/10/ Please let me know if there is anything I can do to test :) Cheers, Sylvestre
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Hi, I've tried to reproduce this more and I have a few questions: 1) what is the version of debootstrap ? 2) do any config files divert as to which debootstrap's `functions` file is used ? 3) what settings do you have in /tmp/configfile ? I'm trying to eliminate a case where new scripts/impish is used that sets AR extractor, and yet old functions file is used which doesn't know how to zstdcat in the AR extractor. ie. ``` $ grep zstdcat /usr/share/debootstrap/functions control.tar.zst) cat_cmd=zstdcat ;; data.tar.zst) cat_cmd=zstdcat ;; ``` I'm not sure what in your case is listed in /tmp/configfile. I assume that one thing is pointer to the custom mirror. I launched Debian sid, enabled experimental, installed debootstrap from experimental, install cowbuilder and all the jenkins-debian-glue stuff. I did echo custom mirror of http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive into /tmp/configfile. Cause that looked like the only custom thing. Not sure if there are anything else set there. and Things mostly progressed fine for me: # DIST=$d ARCH=$a cowbuilder --create --basepath /var/cache/pbuilder/base-$d-$a.cow --distribution $d --debootstrap debootstrap --architecture $a --debootstrapopts --arch --debootstrapopts amd64 --debootstrapopts --variant=buildd --configfile=/tmp/configfile --hookdir /usr/share/jenkins-debian-glue/pbuilder-hookdir/ I: Invoking pbuilder I: forking: pbuilder create --debootstrap debootstrap --debootstrapopts --arch --debootstrapopts amd64 --debootstrapopts --variant=buildd --configfile /tmp/configfile --hookdir /usr/share/jenkins-debian-glue/pbuilder-hookdir/ --buildplace /var/cache/pbuilder/base-impish-amd64.cow --mirror http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ --architecture amd64 --distribution impish --no-targz --extrapackages cowdancer W: /root/.pbuilderrc does not exist I: Running in no-targz mode I: Distribution is impish. I: Current time: Wed Oct 20 15:07:00 UTC 2021 I: pbuilder-time-stamp: 1634742420 I: Building the build environment I: running debootstrap /usr/bin/which: this version of `which' is deprecated; use `command -v' in scripts instead. /usr/sbin/debootstrap I: Target architecture can be executed I: impish uses zstd compression, setting --extractor=ar option I: Retrieving InRelease I: Checking Release signature I: Valid Release signature (key id F6ECB3762474EDA9D21B7022871920D1991BC93C) I: Retrieving Packages I: Validating Packages I: Resolving dependencies of required packages... I: Resolving dependencies of base packages... I: Checking component main on http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive... ... I: Retrieving zlib1g 1:1.2.11.dfsg-2ubuntu7 I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 I: Chosen extractor for .deb packages: ar I: Extracting base-files... I: Extracting base-passwd... I: Installing core packages... I: Unpacking required packages... I: Unpacking base-files... I: Unpacking base-passwd... ... I: Configuring required packages... I: Configuring gcc-11-base:amd64... I: Configuring lsb-base... I: Configuring libtirpc-common.. ... Eventually it failed for me with: Package cowdancer is not available, but is referred to by another package. This may mean that the package is missing, has been obsoleted, or is only available from another source E: Package 'cowdancer' has no installation candidate E: Package 'aptitude' has no installation candidate I: unmounting dev/pts filesystem I: unmounting dev/shm filesystem I: unmounting proc filesystem I: unmounting sys filesystem E: pbuilder create failed I: forking: rm -rf /var/cache/pbuilder/base-impish-amd64.cow But that seems like further along than what you have. It is possible that I didn't enable universe, cause aptitude is available in Ubuntu. On Sat, 16 Oct 2021 at 10:05, Sylvestre Ledru wrote: > > Hello Dimitri, > > Any idea how to fix that? I cannot generate packages for > https://apt.llvm.org/ for impish from a Debian. > > thanks > Sylvestre > > Le 11/10/2021 à 18:08, Sylvestre Ledru a écrit : > > Hello > > > > > > Le 10/10/2021 à 12:41, Sylvestre Ledru a écrit : > >> Package: debootstrap > >> Version: 1.0.124 > >> Severity: normal > >> > >> Dear Maintainer, > >> > >> $ sudo debootstrap impish impish > >> https://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ > >> I: impish uses zstd compression, setting --extractor=ar option > >> I: Retrieving InRelease > >> I: Retrieving Packages > >> I: Validating Packages > >> [...] > >> I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 > >> I: Chosen extractor for .deb packages: ar > >> I: Extracting base-files... > >> I: Extracting base-passwd... > >> E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb > >> requires the zstdcat command, which is not available > > > >> One needs to install zstd on the host, including zstd in the > > debootstrap,set will not help.,,Does $ sudo apt install zstd => fix the > > issue for you? > > > > Yeah, it fixed my test case but my
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Hello Dimitri, Any idea how to fix that? I cannot generate packages for https://apt.llvm.org/ for impish from a Debian. thanks Sylvestre Le 11/10/2021 à 18:08, Sylvestre Ledru a écrit : > Hello > > > Le 10/10/2021 à 12:41, Sylvestre Ledru a écrit : >> Package: debootstrap >> Version: 1.0.124 >> Severity: normal >> >> Dear Maintainer, >> >> $ sudo debootstrap impish impish >> https://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ >> I: impish uses zstd compression, setting --extractor=ar option >> I: Retrieving InRelease >> I: Retrieving Packages >> I: Validating Packages >> [...] >> I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 >> I: Chosen extractor for .deb packages: ar >> I: Extracting base-files... >> I: Extracting base-passwd... >> E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb >> requires the zstdcat command, which is not available > >> One needs to install zstd on the host, including zstd in the > debootstrap,set will not help.,,Does $ sudo apt install zstd => fix the > issue for you? > > Yeah, it fixed my test case but my actual problem was: > > $ export d=impish > $ export a=amd64 > $ sudo DIST=$d ARCH=$a cowbuilder --create --basepath > /var/cache/pbuilder/base-$d-$a.cow --distribution $d --debootstrap > debootstrap --architecture $a --debootstrapopts --arch --debootstrapopts > amd64 --debootstrapopts --variant=buildd --configfile=/tmp/configfile > --hookdir /usr/share/jenkins-debian-glue/pbuilder-hookdir/ > I: Invoking pbuilder > I: forking: pbuilder create --debootstrap debootstrap --debootstrapopts > --arch --debootstrapopts amd64 --debootstrapopts --variant=buildd > --configfile /tmp/configfile --hookdir > /usr/share/jenkins-debian-glue/pbuilder-hookdir/ --buildplace > /var/cache/pbuilder/base-impish-amd64.cow --mirror > http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ > --architecture amd64 --distribution impish --no-targz --extrapackages ' > ccache zstd cowdancer' > I: Running in no-targz mode > I: Distribution is impish. > I: Current time: Mon Oct 11 16:01:34 UTC 2021 > I: pbuilder-time-stamp: 1633968094 > I: Building the build environment > I: running debootstrap > /usr/sbin/debootstrap > I: impish uses zstd compression, setting --extractor=ar option > I: Retrieving InRelease > I: Retrieving Packages > I: Validating Packages > I: Resolving dependencies of required packages... > I: Resolving dependencies of base packages... > I: Checking component main on > http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive... > I: Validating adduser 3.118ubuntu5 > [...] > I: Validating util-linux 2.36.1-8ubuntu1 > I: Validating xz-utils 5.2.5-2 > I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 > I: Chosen extractor for .deb packages: ar > I: Extracting base-files... > E: Unknown compression type for data.tar.zst in > .//var/cache/apt/archives/base-files_11.1ubuntu5_amd64.deb > E: debootstrap failed > E: Tail of debootstrap.log: > 2021-10-11 16:01:35 > URL:http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/dists/impish/InRelease > [270090/270090] -> > "/var/cache/pbuilder/base-impish-amd64.cow/var/lib/apt/lists/partial/www-ftp.lip6.fr_pub_linux_distributions__Ubuntu_archive_dists_impish_InRelease" > [1] > 2021-10-11 16:01:36 > URL:http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/dists/impish/main/binary-amd64/by-hash/SHA256/5f55112843e1755f687849f2f61645c3428d00cc103b646b696cd5ed4ae7d3cc > [1417328/1417328] -> > "/var/cache/pbuilder/base-impish-amd64.cow/var/lib/apt/lists/partial/www-ftp.lip6.fr_pub_linux_distributions__Ubuntu_archive_dists_impish_main_binary-amd64_Packages.xz" > [1] > E: End of debootstrap.log > W: Aborting with an error > E: pbuilder create failed > I: forking: rm -rf /var/cache/pbuilder/base-impish-amd64.cow > > And the system has zstd: > > $ dpkg -l|grep zstd > ii libzstd1:amd64 1.4.8+dfsg-2.1 > amd64 fast lossless compression algorithm > ii zstd 1.4.8+dfsg-2.1 > amd64 fast lossless compression algorithm -- CLI tool >
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Hello Le 10/10/2021 à 12:41, Sylvestre Ledru a écrit : > Package: debootstrap > Version: 1.0.124 > Severity: normal > > Dear Maintainer, > > $ sudo debootstrap impish impish > https://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ > I: impish uses zstd compression, setting --extractor=ar option > I: Retrieving InRelease > I: Retrieving Packages > I: Validating Packages > [...] > I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 > I: Chosen extractor for .deb packages: ar > I: Extracting base-files... > I: Extracting base-passwd... > E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb requires > the zstdcat command, which is not available > One needs to install zstd on the host, including zstd in the debootstrap,set will not help.,,Does $ sudo apt install zstd => fix the issue for you? Yeah, it fixed my test case but my actual problem was: $ export d=impish $ export a=amd64 $ sudo DIST=$d ARCH=$a cowbuilder --create --basepath /var/cache/pbuilder/base-$d-$a.cow --distribution $d --debootstrap debootstrap --architecture $a --debootstrapopts --arch --debootstrapopts amd64 --debootstrapopts --variant=buildd --configfile=/tmp/configfile --hookdir /usr/share/jenkins-debian-glue/pbuilder-hookdir/ I: Invoking pbuilder I: forking: pbuilder create --debootstrap debootstrap --debootstrapopts --arch --debootstrapopts amd64 --debootstrapopts --variant=buildd --configfile /tmp/configfile --hookdir /usr/share/jenkins-debian-glue/pbuilder-hookdir/ --buildplace /var/cache/pbuilder/base-impish-amd64.cow --mirror http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ --architecture amd64 --distribution impish --no-targz --extrapackages ' ccache zstd cowdancer' I: Running in no-targz mode I: Distribution is impish. I: Current time: Mon Oct 11 16:01:34 UTC 2021 I: pbuilder-time-stamp: 1633968094 I: Building the build environment I: running debootstrap /usr/sbin/debootstrap I: impish uses zstd compression, setting --extractor=ar option I: Retrieving InRelease I: Retrieving Packages I: Validating Packages I: Resolving dependencies of required packages... I: Resolving dependencies of base packages... I: Checking component main on http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive... I: Validating adduser 3.118ubuntu5 [...] I: Validating util-linux 2.36.1-8ubuntu1 I: Validating xz-utils 5.2.5-2 I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 I: Chosen extractor for .deb packages: ar I: Extracting base-files... E: Unknown compression type for data.tar.zst in .//var/cache/apt/archives/base-files_11.1ubuntu5_amd64.deb E: debootstrap failed E: Tail of debootstrap.log: 2021-10-11 16:01:35 URL:http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/dists/impish/InRelease [270090/270090] -> "/var/cache/pbuilder/base-impish-amd64.cow/var/lib/apt/lists/partial/www-ftp.lip6.fr_pub_linux_distributions__Ubuntu_archive_dists_impish_InRelease" [1] 2021-10-11 16:01:36 URL:http://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/dists/impish/main/binary-amd64/by-hash/SHA256/5f55112843e1755f687849f2f61645c3428d00cc103b646b696cd5ed4ae7d3cc [1417328/1417328] -> "/var/cache/pbuilder/base-impish-amd64.cow/var/lib/apt/lists/partial/www-ftp.lip6.fr_pub_linux_distributions__Ubuntu_archive_dists_impish_main_binary-amd64_Packages.xz" [1] E: End of debootstrap.log W: Aborting with an error E: pbuilder create failed I: forking: rm -rf /var/cache/pbuilder/base-impish-amd64.cow And the system has zstd: $ dpkg -l|grep zstd ii libzstd1:amd64 1.4.8+dfsg-2.1 amd64 fast lossless compression algorithm ii zstd 1.4.8+dfsg-2.1 amd64 fast lossless compression algorithm -- CLI tool
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
On Sun, 10 Oct 2021 12:41:45 +0200 Sylvestre Ledru wrote: > Package: debootstrap > Version: 1.0.124 > Severity: normal > > Dear Maintainer, > > $ sudo debootstrap impish impish https://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ > I: impish uses zstd compression, setting --extractor=ar option > I: Retrieving InRelease > I: Retrieving Packages > I: Validating Packages > [...] > I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 > I: Chosen extractor for .deb packages: ar > I: Extracting base-files... > I: Extracting base-passwd... > E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb requires the zstdcat command, which is not available > > adding --include=zstd doesn't fix the issue One needs to install zstd on the host, including zstd in the debootstrap set will not help. Does $ sudo apt install zstd => fix the issue for you? > [...] > I: Retrieving zstd 1.4.8+dfsg-2.1 > I: Validating zstd 1.4.8+dfsg-2.1 > I: Chosen extractor for .deb packages: ar > I: Extracting base-files... > I: Extracting base-passwd... > E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb requires the zstdcat command, which is not available > > Thanks, > Sylvestre > > -- System Information: > Debian Release: bookworm/sid > APT prefers unstable > APT policy: (600, 'unstable'), (500, 'oldstable-updates'), (500, 'oldoldstable'), (500, 'stable'), (500, 'oldstable'), (300, 'experimental') > Architecture: amd64 (x86_64) > > Kernel: Linux 5.10.0-8-amd64 (SMP w/8 CPU threads) > Kernel taint flags: TAINT_WARN, TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE > Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE not set > Shell: /bin/sh linked to /usr/bin/dash > Init: systemd (via /run/systemd/system) > LSM: AppArmor: enabled > > Versions of packages debootstrap depends on: > ii wget 1.21-1+b1 > > Versions of packages debootstrap recommends: > pn arch-test > ii debian-archive-keyring 2021.1.1 > ii gnupg 2.2.27-2 > > Versions of packages debootstrap suggests: > ii binutils2.37-7 > pn squid-deb-proxy-client > pn ubuntu-archive-keyring > ii xz-utils5.2.5-2 > pn zstd > > -- no debconf information >
Bug#996019: debootstrap: bootstrap of ubuntu impish is failing
Package: debootstrap Version: 1.0.124 Severity: normal Dear Maintainer, $ sudo debootstrap impish impish https://www-ftp.lip6.fr/pub/linux/distributions//Ubuntu/archive/ I: impish uses zstd compression, setting --extractor=ar option I: Retrieving InRelease I: Retrieving Packages I: Validating Packages [...] I: Validating zlib1g 1:1.2.11.dfsg-2ubuntu7 I: Chosen extractor for .deb packages: ar I: Extracting base-files... I: Extracting base-passwd... E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb requires the zstdcat command, which is not available adding --include=zstd doesn't fix the issue [...] I: Retrieving zstd 1.4.8+dfsg-2.1 I: Validating zstd 1.4.8+dfsg-2.1 I: Chosen extractor for .deb packages: ar I: Extracting base-files... I: Extracting base-passwd... E: Extracting .//var/cache/apt/archives/base-passwd_3.5.51_amd64.deb requires the zstdcat command, which is not available Thanks, Sylvestre -- System Information: Debian Release: bookworm/sid APT prefers unstable APT policy: (600, 'unstable'), (500, 'oldstable-updates'), (500, 'oldoldstable'), (500, 'stable'), (500, 'oldstable'), (300, 'experimental') Architecture: amd64 (x86_64) Kernel: Linux 5.10.0-8-amd64 (SMP w/8 CPU threads) Kernel taint flags: TAINT_WARN, TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE not set Shell: /bin/sh linked to /usr/bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages debootstrap depends on: ii wget 1.21-1+b1 Versions of packages debootstrap recommends: pn arch-test ii debian-archive-keyring 2021.1.1 ii gnupg 2.2.27-2 Versions of packages debootstrap suggests: ii binutils2.37-7 pn squid-deb-proxy-client pn ubuntu-archive-keyring ii xz-utils5.2.5-2 pn zstd -- no debconf information
