Package: dgit-infrastructure Version: 13.13 Severity: wishlist Package build jobs seem to take a minute each. This seemed extraordinarily long, so I investigated: I caused a run where I tail -1000f w0/dgit-tmp/t2u.log | ts | tee ~/ts on the oracle machine. See below.
Notable points: * Each invocation of a command on the build host, via ssh and the print-execute-command, seems to take ~3s. * In this particular run it lost between 78 and 99 seconds to the policy db lock on gideon; that's probably #1095193. * The tarballs upload with dput over anonftp took 1s per file, for a total of 5s, which is quite extraordinary given they're five small files totalling <35K. * Processing steps that don't involve networking seem fast enough. I think maybe the rootless container networking is somehow terrible, with an especially large per-connection delay. Not sure we can do anything, and I'm also not sure this is a priority, but I thought I would share my log and write up my observations/speculations. Ian. Sep 02 14:37:25 oracle$ dgit --version Sep 02 14:37:25 dgit version git:d1f08aa0531e93c7c01b9caa16b95941447984fe Sep 02 14:37:25 # builder: oracle$ ./ssh-builder '[email protected]' ... Sep 02 14:37:25 builder$ dgit --version Sep 02 14:37:28 dgit version 13.13 Sep 02 14:37:35 Sep 02 14:37:35 builder:work$ git fetch origin --no-tags refs/tags/debian/1.137:refs/tags/debian/1.137 Sep 02 14:37:37 From https://salsa.debian.org/dgit-team/dgit-test-dummy Sep 02 14:37:37 * [new tag] debian/1.137 -> debian/1.137 Sep 02 14:37:37 # [ok] Sep 02 14:37:41 Sep 02 14:37:41 builder:work$ git checkout -q refs/tags/debian/1.137 Sep 02 14:37:44 # [ok] Sep 02 14:37:44 # source code fetched Sep 02 14:37:46 # changelog parsed ok Sep 02 14:37:46 # target: debian experimental Sep 02 14:37:46 # no upstream tag/commit specified, not considering orig(s) Sep 02 14:37:46 Sep 02 14:37:46 oracle$ dgit -wn -pdgit-test-dummy --build-products-dir=../bpd --force-uploading-source-only --ssh=./ssh-builder --dgit=dgit -k374D8CE4DB96E9CBD4C0972A606D084E4683C079 --dput:-u --package=dgit-test-dummy --expect-suite=experimental --expect-version=1.137 --tag2upload-builder-mode --split-view=always --new --trust-changelog '--t2u-control-add=Git-Tag-Tagger=Ian Jackson <[email protected]>' '--t2u-control-add=Git-Tag-Info=tag=465fe7c03ea23dab9f748a19052add430299fc81 fp=559ae46c2d6b6d3265e7cba1e3e3392348b50d39' rpush-source '[email protected]:/tmp/autopkgtest-virt-docker.shared.u9jego2t/downtmp/work' Sep 02 14:37:46 Sep 02 14:37:48 canonical suite name for experimental is rc-buggy Sep 02 14:37:49 dpkg-source: warning: short option not allowed in work/debian/source/options, line 1 Sep 02 14:37:49 dpkg-source: warning: no source format specified in debian/source/format, see dpkg-source(1) Sep 02 14:37:49 dpkg-source: warning: --include-removal is not a valid option for Dpkg::Source::Package::V1 Sep 02 14:37:49 dpkg-source: warning: --no-preparation is not a valid option for Dpkg::Source::Package::V1 Sep 02 14:37:49 dpkg-source: warning: source directory 'work' is not <sourcepackage>-<upstreamversion> 'dgit-test-dummy-1.137' Sep 02 14:37:49 dpkg-source: info: using source format '1.0' Sep 02 14:37:49 dpkg-source: info: building dgit-test-dummy in dgit-test-dummy_1.137.tar.gz Sep 02 14:37:49 dpkg-source: info: building dgit-test-dummy in dgit-test-dummy_1.137.dsc Sep 02 14:37:49 changelog will contain changes since 1.135 Sep 02 14:37:49 >> Copying debian/1.137 to depth 1 Sep 02 14:37:49 From file:///tmp/autopkgtest-virt-docker.shared.u9jego2t/downtmp/work/.git/dgit/unpack/work Sep 02 14:37:49 * [new tag] debian/1.137 -> debian/1.137 Sep 02 14:37:49 >> Re-packing ... packed 0 objects not required for --audit Sep 02 14:37:49 >> Starting compression ... done Sep 02 14:37:49 >> Appending 'dgit-test-dummy_1.137.git.tar.xz misc extra' to debian/files Sep 02 14:37:49 dpkg-genchanges: warning: package dgit-test-dummy in control file but not in files list Sep 02 14:37:49 dpkg-genchanges: info: including full source code in upload Sep 02 14:37:57 last upload to archive: specified git info (debian) Sep 02 14:37:57 Sep 02 14:37:57 Git commit in archive is behind the last version allegedly pushed/uploaded. Sep 02 14:37:57 Commit referred to by archive: 9168771f0369d7722b6ae7c8bfd55bd14f604cfe Sep 02 14:37:57 Last version pushed with dgit: bcf2eae6098478c6c153c0342b0644a7ba1a4293 Sep 02 14:37:57 Perhaps the upload is stuck in incoming. Using the version from git. Sep 02 14:37:57 Sep 02 14:37:57 Checking package changelog for archive version 1.136 ... Sep 02 14:37:57 checking that dgit-test-dummy_1.137.dsc corresponds to HEAD Sep 02 14:37:57 dpkg-source: warning: extracting unsigned source package (/tmp/autopkgtest-virt-docker.shared.u9jego2t/downtmp/work/../bpd/dgit-test-dummy_1.137.dsc) Sep 02 14:37:57 dpkg-source: info: extracting dgit-test-dummy in unpacked Sep 02 14:37:57 dpkg-source: info: unpacking dgit-test-dummy_1.137.tar.gz Sep 02 14:38:08 ../bpd/dgit-test-dummy_1.137_source.changes already has appropriate .orig(s) (if any) Sep 02 14:38:10 gpg: WARNING: unsafe permissions on homedir '/home/builder/.gnupg' Sep 02 14:38:10 gpg: Signature made Tue Sep 2 14:38:08 2025 UTC Sep 02 14:38:10 gpg: using RSA key 374D8CE4DB96E9CBD4C0972A606D084E4683C079 Sep 02 14:38:10 gpg: /home/builder/.gnupg/trustdb.gpg: trustdb created Sep 02 14:38:10 gpg: Good signature from "Debian tag2upload service (key 1) <[email protected]>" [unknown] Sep 02 14:38:10 gpg: WARNING: This key is not certified with a trusted signature! Sep 02 14:38:10 gpg: There is no indication that the signature belongs to the owner. Sep 02 14:38:10 Primary key fingerprint: 374D 8CE4 DB96 E9CB D4C0 972A 606D 084E 4683 C079 Sep 02 14:38:44 [policy database busy, retrying (1s)] Sep 02 14:39:21 remote: [policy database busy, retrying (1s)] Sep 02 14:40:02 remote: [policy database busy, retrying (1s)] Sep 02 14:40:13 remote: To /srv/dgit.debian.org/dispatch-dir/distro=debian/repos/dgit-test-dummy.git Sep 02 14:40:13 remote: bcf2eae..a40019e a40019e61a570b6f01b577a2d031620950a0eb93 -> refs/dgit/rc-buggy Sep 02 14:40:13 remote: * [new tag] bc5338561f17f22590901cef2000221f35910a56 -> archive/debian/1.137 Sep 02 14:40:13 remote: * [new tag] 465fe7c03ea23dab9f748a19052add430299fc81 -> debian/1.137 Sep 02 14:40:15 To git+ssh://push.dgit.debian.org/dgit/debian/repos/dgit-test-dummy.git Sep 02 14:40:15 bcf2eae..a40019e a40019e61a570b6f01b577a2d031620950a0eb93 -> refs/dgit/rc-buggy Sep 02 14:40:15 * [new tag] archive/debian/1.137 -> archive/debian/1.137 Sep 02 14:40:15 * [new tag] debian/1.137 -> debian/1.137 Sep 02 14:40:15 signfile dsc dgit-test-dummy_1.137.dsc 374D8CE4DB96E9CBD4C0972A606D084E4683C079 Sep 02 14:40:16 Sep 02 14:40:16 fixup_buildinfo dgit-test-dummy_1.137.dsc dgit-test-dummy_1.137_source.buildinfo Sep 02 14:40:16 signfile buildinfo dgit-test-dummy_1.137_source.buildinfo 374D8CE4DB96E9CBD4C0972A606D084E4683C079 Sep 02 14:40:17 Sep 02 14:40:17 fixup_changes dsc dgit-test-dummy_1.137.dsc dgit-test-dummy_1.137_dgit.changes Sep 02 14:40:17 fixup_changes buildinfo dgit-test-dummy_1.137_source.buildinfo dgit-test-dummy_1.137_dgit.changes Sep 02 14:40:17 signfile changes dgit-test-dummy_1.137_dgit.changes 374D8CE4DB96E9CBD4C0972A606D084E4683C079 Sep 02 14:40:19 Sep 02 14:40:19 Successfully signed dsc, buildinfo, changes files Sep 02 14:40:20 Uploading to ftp-master (via ftp to ftp.upload.debian.org): Sep 02 14:40:21 Uploading dgit-test-dummy_1.137.dsc: done. Sep 02 14:40:22 Uploading dgit-test-dummy_1.137.tar.gz: done. Sep 02 14:40:23 Uploading dgit-test-dummy_1.137.git.tar.xz: done. Sep 02 14:40:25 Uploading dgit-test-dummy_1.137_source.buildinfo: done. Sep 02 14:40:25 Uploading dgit-test-dummy_1.137_source.changes: done. Sep 02 14:40:25 Successfully uploaded packages. Sep 02 14:40:25 dgit (build host) ok: pushed and uploaded 1.137 Sep 02 14:40:25 # [ok] Sep 02 14:40:25 # processing successful Sep 02 14:40:25 # Uploaded to experimental -- Ian Jackson <[email protected]> These opinions are my own. Pronouns: they/he. If I emailed you from @fyvzl.net or @evade.org.uk, that is a private address which bypasses my fierce spamfilter.
