Resolute:

Running the test script in a podman container:
root@resolute:/src# ./test.sh
Testing ubuntu-dev-tools's seeded-in-ubuntu command
ubuntu-dev-tools version:
ubuntu-dev-tools        0.210ubuntu0.1
=====================================================================
Testing source package busybox against default series (stonking).
Watch that 'busybox-static' is mostly in 'extra' seed, and 'busybox-initramfs' 
doesn't exists.
 $ seeded-in-ubuntu busybox
busybox (from busybox) is seeded for tenacious in:
  edubuntu: boot, desktop-gnome-minimal, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  kubuntu: boot, desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  lubuntu: boot, desktop-minimal, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-budgie: boot, desktop-minimal, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntu-core: boot, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-mate: boot, live, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntu-unity: boot, desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu: boot, cloud-image, desktop-minimal, server, server-minimal, 
supported-cloud, supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntucinnamon: boot, desktop, desktop-minimal, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntukylin: boot, desktop, desktop-minimal, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntustudio: boot, desktop, desktop-core, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  xubuntu: boot, live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
busybox-static (from busybox) is seeded for tenacious in:
  ubuntu-core: standard

=====================================================================
Testing binary package busybox-initramfs against default series (stonking).
Should output that the package is not seeded and may not exist.
 $ seeded-in-ubuntu -b busybox-initramfs
busybox-initramfs is not seeded (and may not exist) for tenacious.

=====================================================================
Testing binary package busybox-initramfs against explicit stonking.
Should output that the package is not seeded and may not exist.
 $ seeded-in-ubuntu -s stonking -b busybox-initramfs
busybox-initramfs is not seeded (and may not exist) for stonking.

=====================================================================
Testing source package busybox against resolute.
Watch that 'busybox-static' is mostly in 'standard' seed, and 
'busybox-initramfs' is "everywhere".
 $ seeded-in-ubuntu -s resolute busybox
busybox-initramfs (from busybox) is seeded for resolute in:
  edubuntu: desktop-gnome-minimal, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  kubuntu: desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  lubuntu: live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-budgie: live, ship, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntu-core: supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-mate: core, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-unity: desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu: cloud-image, desktop-minimal, server, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntucinnamon: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntukylin: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntustudio: dvd-live, live, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  xubuntu: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
busybox-static (from busybox) is seeded for resolute in:
  edubuntu: standard
  kubuntu: standard
  lubuntu: standard
  ubuntu-budgie: standard
  ubuntu-core: standard
  ubuntu-mate: standard
  ubuntu-unity: standard
  ubuntu: server-minimal, standard
  ubuntucinnamon: standard
  ubuntukylin: standard
  ubuntustudio: standard
  xubuntu: standard

=====================================================================
Testing binary package busybox-initramfs against resolute.
Should output that the package is seeded "everywhere".
 $ seeded-in-ubuntu -s resolute -b busybox-initramfs
busybox-initramfs is seeded for resolute in:
  edubuntu: desktop-gnome-minimal, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  kubuntu: desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  lubuntu: live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-budgie: live, ship, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntu-core: supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-mate: core, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu-unity: desktop, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntu: cloud-image, desktop-minimal, server, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  ubuntucinnamon: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntukylin: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack
  ubuntustudio: dvd-live, live, ship-live, supported-cloud, 
supported-hardware-server, supported-installer-common, 
supported-installer-desktop, supported-kernel-common, supported-misc-servers, 
supported-openstack
  xubuntu: live, ship-live, supported-cloud, supported-hardware-server, 
supported-installer-common, supported-installer-desktop, 
supported-kernel-common, supported-misc-servers, supported-openstack

=====================================================================
Testing binary package ubuntu-x1e-settings against resolute amd64.
Should output that the package is not seeded and may not exist.
 $ seeded-in-ubuntu -s resolute -b ubuntu-x1e-settings
ubuntu-x1e-settings is not seeded (and may not exist) for resolute.

=====================================================================
Testing binary package ubuntu-x1e-settings against resolute arm64.
This should be seeded for 'ubuntu' in 'ship-live' and 'server-ship-live'
 $ seeded-in-ubuntu -s resolute -a arm64 -b ubuntu-x1e-settings
ubuntu-x1e-settings is seeded for resolute in:
  ubuntu: server-ship-live, ship-live

=====================================================================
Testing binary package ubuntu-x1e-settings against jammy arm64.
Should output that the package is not seeded and may not exist.
 $ seeded-in-ubuntu -s jammy -a arm64 -b ubuntu-x1e-settings
ubuntu-x1e-settings is not seeded (and may not exist) for jammy.

=====================================================================
Testing binary package s390-tools against noble s390x.
This should be seeded for everything in 'boot' and 'supported-cloud', and even 
more seeds for 'ubuntu'
 $ seeded-in-ubuntu -s noble -a s390x -b s390-tools
s390-tools is seeded for noble in:
  edubuntu: boot, supported-cloud
  kubuntu: boot, supported-cloud
  lubuntu: boot, supported-cloud
  ubuntu-budgie: boot, supported-cloud
  ubuntu-core: boot, supported-cloud
  ubuntu-mate: boot, supported-cloud
  ubuntu-unity: boot, supported-cloud
  ubuntu: boot, cloud-image, server, server-cloud-minimal, supported-cloud
  ubuntucinnamon: boot, supported-cloud
  ubuntukylin: boot, supported-cloud
  ubuntustudio: boot, supported-cloud
  xubuntu: boot, supported-cloud

#####################################################################
Smoke testing a couple of other commands from the package
=====================================================================
 $ submittodebian --help
usage: submittodebian [-h]

Submit the Ubuntu changes in a package to Debian. Run inside an unpacked
Ubuntu source package.

options:
  -h, --help  show this help message and exit

=====================================================================
 $ import-bug-from-debian --help
usage: import-bug-from-debian [-h] [-b] [-l INSTANCE] [-v] [-n] [-p PACKAGE] 
[--no-conf] bugs [bugs ...]

positional arguments:
  bugs                  Bug number(s) or URL(s)

options:
  -h, --help            show this help message and exit
  -b, --browserless     Don't open the bug in the browser at the end
  -l, --lpinstance INSTANCE
                        LP instance to connect to (default: production)
  -v, --verbose         Print info about the bug being imported
  -n, --dry-run         Don't actually open a bug (also sets verbose)
  -p, --package PACKAGE
                        Launchpad package to file bug against (default: Same as 
Debian)
  --no-conf             Don't read config files or environment variables.

=====================================================================
 $ reverse-depends --help
usage: reverse-depends [-h] [-r RELEASE] [-R] [-s] [-b] [-a ARCH] [-c 
COMPONENT] [-l] [-u URL] [-x] [-d RECURSIVE_DEPTH] package

List reverse-dependencies of package. If the package name is prefixed with src: 
then the reverse-dependencies of all the binary packages that the specified
source package builds will be listed.

positional arguments:
  package

options:
  -h, --help            show this help message and exit
  -r, --release RELEASE
                        Query dependencies in RELEASE. Default: tenacious
  -R, --without-recommends
                        Only consider Depends relationships, not Recommends
  -s, --with-suggests   Also consider Suggests relationships
  -b, --build-depends   Query build dependencies (synonym for --arch=source)
  -a, --arch ARCH       Query dependencies in ARCH. Default: any
  -c, --component COMPONENT
                        Only consider reverse-dependencies in COMPONENT. Can be 
specified multiple times. Default: all
  -l, --list            Display a simple, machine-readable list
  -u, --service-url URL
                        Reverse Dependencies webservice URL. Default: UbuntuWire
  -x, --recursive       Consider to find reverse dependencies recursively.
  -d, --recursive-depth RECURSIVE_DEPTH
                        If recusive, you can specify the depth.

=====================================================================
 $ ubuntu-build --help
usage: ubuntu-build <srcpackage> <release> <operation>

Where operation may be one of: rescore, retry, or status.
Only Launchpad Buildd Admins may rescore package builds.

options:
  -h, --help            show this help message and exit
  -a, --arch ARCHITECTURE
                        Rebuild or rescore a specific architecture. Valid 
architectures include: armhf, riscv64, i386, powerpc, arm64, ppc64el, s390x,
                        amd64v3, amd64.
  -A, --archive ARCHIVE
                        operate on ARCHIVE

Batch processing:
  These options and parameter ordering is only available in --batch mode. 
Usage: ubuntu-build --batch [options] <package>...

  --batch               Enable batch mode
  --series SERIES       Selects the Ubuntu series to operate on (default: 
current development series)
  --retry               Retry builds (give-back).
  --rescore PRIORITY    Rescore builds to <priority>.
  --state STATE         Act on builds that are in the specified state

=====================================================================

Everything looks good and works fine.

** Description changed:

  [ Impact ]
  
  The `seeded-in-ubuntu` command, used by the Release Team, is currently backed 
by an index on UbuntuWire: 
http://qa.ubuntuwire.org/ubuntu-seeded-packages/seeded.json.gz
  This index currently has multiple issues:
  * It doesn't support series and arches, so essentially only returns results 
for the devel series on amd64
  * It seems to be a bit broken, as shown with the `packagekit` case below (in 
[ Original description ])
  
  [ Test Plan ]
  
  Run seeded-in-ubuntu in various situations to cover different combinations 
among:
    * source vs binary package
    * series
    * architectures
    * seeded or not seeded
  Run some other ubuntu-dev-tools commands to make sure the package isn't 
broken.
  
  The following script can help cover these cases:
  ```bash
  #!/usr/bin/bash
  
  echo "Testing ubuntu-dev-tools's seeded-in-ubuntu command"
  echo "ubuntu-dev-tools version:"
  dpkg-query -W ubuntu-dev-tools
  
  function run() {
    echo "  $" $@
    $@
    echo ""
  }
  
  echo "====================================================================="
  echo "Testing source package busybox against default series (stonking)."
  echo "Watch that 'busybox-static' is mostly in 'extra' seed, and 
'busybox-initramfs' doesn't exists."
  run seeded-in-ubuntu busybox
  
  echo "====================================================================="
  echo "Testing binary package busybox-initramfs against default series 
(stonking)."
  echo "Should output that the package is not seeded and may not exist."
  run seeded-in-ubuntu -b busybox-initramfs
  
  echo "====================================================================="
  echo "Testing binary package busybox-initramfs against explicit stonking."
  echo "Should output that the package is not seeded and may not exist."
  run seeded-in-ubuntu -s stonking -b busybox-initramfs
  
  echo "====================================================================="
  echo "Testing source package busybox against resolute."
  echo "Watch that 'busybox-static' is mostly in 'standard' seed, and 
'busybox-initramfs' is \"everywhere\"."
  run seeded-in-ubuntu -s resolute busybox
  
  echo "====================================================================="
  echo "Testing binary package busybox-initramfs against resolute."
  echo "Should output that the package is seeded \"everywhere\"."
  run seeded-in-ubuntu -s resolute -b busybox-initramfs
  
  echo "====================================================================="
  echo "Testing binary package ubuntu-x1e-settings against resolute amd64."
  echo "Should output that the package is not seeded and may not exist."
  run seeded-in-ubuntu -s resolute -b ubuntu-x1e-settings
  
  echo "====================================================================="
  echo "Testing binary package ubuntu-x1e-settings against resolute arm64."
  echo "This should be seeded for 'ubuntu' in 'ship-live' and 
'server-ship-live'"
  run seeded-in-ubuntu -s resolute -a arm64 -b ubuntu-x1e-settings
  
  echo "====================================================================="
  echo "Testing binary package ubuntu-x1e-settings against jammy arm64."
  echo "Should output that the package is not seeded and may not exist."
  run seeded-in-ubuntu -s jammy -a arm64 -b ubuntu-x1e-settings
  
  echo "====================================================================="
- echo "Testing binary package s390x-tools against noble s390x."
+ echo "Testing binary package s390-tools against noble s390x."
  echo "This should be seeded for everything in 'boot' and 'supported-cloud', 
and even more seeds for 'ubuntu'"
- run seeded-in-ubuntu -s noble -a s390x -b s390x-tools
+ run seeded-in-ubuntu -s noble -a s390x -b s390-tools
  
  echo "#####################################################################"
  echo "Smoke testing a couple of other commands from the package"
  echo "====================================================================="
  run submittodebian --help
  echo "====================================================================="
  run import-bug-from-debian --help
  echo "====================================================================="
  run reverse-depends --help
  echo "====================================================================="
  run ubuntu-build --help
  echo "====================================================================="
  ```
  
  [ Where problems could occur ]
  
  This is a Python script developed on the devel series, meaning a recent 
Python ecosystem. Backporting it to older release has the risk of hitting a too 
recent Python feature or API that doesn't work in older ecosystem.
  Fortunately, this is a self-contained script, not a module/library, so should 
impact anything else than just being broken.
  Also, the set of arguments and code paths is fairly low, so it should be 
humanly doable to reach good exhaustive coverage by following the Test Plan 
carefully.
  Finally, this script and package is mostly used by Ubuntu Developers, so 
shouldn't impact non-technical folks if it happens to break somehow.
  
  [ Other info ]
  
  Please note that the `seeded-in-ubuntu` command relies on an external 
service: https://static-reports.ubuntu.com/
  If this service is down, a local cache can help, but needs to be populated at 
least once.
  With the current difficulties regarding Canonical infrastructure, we might be 
in a position of not being able to execute the Test Plan swiftly when the 
package is published in -proposed.
  
  [ Original description ]
  
  As of now:
  
  ❯ seeded-in-ubuntu packagekit
  gir1.2-packagekitglib-1.0 (from packagekit) is seeded in:
    ubuntu-core-installer: daily-live
  libpackagekit-glib2-18 (from packagekit) is seeded in:
    ubuntu-core-installer: daily-live
  libpackagekit-glib2-dev (from packagekit) is seeded in:
    ubuntu-budgie: supported
    ubuntu: supported
  packagekit (from packagekit) is seeded in:
    ubuntu-core-installer: daily-live
  packagekit-docs (from packagekit) is seeded in:
    ubuntu-budgie: supported
    ubuntu: supported
  
  but
  
  ❯ curl -s 
https://cdimage.ubuntu.com/ubuntu-server/resolute/daily-live/current/resolute-live-server-amd64.manifest
 | grep packagekit
  gir1.2-packagekitglib-1.0     1.3.4-3ubuntu1.1
  libpackagekit-glib2-18:amd64  1.3.4-3ubuntu1.1
  packagekit    1.3.4-3ubuntu1.1
  
  and
  
  ❯ curl -s 
https://cdimage.ubuntu.com/ubuntu/resolute/daily-live/current/resolute-desktop-amd64.manifest
 | grep packagekit
  gir1.2-packagekitglib-1.0     1.3.4-3ubuntu1
  gstreamer1.0-packagekit       1.3.4-3ubuntu1
  libpackagekit-glib2-18:amd64  1.3.4-3ubuntu1
  packagekit    1.3.4-3ubuntu1
  
  and
  
  ❯ curl -s 
https://cdimage.ubuntu.com/ubuntu/stonking/daily-live/current/stonking-desktop-amd64.manifest
 | grep packagekit
  gir1.2-packagekitglib-1.0     1.3.5-1ubuntu1
  gstreamer1.0-packagekit       1.3.5-1ubuntu1
  libpackagekit-glib2-18:amd64  1.3.5-1ubuntu1
  packagekit    1.3.5-1ubuntu1
  
  We apparently can't trust `seeded-in-ubuntu` anymore 😢
  
  Maybe a first step would be to get back control over its index,
  currently hosted and generated who knows how on UbuntuWire:
  http://qa.ubuntuwire.org/ubuntu-seeded-packages/seeded.json.gz

** Tags removed: verification-needed-resolute
** Tags added: verification-done-resolute

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2160240

Title:
  seeded-in-ubuntu is lying

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-dev-tools/+bug/2160240/+subscriptions


-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to