I have run the full ubuntu-advantage-tools integration test suite against the version in -proposed. The results are attached.
This is a new test artifact format--attached is a compressed archive containing test results. The `campaign.json` describes the test permutations. We ran all machine types and all LTS releases from bionic through resolute. Please reference `units.csv` to see the scenarios that were run for each (release, machine type). Each entry contains a job_id that you can use to look up the particular test output in `jobs/` if interested. Please note that the "skipped" tests are all bionic on WSL; this release was only available through winget, and we do not support anything outside of the official installation channels. We dropped support for bionic during this test run, so that is why they are skipped. There are also two tests failing due to infra issues: 1. The (focal/wsl) test for fix.feature is having trouble connecting to the security URL. Confirmed this is an outage: https://ubuntu.com/security/cves/CVE-1800-123456.json 2. The (focal/gcp.generic) test in livepatch.feature is failing because the staging Livepatch server is now using the production contracts URL to validate tokens. I have been able to do a manual test for failing scenario (2) to confirm that Livepatch is working as expected on (focal/gcp.generic) against prod Livepatch. Failing scenario (1) cannot pass since the security URL is down. We have not altered `pro fix` functionality in this SRU. Further, other `pro fix` and other (focal/wsl) tests are passing, so I am reasonably confident that this failure is not masking a real regression. ** Attachment added: "LP-2163406.tar.gz" https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/2163406/+attachment/6009560/+files/LP-2163406.tar.gz ** Tags removed: verification-needed-bionic verification-needed-focal verification-needed-jammy verification-needed-noble verification-needed-resolute ** Tags added: verification-done-bionic verification-done-focal verification-done-jammy verification-done-noble verification-done-resolute -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/2163406 Title: [SRU] Update ubuntu-advantage-tools to v38 (AppArmor fixes, CVEs, cloud license updates) - Bionic, Focal, Jammy, Noble, Resolute To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/2163406/+subscriptions -- ubuntu-bugs mailing list [email protected] https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
