@juliank As I understand the definition of the needs-internet
restriction Ubuntu's CI does not provide that and still running those
small number of potentially tests is worse than loosing the result by
not executing them.

https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README
.package-tests.rst

needs-internet
The test needs unrestricted internet access, e.g. to download test data
that's not shipped as a package, or to test a protocol implementation
against a test server. Please also see the note about Network access later
in this document.
...
Network access

autopkgtest needs access to the network at least for downloading test
dependencies and possibly dist-upgrading testbeds. In environments with
restricted internet access you need to set up an apt proxy and configure
the testbed to use it. (Note that the standard tools like autopkgtest-
build-lxc or mk-sbuild automatically use the apt proxy from the host
system.)

In general, tests should not access the internet themselves. If a test
does use the internet outside of the pre-configured apt domain, the test
must be marked with the needs-internet restriction. Using the internet
usually makes tests less reliable, so this should be kept to a minimum.
But for many packages their main purpose is to interact with remote web
services and thus their testing should actually cover those too, to
ensure that the distribution package keeps working with their
corresponding web service.

Please note that for Debian, the ftp-master have ruled (in their REJECT-
FAQ (Non-Main II) that tests must not execute code they download. In
particular, tests must not use external repositories to depend on
software (as opposed to data) that is not in Debian. However, currently
there is nothing preventing this.

Debian's production CI infrastructure allows unrestricted network access
on most workers. Tests with needs-internet can be skipped on some to
avoid flaky behavior. In Ubuntu's infrastructure access to sites other
than *.ubuntu.com and *.launchpad.net happens via a proxy (limited to
DNS and http/https).

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1892903

Title:
  autopkgtest with needs-internet restriction fails

To manage notifications about this bug go to:
https://bugs.launchpad.net/auto-package-testing/+bug/1892903/+subscriptions

-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to