I'm worried that KDE autopkgtests are a serious strain on the
infrastructure.

  (1) They are C++ applications that rebuild the whole package to run
      their tests. As well as being *very* time and compute intensive,
      this means they test the just-built thing¹ and not the binaries in
      the archive, so they are not testing the things that users are
      getting - which is what autopkgtests are supposed to test.
  (2) When there is a new upstream version uploaded, all the tests run,
      fail, and get retried with all-proposed=1. That is very wasteful.
      This will probably be due to some not-tight-enough dependencies
      but I'm not aware that anybody has worked to fix this.
  (3) Uploads trigger a whole web of rdependency tests, each of which
      have the above problems.

(3) would not be a problem if (1) and (2) were solved, but in the
absence of that it multiplies the problem.

Of course, when the tests are running, they take up a worker instance
which can't be used for something else. The rebuilds also cause 'noisy
neighbour' effects which impact unrelated tests that happen to be
running simultaneously.

Taken together, these are a big cause of slower queue throughput that is
especially bad when (and contribute to) the queues are large.

I've tried to raise this before, many times, but we've never got any
traction. If we can't get some this time, I'm proposing that we
blacklist these tests since they are too much of a strain on our
resources for not very much gain. We are a testing service, not a
continuous rebuild service.

Cheers,

-- 
Iain Lane                                  [ [email protected] ]
Debian Developer                                   [ [email protected] ]
Ubuntu Developer                                   [ [email protected] ]

¹ for example:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-disco/disco/amd64/k/kio/20190116_153902_bc22d@/log.gz:
  /usr/bin/ctest --force-new-ctest-process -j1
  Test project /tmp/autopkgtest.PRFpOs/build.vhn/src/obj-x86_64-linux-gnu

Attachment: signature.asc
Description: PGP signature

-- 
Ubuntu-release mailing list
[email protected]
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-release

Reply via email to