I've linked to a branch with modifications to execute the tests inside
pbuilder. Some caveats:

1. A credential file with user/password is required to actually run them. Not 
an issue in PS Jenkins, can be downloaded using a hook.
2. Our CI infrastructure don't have direct connection to the Internet, we use a 
special VM for site tests. Non-issue in PS Jenkins, can use it as slave.
3. This tests are prone to temporary errors. The experience tell us that sites 
sometimes report failures, so we decided to get notifications of non-temporary 
failures (+3 hours). Jenkins may not be so patient. Opinions?
4. All site tests are executed (we may get failures from the unmodified sites).

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1087415

Title:
  We need a coherent test suite in place before we can enable package
  autolanding.

To manage notifications about this bug go to:
https://bugs.launchpad.net/webapps-applications/+bug/1087415/+subscriptions

-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to