At Mozilla we regularly change our build and test configurations in CI
based on business and market needs (new platforms, OS upgrades, cost
savings, etc).

We’ve recently documented this process to provide more clarity about
timelines and responsibilities when one of these changes happen: We
also created a basic schedule to share what we are currently working on and
have planned:

The key takeaway for a developer responsible for tests: If your tests begin
to fail in a new configuration, we will file a bug and notify triage owners
while the new configuration is tier 2. After that, you will have at least 6
weeks with the failures being reproducible on the try server to investigate
and fix the test before the new configuration becomes tier 1. If your test
is still failing at that time it will remain skipped.

If you have questions or concerns, please contact the Releng team


dev-platform mailing list

Reply via email to