The GitHub Actions job "Tests" on airflow.git has succeeded.
Run started by GitHub user potiuk (triggered by potiuk).

Head commit for run:
85301afa54edb4828b77c2f705cb5aa9ee19dbb3 / Jarek Potiuk <[email protected]>
Collect test types in CI in parallel

One of the steps in our CI is to collect tests, which is to prevent
parallel tests from even starting when we know test collection will
fail (it is terrible waste of resources to start 20 test jobs and
initialize databases etc. when we know it is not needed.

This however introduced a single point of delay in the CI process,
which with the recent collection protection implemented in #30315 piled
up to more than 5 minutes occassionally on the CI machines of ours,
especially on public runners.

This PR utilises our existing test framework to be able to parallelise
test collection (Pytest does not have paralllel collection
mechanism) - also for localised PRs it will only run test collection
for the test types that are going to be executed, which will speed it
up quite a lot.

This might get further sped up if we split Provider tests into
smaller groups to parallelise them even more.

Report URL: https://github.com/apache/airflow/actions/runs/4605079205

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to