The GitHub Actions job "Tests" on airflow.git has failed. Run started by GitHub user potiuk (triggered by potiuk).
Head commit for run: af556b4b199b832374c2bffc76b32cece8fc1683 / Jarek Potiuk <[email protected]> Optimize CI/PROD image waiting and verification in CI workflow Currently both "wait-for-ci-images" and "preview-constraints" jobs are waiting for images to be built - which means that they both take a running worker slot (public runner) just to do the waiting while the image is being built. Also "verify-image" job is run as part of "wait-for-image" which adds additional delay between being downloaded and dependent jobs starting. This PR optimizes it quite a bit: * preview-constraints job now depends on "wait-for-ci-images". This means that only one slot will be busy while waiting for images. * both CI and PROD `verify-image` commands in breeze got --run-in-parallel set of flags that allow the verification to happen for all images in parallel. * Image verification is added as separate step in jobs that already need to pull the images to do other stuff. For CI Image it's "Preview constraints" and for PROD image it is "Test Docker compose job". The fact that they are not run as part of "wait for image" jobs allows us to start the other jobs faster but also to not let failure in image verification block other tests from running. * In case of the "in-workflow-build" the "wait-for-ci-images" does not have to be run at all, because there wait-for-ci-images depends on in-workflow build-ci-images job - so if that job completes, we know image is built already and we do not have to wait for it separately - so far we had to run it in order to add `--verify` flag to verify the images. With separate job we can run i in parallel to all the other waiting jobs. * Also names and dependencies between jobs are updated, including CI documentation describing diagrams of how CI workflows work. The diagrams are cleaned-up/verified and updated. The separate diagram for scheduled build has been removed as it was essentially the same as "canary build". A paragraph description for every type of workflow was added to add more context to the diagrams. Report URL: https://github.com/apache/airflow/actions/runs/6992488918 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
