FrankYang0529 commented on PR #76279: URL: https://github.com/apache/airflow/pull/76279#issuecomment-6631752395
Thanks for narrowing this down. I ran the check you suggested on the "Build CI image" jobs. - The four cards at the top of the metrics page count every job in the repository, and the "Build CI image" filter only changes the table under the tabs. - From 2026-09-01 to 2026-09-30, 34 of 7,257 jobs failed. From 2026-10-02 to 2026-11-03, 133 of 8,897 jobs failed. None of the 167 failures happened while zstd was running. The export step, which runs zstd, failed in 4 jobs. These 4 jobs are among the 13 jobs that the table counts as Spot interruptions. In each of these 4 jobs, AWS interrupted the Spot instance during `docker image save`, before zstd started. In the other 9 of the 13 jobs, AWS interrupted the Spot instance during a different step. | Cause | 2026-09-01 to 09-30 | 2026-10-02 to 11-03 | |---|---:|---:| | `install_os_dependencies.sh` failed, mostly in apt (held broken packages, or 403 from dhi.io) | 2 | 40 | | Docker Hub returned 429 or 5xx, or could not be reached | 2 | 26 | | Installing or checking the Python packages failed (uv or pip) | 17 | 21 | | The download of mprocs failed | 4 | 14 | | AWS interrupted the EC2 Spot instance (RunsOn) | 0 | 13 | | Other, such as a failed stash upload or a base image missing on ghcr.io | 9 | 19 | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
