nchammas opened a new pull request, #57083: URL: https://github.com/apache/spark/pull/57083
### What changes were proposed in this pull request? Rebuild the various images used on CI on a schedule. The schedule is set to once a week. ### Why are the changes needed? All of our CI build images are based on `ubuntu:noble`. They are only refreshed if we push changes to the Dockerfiles on `master`. https://github.com/apache/spark/blob/d386172e690188b659cf89894e1eca4485c05c57/.github/workflows/build_infra_images_cache.yml#L31-L48 On the other hand, however, `ubuntu:noble` is updated roughly once a month: ```sh $ curl -s "https://hub.docker.com/v2/repositories/library/ubuntu/tags?name=noble&page_size=10"; \ | jq -r '.results[] | "\(.tag_last_pushed[:10]) \(.name)"' 2026-07-02 noble-20260610 2026-07-02 noble 2026-06-02 noble-20260509.1 2026-04-15 noble-20260410 2026-04-07 noble-20260324 2026-03-19 noble-20260217 2026-02-18 noble-20260210.1 2026-01-19 noble-20260113 2025-11-15 noble-20251013 2025-10-13 noble-20251001 ``` This means that there are several updates to the base image that we have not incorporated. So when CI runs, it cannot pull from an existing cache and has to build the images from scratch. This takes about [50 minutes](https://github.com/nchammas/spark/actions/runs/28833909584/job/85513889893)! With an up-to-date cache, this drops down to [~1 minute](https://github.com/nchammas/spark/actions/runs/28836719647/job/85522299879). ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? I tested this with a change to `build_and_test.yml` on one of my branches, but I believe the correct fix is to ensure the that the base images are refreshed on a schedule. ```yml cache-from: | type=registry,ref=ghcr.io/${{ github.repository_owner }}/spark/apache-spark-github-action-image-cache:${{ inputs.branch }} type=registry,ref=ghcr.io/apache/spark/apache-spark-github-action-image-cache:${{ inputs.branch }} cache-to: type=registry,ref=ghcr.io/${{ github.repository_owner }}/spark/apache-spark-github-action-image-cache:${{ inputs.branch }},mode=max ``` ### Was this patch authored or co-authored using generative AI tooling? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
