yew1eb opened a new pull request, #3812:
URL: https://github.com/apache/celeborn/pull/3812
### What changes were proposed in this pull request?
Add an actions/cache step to every job in sbt.yml, caching:
- build/*.jar (the sbt launcher downloaded by build/sbt)
- ~/.sbt
- ~/.cache/coursier (dependency repository)
Keys are derived from hashFiles of the poms and build scripts, so downloads
only happen when the build files change. This follows the pattern used by
Spark's `build_and_test.yml`.
### Why are the changes needed?
The sbt CI jobs currently configure no caching at all: every run of every
matrix job (~40 jobs) re-downloads the sbt launcher and the entire dependency
set, which exposes CI to network flakes. Recent examples on PR CI and on main:
- "Our attempt to download sbt locally to build/sbt-launch-1.9.4.jar
failed" (job fails in ~15s)
- scala compile failing with MissingResourceException:
org.scalactic.ScalacticBundle caused by java.io.IOException: Stream
closed (corrupted jar download)
<img width="2110" height="444" alt="image"
src="https://github.com/user-attachments/assets/9d24b07d-3910-400e-b8ee-af550ca444e2";
/>
### Does this PR resolve a correctness bug?
- [ ] Yes
### Does this PR introduce _any_ user-facing change?
- [ ] Ye
### How was this patch tested?
Workflow-only change; the PR's own CI run exercises the new cache steps
(first run populates the cache, subsequent runs hit it).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
