pan3793 opened a new pull request, #7561:
URL: https://github.com/apache/kyuubi/pull/7561
### Why are the changes needed?
The old `cache-engine-archives` cache is one blob under a constant key, so
bumping any
engine invalidates all of them. This provisions engines explicitly instead:
- New reusable action `.github/actions/download-archive` downloads a tarball
and caches it
with `actions/cache` **keyed by the URL** (atomic download), so each
engine caches
independently and stable versions restore instantly.
- `.github/scripts/resolve-engine-archive-urls.sh` derives each URL from the
Maven
properties (honoring the build's profiles/`-D` overrides);
`expose-engine-homes.sh`
publishes `SPARK_HOME`/`HIVE_HOME`/`FLINK_HOME` from `/opt`.
- Every `master.yml` job now resolves → downloads → exposes only the engines
it needs;
`cache-engine-archives` is dropped. Build runs with
`-P{spark,flink,hive}-provided`.
- Flink test helpers now honor `FLINK_HOME` first (fallback to the download
dir for local
runs), matching Spark/Hive.
- The `hive-it` avatica/CALCITE-1224 hack is now a single `zip -d`.
### How was this patch tested?
Run by this PR's CI.
Locally checked: URL resolution across all matrix cases (Scala 2.13,
Spark/Flink/Hive version overrides, CDH6 empty-query), `*_HOME` resolution,
the
`closer.lua` redirect for `curl -fSL`, and the `zip -d` patch on a mock jar.
### Was this patch authored or co-authored using generative AI tooling?
Assisted-by: Claude Opus 4.8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
