FelixYBW opened a new pull request, #13421:
URL: https://github.com/apache/gluten/pull/13421
## What changes are proposed in this pull request?
Each PR-triggered workflow builds Velox on its own. This PR cuts down how
many native builds a PR runs:
- **`velox_backend_enhanced.yml`**: paused on pull requests. It now runs on
`workflow_dispatch` only, and `detect-changes` runs everything when there is no
PR diff.
- **`velox_kafka.yml`**: removed.
- Its native Kafka tests (`velox_kafka_connector_test`,
`velox_plan_conversion_test`) already run in x86's `cpp-test-udf-test`. That
job's shared build (`ci-velox-buildshared-centos-9.sh`) passes
`--enable_kafka=ON` and runs `ctest`.
- Its Spark 3.5 job is now `spark-test-kafka-spark35` in
`velox_backend_x86.yml`, using the `build-native-lib-centos-8` artifact. Today
that job only builds with `-Pkafka`; its test steps are still TODO. A TODO
notes that re-enabling them needs a static build with `--enable_kafka=ON`.
- `gluten-kafka/**` is added to the x86 path filter and to the `java`
change flag.
- **`iceberg_spark_ut.yml`**: now a reusable workflow, called from
`velox_backend_x86.yml` (`iceberg-spark-ut`).
- It gets the static native artifact for the head revision, so
`iceberg_upstream_revision.yml` skips its own native build when
`native_artifact` is set.
- The base revision still builds its native libraries when no saved
baseline exists, because it is a different commit.
- `workflow_dispatch` still works on its own and builds native as before.
- `baseline.py` now accepts saved baselines recorded by either workflow
path. The x86 nightly schedule also produces main-branch baselines.
- Docs: updated the Iceberg section of `velox-backend-CI.md`.
On a typical C++ PR, this removes 3 Velox builds: enhanced static, Kafka
static and Iceberg head static.
Notes for reviewers:
- Iceberg now runs when x86's `java`, `shims35` or `cpp` flag is set. That
is slightly broader than its old path filter.
- `baseline.py` is part of the Iceberg harness hash, so the first PR after
this merges will run the base revision once.
- The head native libraries now come from x86's
`apache/gluten:vcpkg-almalinux-8-gcc13` tag rather than the digest pinned by
`prepare`. It is the same image tag and build script.
## How was this patch tested?
- `actionlint` on all changed workflows: clean. It also checks the
reusable-workflow inputs.
- `python3 -m unittest discover -s
gluten-ut/src-iceberg-upstream/test/python`: 60 tests OK, including a new test
that accepts a baseline recorded from `velox_backend_x86.yml`.
- The workflows themselves are exercised by this PR's CI.
## Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude claude-opus-5-5
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
