rdtr opened a new issue, #13573:
URL: https://github.com/apache/gluten/issues/13573
### Description
### Description
Spark 3.4 reached EOL in October 2024. 3.4.4, tagged on 2024-10-21, was its
last release. In #13524, LuciferYang proposed removing it from main now, the
same way Spark 3.3 was removed under #12807. This issue tracks the same four
steps.
- [ ] Migrate Spark 3.4-only test coverage to Spark 3.5+. One
Gluten-authored case lives only in `gluten-ut/spark34`: `GlutenInsertSuite`'s
`offload empty2null when v1writes fallback`, added by #6859.
- [ ] Remove the Spark 3.4 profile, the shim and UT modules
(`shims/spark34`, `gluten-ut/spark34`), the Delta Lake 2.4 sources
(`gluten-delta/src-delta24`), Bolt's `src-iceberg-spark34`, the 3.4 CI jobs and
the build scripts.
- [ ] Clean up the shim APIs that exist only because Spark 3.4 differs from
later versions (like #12954 for 3.3).
- [ ] Remove the leftover Spark 3.4 version checks: the Spark 3.4 deletion
vector fallback in `OffloadDeltaScan`, `startsWith("3.4")` checks in tests, and
the `testWithMinSparkVersion(..., "3.4")` / `"3.5"` gates that become constant
(like #12981 and #12992).
### Gluten version
main branch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]