andygrove opened a new pull request, #3271: URL: https://github.com/apache/datafusion-comet/pull/3271
## Summary Merges three near-identical Spark SQL test jobs into a single consolidated job with a config matrix: - `spark-sql-auto-scan` (was 20 jobs) - `spark-sql-native-native-comet` (was 14 jobs) - `spark-sql-native-iceberg-compat` (was 14 jobs, now 7) **Before:** 48 jobs across 3 workflows (293 lines) **After:** 41 jobs in 1 consolidated workflow (191 lines) **Reduction:** ~15% fewer jobs ### Test matrix | Scan Implementation | Spark Versions | Jobs | |---------------------|----------------|------| | auto | 3.4, 3.5, 4.0 | 20 | | native_comet | 3.4, 3.5 | 14 | | native_iceberg_compat | 3.5 | 7 | The `native_iceberg_compat` scanner is now only tested on Spark 3.5, as testing on 3.4 provides diminishing returns. ## Test plan - [ ] Verify the workflow runs correctly on this PR - [ ] Check that all expected matrix combinations are generated 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
