andygrove opened a new pull request, #3455: URL: https://github.com/apache/datafusion-comet/pull/3455
## Summary - Spark configs with the prefix `spark.comet.datafusion.*` are now passed through to DataFusion's `SessionConfig` - The `spark.comet.` prefix is stripped so that e.g. `spark.comet.datafusion.sql_parser.parse_float_as_decimal=true` becomes `datafusion.sql_parser.parse_float_as_decimal=true` in DataFusion - This allows users to tune DataFusion behavior from Spark via `--conf` without code changes ## Test plan - [ ] Verify existing tests pass (no behavioral change for users not setting `spark.comet.datafusion.*` configs) - [ ] Manually test with `spark-shell --conf spark.comet.datafusion.sql_parser.parse_float_as_decimal=true` and confirm the setting is applied in DataFusion 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
