dajiaohuang opened a new pull request, #7526: URL: https://github.com/apache/datafusion-comet/pull/7526
## What changes Capture the session's Comet settings on the shuffle dependency and apply them when constructing, writing and stopping JVM columnar shuffle writers. This lets map stages launched outside a SQL execution use the configured settings. Native and Spark shuffle writers retain their existing paths. Fixes #7303. ## Validation - Reproduced the reported missing invalid-codec failure with a synthetic fixture after selecting the Comet exchange. An earlier attempt without the native library did not exercise the issue. - `make format`, `make`, and `git diff --check` passed. - Focused regression passed on Spark 4.1 with AQE on and off and Spark 3.5 with AQE off. Each run covers serialized and bypass handles, valid and invalid codecs, and SQL and non-SQL controls. Other Spark profiles and the upstream Spark SQL suites were not run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
