brijrajk opened a new pull request, #12360: URL: https://github.com/apache/gluten/pull/12360
## What changes are proposed in this pull request? Follow-up to #12333. When `spark.io.compression.codec=none`, the error message from #12333 told users to configure `spark.gluten.sql.columnar.shuffle.codec`, which is misleading if their intent is to disable shuffle compression. `none` is special-cased to also point users to `spark.shuffle.compress=false`, which is the correct knob for disabling Gluten native shuffle compression (already handled in `ColumnarShuffleWriter` and `ColumnarBatchSerializer`). **Before (from #12333):** ``` Gluten shuffle only supports lz4, zstd. none is not supported. You may configure spark.gluten.sql.columnar.shuffle.codec to lz4 or zstd. ``` **After:** ``` Gluten shuffle does not support codec 'none'. To disable shuffle compression, set spark.shuffle.compress=false. To use a supported codec, set spark.gluten.sql.columnar.shuffle.codec to lz4 or zstd. ``` **Files changed** - `GlutenShuffleUtils.scala` — special-cases `none` with a more actionable error message - `MiscOperatorSuite.scala` — updates the `none` regression test assertion to match --- ## How was this patch tested? `MiscOperatorSuite` — 97/97 passed locally (Spark 4.0, Velox backend). --- ## Was this patch authored or co-authored using generative AI tooling? Yes. Claude Code (claude-sonnet-4-6) was used as an AI assistant during development. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
