sridhar09 opened a new pull request, #13523: URL: https://github.com/apache/gluten/pull/13523
## What changes are proposed in this pull request? Backport of #11832 to `branch-1.6`. On 1.6.0 with `spark.gluten.sql.native.union=true`, the native union names its output columns after their type. After a wide transformation, every column of a given type then returns the value of the first column of that type, with no error (#13522). This ports the fix from main (commit `985b19ae4`, released in 1.7.0) unchanged: the one-line change in `SubstraitToVeloxPlan.cc` and its test in `MiscOperatorSuite`. Original author: @lifulong. Fixes #13522. ## How was this patch tested? `git cherry-pick -x 985b19ae4` applies cleanly to `branch-1.6` with no conflicts, and the two commits here produce exactly the same tree as that cherry-pick. It includes the original test, `native union_all with two level union keeps distinct output columns`. The helpers it uses (`compareDfResultsAgainstVanillaSpark`, `checkGlutenPlan`, `GlutenConfig.NATIVE_UNION_ENABLED`) exist on `branch-1.6` with the same signatures. Relying on CI for the build and test run. ## Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 5.5 (cherry-pick and PR description; the code change is the original #11832). 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01DaMaEFEUTo7kQvUefAnQ7B -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
