ulysses-you commented on PR #59630: URL: https://github.com/apache/spark/pull/59630#issuecomment-6597237330
I made `spark.sql.optimizer.pushDownShuffleThroughUnion.enabled` default to `false` in `a92fe353f77` as a conservative starting point. The shuffle savings depend on plan shape, and removing the union exchange can affect other AQE optimizations and cost-based plan selection. Keeping the rule opt-in preserves default behavior while allowing users to evaluate these trade-offs for their workloads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
