Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/20699
`EnsureRequirements `can eliminates unnecessary shuffles if child has same
partitioning or compatible child partitionings that same expressions
distribution.
but when child has different partitioning or different expressions
distribution. `EnsureRequirements `can't eliminates unnecessary shuffles .
this PR deals with the latter case. thanks.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
