manuzhang commented on pull request #30494: URL: https://github.com/apache/spark/pull/30494#issuecomment-734731545
If it's not the final stage, `OptimizeLocalShuffleReader` will not be applied to the probe side when the output partitioning can not `ensureRequirements`. I think we lack this `ensureRequirements` for the final stage, which is usually the requirement of target table. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
