JkSelf commented on pull request #31941: URL: https://github.com/apache/spark/pull/31941#issuecomment-805795477
When found the `buildPlan `in `SubqueryAdaptiveBroadcastExec `can be reused, we can apply the DPP filter firstly(same with the `PlanDynamicPruningFilters `rule) and then back the AQE framework to reuse the broadcast exchange in the build side. And If the build side exchange is running and not finished, we can use the wait or cancel this stage mechanism to avoid the broadcast exchange be executed twice. @cloud-fan @weixiuli Please correct me if wrong understandings. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
