weixiuli commented on pull request #31941: URL: https://github.com/apache/spark/pull/31941#issuecomment-807967814
> 3\. In the `PlanAdaptiveDynamicPruningFilters` rule, I am more inclined to the idea of `PlanDynamicPruningFilters` rule, just add DPP filter by judging whether there is an exchange that can be reused. The real reuse process is left to AQE Framework instead of looking in the `stageCache` to create the reused exchange or calling the `newQueryStage` method to create a new quey stage in the `PlanAdaptiveDynamicPruningFilters` rule. @JkSelf I don't think so, the 'case 2’ said by @cloud-fan would be ignored if following your opinion. This PR can solve the 'case 2’. In addition, I think this modification is relatively concise. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
