cloud-fan commented on PR #49202: URL: https://github.com/apache/spark/pull/49202#issuecomment-2553357928
OK let's make the scope clear. We do not aim to find all duplicated expressions in the query plan tree and optimize them with `With`. We aim to avoid extra expression duplication that happens during pushing filter through project. So the change should be we update the filter pushdown rule and use `With` to avoid the aforementioned expression duplication. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
