Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/11682#issuecomment-196939816
@davies I might understand your points. We still prefer
`PushPredicateThroughProject`. Let me submit another PR to address that issue
and at you.
Let me explain my understanding. They still conflicts with each other.
However, now the changes can converge now without extra changes. It depends the
order of these two rules.
If we want to push `Project` deeper, we should keep the current order.
Then, after finishing the batch `Batch("Operator Optimizations")`, we can add
another batch for `PushPredicateThroughProject`. We just need to run it once to
make sure `Filter` is below `Project` in the final optimized plan.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
