Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/11649#issuecomment-195793185
As mentioned in another thread, we do not explicitly add the inferred
predicates(including `isNotNull`) into the conditions always. We just store
them in the node. So far, we only do a bottom-up constraint propagation. That
is not enough. We need a way to push down the local inferred predicates as low
as possible.
I am not sure what is the best way to implement it. I guess we need such a
class parameter for storing constraints in each case class?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
