Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/5044#issuecomment-91949704
After thinking about this more, I think this approach is must too
simplistic to be correct. I was able to come up with one trivial example that
breaks the logic (and was not caught by tests), but I think this is a really
hard problem in general. Basically equality is easy and can be done with
simple plan munging, but doing query subsumption is likely going to require
considering each operator carefully. As a result I think we should close this
issue for now until there is a concrete propose for how to handle this
correctly in all cases.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
