Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/11714#issuecomment-200069678
@rxin @marmbrus This test build will fail for sure.
The related PRs is https://github.com/apache/spark/pull/11828 by @davies
Now, I think his version is more favorable to my PR:
https://github.com/apache/spark/pull/11745
Another issue is ongoing. The related `Optimizer` rule is
`InferFiltersFromConstraints`:
- Sure, we can disable it and the related test cases.
- To resolve it, I submitted a PR to avoid the Constraints triggered
condition push down: https://github.com/apache/spark/pull/11765
- At the same time, @viirya is resolving the related issue by cleaning the
Constraints generation of compound expressions for `IsNotNull`.
https://github.com/apache/spark/pull/11809 I think this could also avoid
exceeding the max num of iterations. Not 100% sure.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
