Github user sathiyapk commented on the issue:
https://github.com/apache/spark/pull/19451
In the previous version of the rule, the `InferFiltersFromConstraints` rule
added some additional filters (like 'col.isNotNull) after the filter condition
is flipped, so it filtered out the null values. By applying the
`InferFiltersFromConstraints` rule before flipping the condition fixes it.
Please let me know if you have any questions. Thanks to @gatorsmile for
reminding to add `NULL` values in the test suite.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
