Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/13893
With [PR#14012](https://github.com/apache/spark/pull/14012) the order
between deterministic and non-deterministic predicates would not be changed
arbitrarily, so I think we could apply this improvement which push down
predicates placed before non-deterministic parts in partition conditions so
that we could do partition pruning even when condition contains
non-deterministic fields. @liancheng @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
