Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/10655#issuecomment-172140783
@RussellSpitzer Thanks for the change. I have thought about it again. My
only concern is that `unhandledPredicates` actually contains filters that can
be handled by the data source. For example, filters in orc are applied to a
more coarse grain level. Also, any data source that does not override
`unhandledFilters` method will cause `HandledFilters` shows nothing, which can
cause confusion.
So, how about we still show `PUSHED_FILTERS`? But, we can add a special
character (maybe `*`) to filters that belong to `unhandledPredicates` to
indicate these filters may not be applied to every row?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
