Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/5369#issuecomment-90156494
Thanks for working on this! Left several commented about styling. However,
I just realized that adding a new method `supportPredicate` in
`PrunedFilteredScan` breaks backwards compatibility of the data sources API.
This makes hesitant to have this.
Incidentally, I just wrote a design doc for improving data sources API and
adding partitioning support to it. This very issue is also covered by adding a
new trait rather than a new method to an existing trait. This doc should
probably be made public very soon. Would you mind me revisiting this later?
I'll keep you updated.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
