[
https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanjia Gary Li updated HUDI-905:
--------------------------------
Description:
Hudi Spark Datasource incremental view currently is using
DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter.
If we wanna use Spark predicate pushdown in a native way, we need to implement
PrunedFilteredScan for Hudi Datasource.
> Support PrunedFilteredScan for Spark Datasource
> -----------------------------------------------
>
> Key: HUDI-905
> URL: https://issues.apache.org/jira/browse/HUDI-905
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Reporter: Yanjia Gary Li
> Priority: Major
>
> Hudi Spark Datasource incremental view currently is using
> DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter.
> If we wanna use Spark predicate pushdown in a native way, we need to
> implement PrunedFilteredScan for Hudi Datasource.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
