[jira] [Updated] (HUDI-905) Support PrunedFilteredScan for Spark Datasource
[ https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-905: Status: Open (was: New) > Support PrunedFilteredScan for Spark Datasource > --- > > Key: HUDI-905 > URL: https://issues.apache.org/jira/browse/HUDI-905 > Project: Apache Hudi (incubating) > Issue Type: New Feature >Reporter: Yanjia Gary Li >Priority: Minor > > Hudi Spark Datasource incremental view currently is using > DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter. > If we wanna use Spark predicate pushdown in a native way, we need to > implement PrunedFilteredScan for Hudi Datasource. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-905) Support PrunedFilteredScan for Spark Datasource
[ https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-905: Component/s: Spark Integration > Support PrunedFilteredScan for Spark Datasource > --- > > Key: HUDI-905 > URL: https://issues.apache.org/jira/browse/HUDI-905 > Project: Apache Hudi (incubating) > Issue Type: New Feature > Components: Spark Integration >Reporter: Yanjia Gary Li >Priority: Minor > > Hudi Spark Datasource incremental view currently is using > DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter. > If we wanna use Spark predicate pushdown in a native way, we need to > implement PrunedFilteredScan for Hudi Datasource. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-905) Support PrunedFilteredScan for Spark Datasource
[ https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-905: Priority: Minor (was: Major) > Support PrunedFilteredScan for Spark Datasource > --- > > Key: HUDI-905 > URL: https://issues.apache.org/jira/browse/HUDI-905 > Project: Apache Hudi (incubating) > Issue Type: New Feature >Reporter: Yanjia Gary Li >Priority: Minor > > Hudi Spark Datasource incremental view currently is using > DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter. > If we wanna use Spark predicate pushdown in a native way, we need to > implement PrunedFilteredScan for Hudi Datasource. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-905) Support PrunedFilteredScan for Spark Datasource
[ https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-905: Description: Hudi Spark Datasource incremental view currently is using DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter. If we wanna use Spark predicate pushdown in a native way, we need to implement PrunedFilteredScan for Hudi Datasource. > Support PrunedFilteredScan for Spark Datasource > --- > > Key: HUDI-905 > URL: https://issues.apache.org/jira/browse/HUDI-905 > Project: Apache Hudi (incubating) > Issue Type: New Feature >Reporter: Yanjia Gary Li >Priority: Major > > Hudi Spark Datasource incremental view currently is using > DataSourceReadOptions.PUSH_DOWN_INCR_FILTERS_OPT_KEY to push down the filter. > If we wanna use Spark predicate pushdown in a native way, we need to > implement PrunedFilteredScan for Hudi Datasource. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-905) Support PrunedFilteredScan for Spark Datasource
[ https://issues.apache.org/jira/browse/HUDI-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanjia Gary Li updated HUDI-905: Summary: Support PrunedFilteredScan for Spark Datasource (was: Support native filter pushdown for Spark Datasource) > Support PrunedFilteredScan for Spark Datasource > --- > > Key: HUDI-905 > URL: https://issues.apache.org/jira/browse/HUDI-905 > Project: Apache Hudi (incubating) > Issue Type: New Feature >Reporter: Yanjia Gary Li >Assignee: Yanjia Gary Li >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
