[
https://issues.apache.org/jira/browse/HUDI-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit closed HUDI-7523.
-----------------------------
Resolution: Fixed
> Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used in HoodieIncrSource
> ------------------------------------------------------------------
>
> Key: HUDI-7523
> URL: https://issues.apache.org/jira/browse/HUDI-7523
> Project: Apache Hudi
> Issue Type: Improvement
> Components: deltastreamer
> Reporter: Vinish Reddy
> Assignee: Vinish Reddy
> Priority: Minor
> Labels: pull-request-available
> Fix For: 0.15.0, 1.0.0
>
>
> Add a new config HOODIE_SPARK_DATASOURCE_OPTIONS which is used by the spark
> dataframe reader for {{{}HoodieIncrSource{}}}, options like using
> metadataTable, dataSkipping present inDataSourceOptions.scala can be passed
> for efficient pruning of files.
> [https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
