[
https://issues.apache.org/jira/browse/HUDI-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-5104:
----------------------------
Description: Currently, the HoodieFileIndex used by HoodieBaseRelation is
not compatible with Databricks Spark runtime (while HoodieFileIndex is
compatible with OSS Spark). We have to disable HoodieFileIndex and fall back
to HoodieROTablePathFilter to make queries work on Hudi tables in Databricks
Spark runtime. (was: Currently, the HoodieFileIndex used by HoodieBaseRelation
is not compatible with Databricks Spark runtime (while HoodieFileIndex is
compatible with OSS Spark). We have to disable HoodieFileIndex )
> Add feature flag to disable HoodieFileIndex and fall back to
> HoodieROTablePathFilter
> ------------------------------------------------------------------------------------
>
> Key: HUDI-5104
> URL: https://issues.apache.org/jira/browse/HUDI-5104
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.13.0
>
>
> Currently, the HoodieFileIndex used by HoodieBaseRelation is not compatible
> with Databricks Spark runtime (while HoodieFileIndex is compatible with OSS
> Spark). We have to disable HoodieFileIndex and fall back to
> HoodieROTablePathFilter to make queries work on Hudi tables in Databricks
> Spark runtime.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
