[
https://issues.apache.org/jira/browse/HUDI-8624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-8624:
------------------------------
Description:
[https://github.com/apache/hudi/pull/12385/files#r1865249449]
We need to revisit why we need commit metadata from timeline history. Reading
timeline history (archival timeline in old term) is expensive and should not be
incurred in incremental query except for completion time lookup.
> Revisit commitsMetadata fetching from timeline history in
> MergeOnReadIncrementalRelation
> ----------------------------------------------------------------------------------------
>
> Key: HUDI-8624
> URL: https://issues.apache.org/jira/browse/HUDI-8624
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Y Ethan Guo
> Priority: Blocker
> Fix For: 1.0.1
>
>
> [https://github.com/apache/hudi/pull/12385/files#r1865249449]
> We need to revisit why we need commit metadata from timeline history.
> Reading timeline history (archival timeline in old term) is expensive and
> should not be incurred in incremental query except for completion time lookup.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
