[
https://issues.apache.org/jira/browse/HUDI-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481615#comment-17481615
]
Yann Byron edited comment on HUDI-3232 at 1/25/22, 7:54 AM:
------------------------------------------------------------
[~shivnarayan]
i plan to do something in HoodieActiveTimeline.
all the methods in HoodieActiveTimeline will judge whether need to load the
latest instant. If yes, load incrementally and execute the following codes.
Also, all the methods that will create a new instant will force to load after
the operation.
WDYT?
was (Author: [email protected]):
[~shivnarayan]
yep, it's very like you comment above.
> support reload timeline Incrementally
> -------------------------------------
>
> Key: HUDI-3232
> URL: https://issues.apache.org/jira/browse/HUDI-3232
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Common Core, incremental-query, writer-core
> Reporter: Yann Byron
> Priority: Critical
> Fix For: 0.11.0
>
>
> Recently, call `HoodieTableMetaClient.reloadActiveTimeline` many times in one
> operation, and this will reload the timeline fully.
> Perhaps, to support to reload in Incremental mode will increase the
> performance.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)