[
https://issues.apache.org/jira/browse/HUDI-6389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6389:
----------------------------
Description:
[https://github.com/apache/hudi/pull/7561/files/f61d9480f00b3f79d71044e0392ed6e2f10af4ad#r1203654251]
the following case where the timeline is like:
ts3.rollback, ts50.commit, ts51.commit, ts52.commit, ...
and ts49.commit and ts48.commit are archived.
If we pass in ts47 as the exclusiveStartInstantTime at this point,
activeTimeline.isBeforeTimelineStarts(exclusiveStartInstantTime) returns false.
However, the active timeline misses ts48.commit and ts49.commit which are
required for meta sync. This is a problem if ts48.commit or ts49.commit has
partition changes.
> Fix instant time check against the active timeline in meta sync
> ---------------------------------------------------------------
>
> Key: HUDI-6389
> URL: https://issues.apache.org/jira/browse/HUDI-6389
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Blocker
> Fix For: 0.14.0
>
>
> [https://github.com/apache/hudi/pull/7561/files/f61d9480f00b3f79d71044e0392ed6e2f10af4ad#r1203654251]
>
> the following case where the timeline is like:
> ts3.rollback, ts50.commit, ts51.commit, ts52.commit, ...
> and ts49.commit and ts48.commit are archived.
> If we pass in ts47 as the exclusiveStartInstantTime at this point,
> activeTimeline.isBeforeTimelineStarts(exclusiveStartInstantTime) returns
> false. However, the active timeline misses ts48.commit and ts49.commit which
> are required for meta sync. This is a problem if ts48.commit or ts49.commit
> has partition changes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
