[
https://issues.apache.org/jira/browse/HUDI-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-7552:
-----------------------------
Description:
We wanna remove the very specific design for MDT so that it's behavior is in
sync with the DT.
The criteria for simplification:
{code:java}
1. use the instant timestamp from DT to commit to the MDT as much as possible
for any delta_commit on MDT.
2. for table sercives like cleaning, compaction and log_compaction, the
timestamp is auto-generated.
3. avoid to trigger multiple commits to MDT for one DT action. {code}
The async index instant suffix is kept because there are some validation logic
that needs special filtering on these instants, the suffix is kind of a "tag"
for filtering. We should refacor that out in the future if we have a better
solution.
> Remove the suffix for MDT table service instants
> ------------------------------------------------
>
> Key: HUDI-7552
> URL: https://issues.apache.org/jira/browse/HUDI-7552
> Project: Apache Hudi
> Issue Type: Improvement
> Components: core
> Reporter: Danny Chen
> Assignee: Danny Chen
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
>
> We wanna remove the very specific design for MDT so that it's behavior is in
> sync with the DT.
>
> The criteria for simplification:
> {code:java}
> 1. use the instant timestamp from DT to commit to the MDT as much as possible
> for any delta_commit on MDT.
> 2. for table sercives like cleaning, compaction and log_compaction, the
> timestamp is auto-generated.
> 3. avoid to trigger multiple commits to MDT for one DT action. {code}
> The async index instant suffix is kept because there are some validation
> logic that needs special filtering on these instants, the suffix is kind of a
> "tag" for filtering. We should refacor that out in the future if we have a
> better solution.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
