Alexey Kudinkin created HUDI-3830:
-------------------------------------
Summary: We need to revisit MOR block merging sequence
Key: HUDI-3830
URL: https://issues.apache.org/jira/browse/HUDI-3830
Project: Apache Hudi
Issue Type: Bug
Reporter: Alexey Kudinkin
Assignee: Alexey Kudinkin
Fix For: 0.12.0
We need to revisit MOR block merging sequence and make sure that following
invariants are upheld
# Block have to be merged backward-pass (ie we first fetch all the blocks, and
merge them in the reverse order of their timeline)
# We should try to avoid having 2 merging sequences and instead consolidate on
just one: right now we have "block + block", and "base + block", but we should
be able to just get away with just the latter (this will simplify merging
sequence quite substantially, for ex in respect to handling of deletions)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
