[
https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6654:
----------------------------
Description: To support position-based merging of base and log files, we
need to encode positions in the log blocks so that the positions can be used
directly, without having to deserialize records or delete keys for
OverwriteWithLatest payload, or with ordering values required only for
`DefaultHoodieRecordPayload` supporting event time based streaming. We add a
new `HeaderMetadataType` to store the positions in the log block header. (was:
To support position-based merging of base and log files, we need to encode
positions in the log blocks so that the positions can be used directly, without
having to deserialize records or delete keys for OverwriteWithLatest payload,
or with ordering values required only for `DefaultHoodieRecordPayload`
supporting event time based streaming.)
> Encode record positions in log blocks
> -------------------------------------
>
> Key: HUDI-6654
> URL: https://issues.apache.org/jira/browse/HUDI-6654
> Project: Apache Hudi
> Issue Type: New Feature
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Blocker
> Fix For: 0.14.0
>
>
> To support position-based merging of base and log files, we need to encode
> positions in the log blocks so that the positions can be used directly,
> without having to deserialize records or delete keys for OverwriteWithLatest
> payload, or with ordering values required only for
> `DefaultHoodieRecordPayload` supporting event time based streaming. We add a
> new `HeaderMetadataType` to store the positions in the log block header.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
