sivabalan narayanan created HUDI-9341:
-----------------------------------------
Summary: Add ordering value to RLI partition
Key: HUDI-9341
URL: https://issues.apache.org/jira/browse/HUDI-9341
Project: Apache Hudi
Issue Type: Improvement
Components: metadata, writer-core
Reporter: sivabalan narayanan
For now, when we add records to log files in data table, to generate RLI
records, we avoid reading older log files/entire file slice to account for
deletes w/ lower ordering value.
One way we could solve this is to store the ordering value in RLI partition.
And so, while reading records from log file, while merging w/ previous value in
RLI we can use that to determine the final resolved state.
this means, we have to upgrade the schema for RLI.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
