yihua commented on code in PR #9883:
URL: https://github.com/apache/hudi/pull/9883#discussion_r1375179246
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/HoodiePositionBasedFileGroupRecordBuffer.java:
##########
@@ -84,6 +79,10 @@ public void processDataBlock(HoodieDataBlock dataBlock,
Option<KeySpec> keySpecO
isFullKey = keySpecOpt.get().isFullKey();
}
+ if (dataBlock.containsPartialUpdates()) {
+ enablePartialMerging = true;
+ }
Review Comment:
The buffer consumes multiple log blocks in the file group. When there are
partial updates in one log block, we switch the merging mode and do not switch
back going forward to guarantee correct merging results.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
