sherhomhuang created HUDI-4283:
----------------------------------
Summary: The memory cost in HoodieMergeHandle is increasing as the
size of base file is bigger and bigger
Key: HUDI-4283
URL: https://issues.apache.org/jira/browse/HUDI-4283
Project: Apache Hudi
Issue Type: Improvement
Components: archiving, compaction, performance
Reporter: sherhomhuang
Assignee: sherhomhuang
Suppose a situation, there is a large history data in one dimension table. All
files are in base path. There are few changes in the table, but for the large
num of history data. It costs a large memory in _*HoodieMergeHandle,*_ because
it will cache _*writtenRecordKeys*_ in memory.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
