Manoj Govindassamy created HUDI-3356:
----------------------------------------
Summary: Conversion of write stats to metadata index records
should use HoodieData throughout
Key: HUDI-3356
URL: https://issues.apache.org/jira/browse/HUDI-3356
Project: Apache Hudi
Issue Type: Task
Components: writer-core
Reporter: Manoj Govindassamy
Assignee: Manoj Govindassamy
Fix For: 0.11.0
HoodieMetadataTableUtil convertMetadataToRecords() converts all write stats to
metadata index records to List of HoodieRecords before passing on them to
engine specific commit() to prep records. This can OOM driver. We need to use
HoodieData<HoodieRecords> throughout.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
