Davis Zhang created HUDI-8822:
---------------------------------
Summary: Instants file read write should replace byte array
allocation with input output stream.
Key: HUDI-8822
URL: https://issues.apache.org/jira/browse/HUDI-8822
Project: Apache Hudi
Issue Type: Bug
Reporter: Davis Zhang
For relevant code path on archival and commits where we need to read write
instant files, underlying code can use byte array and is not robust for
handling big instant files.
One example is
org.apache.hudi.common.table.log.HoodieLogFormatWriter#appendBlocks. When we
ask for byte array 2 GB and larger JVM will simply reject the request and code
will fail.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
