[
https://issues.apache.org/jira/browse/HUDI-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-8822:
--------------------------------------
Fix Version/s: 1.0.2
> Instants file read write should replace byte array allocation with input
> output stream.
> ---------------------------------------------------------------------------------------
>
> Key: HUDI-8822
> URL: https://issues.apache.org/jira/browse/HUDI-8822
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Davis Zhang
> Priority: Major
> Fix For: 1.0.1, 1.0.2
>
>
> For relevant code path on archival and commits where we need to read write
> instant files, underlying code can use byte array and is not robust for
> handling big instant files.
>
> One example is
> org.apache.hudi.common.table.log.HoodieLogFormatWriter#appendBlocks. When we
> ask for byte array 2 GB and larger JVM will simply reject the request and
> code will fail.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
