[
https://issues.apache.org/jira/browse/PARQUET-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gang Wu resolved PARQUET-2449.
------------------------------
Fix Version/s: 1.14.0
Assignee: Atour Mousavi Gourabi
Resolution: Fixed
> Writing using LocalOutputFile creates a large buffer
> ----------------------------------------------------
>
> Key: PARQUET-2449
> URL: https://issues.apache.org/jira/browse/PARQUET-2449
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Reporter: Atour Mousavi Gourabi
> Assignee: Atour Mousavi Gourabi
> Priority: Major
> Fix For: 1.14.0
>
>
> LocalOutputFile uses a large buffer to write Parquet files. In low-memory
> environments this causes OOMs. See the discussion under
> apache/parquet-mr#1111 for more details.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
