Atour Mousavi Gourabi created PARQUET-2449:
----------------------------------------------
Summary: Writing using LocalOutputFile creates a large buffer
Key: PARQUET-2449
URL: https://issues.apache.org/jira/browse/PARQUET-2449
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Reporter: Atour Mousavi Gourabi
LocalOutputFile uses a large buffer to write Parquet files. In low-memory
environments this causes OOMs. See the discussion under apache/parquet-mr#1111
for more details.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]