[
https://issues.apache.org/jira/browse/PARQUET-108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152719#comment-14152719
]
Dong Chen commented on PARQUET-108:
-----------------------------------
Hi Brock, it is assigned correctly. When working on the Hive side, I found the
writers' dynamic buffer size and flush method is needed to manage their memory
usage balance. These info can only be accessed in Parquet, so I will try to
implement it here.
> Parquet Memory Management in Java
> ---------------------------------
>
> Key: PARQUET-108
> URL: https://issues.apache.org/jira/browse/PARQUET-108
> Project: Parquet
> Issue Type: Improvement
> Reporter: Brock Noland
> Assignee: Dong Chen
>
> As discussed in HIVE-7685, Hive + Parquet often runs out memory when writing
> to many Hive partitions. This is quite problematic for our users.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
