[ 
https://issues.apache.org/jira/browse/PARQUET-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307683#comment-14307683
 ] 

Ryan Blue commented on PARQUET-179:
-----------------------------------

I agree with this, although with PARQUET-139 we shouldn't need (or try to use) 
either _metadata or _common_metadata. Those assume that the files in the 
directory haven't changed and could be a lurking problem.

> Retire _metadata generation 
> ----------------------------
>
>                 Key: PARQUET-179
>                 URL: https://issues.apache.org/jira/browse/PARQUET-179
>             Project: Parquet
>          Issue Type: Task
>            Reporter: elif dede
>            Assignee: elif dede
>
> We can disable  _metadata file generation since it is not being used anymore 
> to reduce the memory usage during commit phase.
> We are keeping the _common_metadata since it is less memory expensive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to