[
https://issues.apache.org/jira/browse/PARQUET-179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307806#comment-14307806
]
Ryan Blue commented on PARQUET-179:
-----------------------------------
You're right. I wasn't thinking about Pig. Does Pig have a method to turn off
looking at _common_metadata? Or do we have a way to know that it is still valid
for a directory?
> Retire _metadata generation
> ----------------------------
>
> Key: PARQUET-179
> URL: https://issues.apache.org/jira/browse/PARQUET-179
> Project: Parquet
> Issue Type: Task
> Reporter: elif dede
> Assignee: elif dede
>
> We can disable _metadata file generation since it is not being used anymore
> to reduce the memory usage during commit phase.
> We are keeping the _common_metadata since it is less memory expensive.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
