[ 
https://issues.apache.org/jira/browse/PIG-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cheolsoo Park updated PIG-4074:
-------------------------------

    Status: Patch Available  (was: Open)

> mapreduce.client.submit.file.replication is not honored in cached files
> -----------------------------------------------------------------------
>
>                 Key: PIG-4074
>                 URL: https://issues.apache.org/jira/browse/PIG-4074
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Cheolsoo Park
>            Assignee: Cheolsoo Park
>             Fix For: 0.14.0
>
>         Attachments: PIG-4074-1.patch
>
>
> Pig ships files to hdfs in several cases (e.g. replicated join, streaming 
> cached files, etc). But {{mapreduce.client.submit.file.replication}} (or 
> {{mapred.submit.replication}} for Hadoop 1.x) is not honored, and this has 
> performance impact since many tasks read the same hdfs blocks in a large 
> cluster.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to