[ 
https://issues.apache.org/jira/browse/PIG-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074949#comment-14074949
 ] 

Rohini Palaniswamy commented on PIG-4074:
-----------------------------------------

Minor comments:
 - Can you leave the default at 3?
 - Also can you create a MapredConfig class and define the config as constant 
there. 

> mapreduce.client.submit.file.replication is not honored in cached files
> -----------------------------------------------------------------------
>
>                 Key: PIG-4074
>                 URL: https://issues.apache.org/jira/browse/PIG-4074
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Cheolsoo Park
>            Assignee: Cheolsoo Park
>             Fix For: 0.14.0
>
>         Attachments: PIG-4074-1.patch
>
>
> Pig ships files to hdfs in several cases (e.g. replicated join, streaming 
> cached files, etc). But {{mapreduce.client.submit.file.replication}} (or 
> {{mapred.submit.replication}} for Hadoop 1.x) is not honored, and this has 
> performance impact since many tasks read the same hdfs blocks in a large 
> cluster.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to