[
https://issues.apache.org/jira/browse/MAPREDUCE-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira AJISAKA updated MAPREDUCE-5906:
-------------------------------------
Attachment: MAPREDUCE-5906.patch
Attaching a patch to change the default value in MergeManagerImpl.java.
> Inconsistent configuration in property
> "mapreduce.reduce.shuffle.input.buffer.percent"
> --------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5906
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 2.4.0
> Reporter: Akira AJISAKA
> Assignee: Akira AJISAKA
> Priority: Minor
> Labels: newbie
> Attachments: MAPREDUCE-5906.patch
>
>
> In MergeManagerImpl.java, the default value of
> MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT
> (=mapreduce.reduce.shuffle.input.buffer.percent) looks 0.90.
> {code}
> final float maxInMemCopyUse =
> jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
> {code}
> However, the actual default value is 0.70 in mapred-default.xml.
> {code}
> <name>mapreduce.reduce.shuffle.input.buffer.percent</name>
> <value>0.70</value>
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
