Hadoop should allow the task trackerto to have different mapper/reducer task
limits
-----------------------------------------------------------------------------------
Key: HADOOP-1728
URL: https://issues.apache.org/jira/browse/HADOOP-1728
Project: Hadoop
Issue Type: Improvement
Components: mapred
Reporter: Runping Qi
Right now, Hadoop has one configuration variable to set the limit on the number
of tasks
per task tracker. That number applies to both the mappers and reducers.
However, in many
cases, it make a lot of sense to set different limits on them, For example,
since mappers
are typically take less resources than reducers, we can set 4 as the limit on
mappers
and 2 on reducers. This will improve the cluster utilization and improve the
overall performance.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
