Automatic configuration of number of map and reduce slots based on available
resources for dealing with heterogenous clusters
-----------------------------------------------------------------------------------------------------------------------------
Key: MAPREDUCE-922
URL: https://issues.apache.org/jira/browse/MAPREDUCE-922
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Components: tasktracker
Reporter: Arun C Murthy
Currently the number of map and reduce slots have to be configured manually,
which is reasonable for homogeneous clusters. However, as the clusters start to
change over time it becomes rather painful to administer and configure. We
should start thinking along the direction of auto-magically configuring the
slots based on available resources on the node such as RAM, CPU, disk etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.