[
https://issues.apache.org/jira/browse/MAPREDUCE-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil Govindan updated MAPREDUCE-7070:
--------------------------------------
Target Version/s: 3.3.0 (was: 2.6.6, 3.2.0)
Bulk update: moved all 3.2.0 non-blocker issues, please move back if it is a
blocker.
> Batch calls to RackResolver from AM
> -----------------------------------
>
> Key: MAPREDUCE-7070
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7070
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: applicationmaster, performance
> Reporter: Greg Phillips
> Priority: Minor
> Attachments: MAPREDUCE-7070.patch
>
>
> TaskAttemptImpl calls RackResolver once for every split location. This
> results in many shells being spawned by the Application Master when the
> topology script is enabled. The worst case scenario would entail one call to
> the topology script for each Datanode. The NameNode is also topology aware,
> and uses batch calls to the topology script to improve performance.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
