TaskTracker can skip a dfs check on every task launch.
------------------------------------------------------
Key: HADOOP-3712
URL: https://issues.apache.org/jira/browse/HADOOP-3712
Project: Hadoop Core
Issue Type: Improvement
Components: mapred
Reporter: Amar Kamat
When tasktracker gets a new task to run, it queries the namenode to find out
the job directory _size_. This _size_ is required if the job files are not yet
localized. But if its already localized then the dfs call gets wasted. This
will be true for all but 1 tasks that run for a job on a tracker. One can avoid
it but checking if the job is already localized.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.