JobTracker.getJobCounters() should not hold JobTracker lock while calling
JobInProgress.getCounters()
-----------------------------------------------------------------------------------------------------
Key: MAPREDUCE-2026
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2026
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Scott Chen
Assignee: Scott Chen
Fix For: 0.22.0
JobTracker.getJobCounter() will lock JobTracker and call
JobInProgress.getCounters().
JobInProgress.getCounters() can be very expensive because it aggregates all the
task counters.
We found that from the JobTracker jstacks that this method is one of the
bottleneck of the JobTracker performance.
JobInProgress.getCounters() should be able to be called out side the JobTracker
lock because it already has JobInProgress lock.
For example, it is used by jobdetails.jsp without a JobTracker lock.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
