[
https://issues.apache.org/jira/browse/HADOOP-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651908#action_12651908
]
Sreekanth Ramakrishnan commented on HADOOP-4445:
------------------------------------------------
Instead of relying on freshness of the queue information objects which are used
by scheduler to maintain the scheduling information, we can compute the number
of running tasks when the information is requested for by the user.
Following can be done for the same:
- Call JobQueueManager.getRunningJobs(queue).
- Iterate thro' list of jobs and keep adding to global running tasks count.
We also should be fixing
[HADOOP-4576|https://issues.apache.org/jira/browse/HADOOP-4576] along with this
so that we don't iterate thro' all the waiting jobs in order to compute the
pending total tasks in a queue.
Only downside of this approach would be that, whenever there is a UI request we
would be iterating thro' running jobs in order to compute the number of running
task, which might be a performance problem.
Any comments on the approach described above?
> Wrong number of running map/reduce tasks are displayed in queue information.
> ----------------------------------------------------------------------------
>
> Key: HADOOP-4445
> URL: https://issues.apache.org/jira/browse/HADOOP-4445
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Environment: Hadoop r705159, Queue=default, GC=100%
> MapCapacity=ReduceCapacity=212
> Reporter: Karam Singh
> Assignee: Sreekanth Ramakrishnan
>
> Wrong number of running map/reduce tasks are displayed in queue information.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
