[
https://issues.apache.org/jira/browse/HADOOP-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637840#action_12637840
]
Karam Singh commented on HADOOP-4373:
-------------------------------------
Settings:
Cluster is of 107 nodes out which 106 runs tasktrackers
Configured 4 qeueues -:
default gc_percent=10
test_q1 gc_percent=20
test_q2 gc_precent=30
test_q3 gc_percent=40
After starting mapred cluster.
JobTracker UI shows -:
Nodes=106, Map Task Capacity=212, Reduce Task Capacity=212 Avg.
Tasks/Node=4.00
Queue Information shows -:
Queue Name Scheduling Information
default Guaranteed Capacity Maps (%) :10.0, Guaranteed Capacity Reduces (%)
:10.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q1 Guaranteed Capacity Maps (%) :20.0, Guaranteed Capacity Reduces (%)
:20.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q2 Guaranteed Capacity Maps (%) :30.0, Guaranteed Capacity Reduces (%)
:30.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q3 Guaranteed Capacity Maps (%) :40.0, Guaranteed Capacity Reduces (%)
:40.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
And Job track log shows -:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:
After updating QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:
Queue 'default'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q1'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q2'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q3'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:
After updating QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler:
Queue 'default'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q1'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q2'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue
'test_q3'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
Ran running about 15 jobs.
gc for all 4 queues remained 0 all the time.
> Guaranteed Capacity calculation is not calculated correctly
> -----------------------------------------------------------
>
> Key: HADOOP-4373
> URL: https://issues.apache.org/jira/browse/HADOOP-4373
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
> Priority: Blocker
>
> Guaranteed Capacity calculation is not calculated correctly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
