[
https://issues.apache.org/jira/browse/YARN-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064736#comment-14064736
]
Sunil G commented on YARN-2305:
-------------------------------
No. Its a capacity scheduler. I could collect logs from Andreina for same. I
will take over and analyze for Capacity Scheduler.
{noformat}
2014-07-15 16:56:50,720 INFO
org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl:
container_1405414066690_0023_01_000129 Container Transitioned from NEW to
RESERVED
2014-07-15 16:56:50,720 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue:
Reserved container application attempt=appattempt_1405414066690_0023_000001
resource=<memory:2048, vCores:1> queue=a: capacity=0.5, absoluteCapacity=0.5,
usedResources=<memory:7168, vCores:4>, usedCapacity=0.875,
absoluteUsedCapacity=0.4375, numApps=1, numContainers=4 node=host:
host-10-18-40-14:45026 #containers=4 available=1024 used=7168
clusterResource=<memory:16384, vCores:16>
2014-07-15 16:56:50,720 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue:
Re-sorting assigned queue: root.a stats: a: capacity=0.5, absoluteCapacity=0.5,
usedResources=<memory:9216, vCores:5>, usedCapacity=1.125,
absoluteUsedCapacity=0.5625, numApps=1, numContainers=5
2014-07-15 16:56:50,720 INFO
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue:
assignedContainer queue=root usedCapacity=1.0625 absoluteUsedCapacity=1.0625
used=<memory:17408, vCores:10> cluster=<memory:16384, vCores:16>
{noformat}
> When a container is in reserved state then total cluster memory is displayed
> wrongly.
> -------------------------------------------------------------------------------------
>
> Key: YARN-2305
> URL: https://issues.apache.org/jira/browse/YARN-2305
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Affects Versions: 2.4.1
> Reporter: J.Andreina
> Assignee: Hong Zhiguo
> Attachments: Capture.jpg
>
>
> ENV Details:
> =========
> 3 queues : a(50%),b(25%),c(25%) ---> All max utilization is set to
> 100
> 2 Node cluster with total memory as 16GB
> TestSteps:
> =========
> Execute following 3 jobs with different memory configurations for
> Map , reducer and AM task
> ./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=a
> -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=2048
> -Dyarn.app.mapreduce.am.resource.mb=1024 -Dmapreduce.reduce.memory.mb=2048
> /dir8 /preempt_85 (application_1405414066690_0023)
> ./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=b
> -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=2048
> -Dyarn.app.mapreduce.am.resource.mb=2048 -Dmapreduce.reduce.memory.mb=2048
> /dir2 /preempt_86 (application_1405414066690_0025)
>
> ./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=c
> -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=1024
> -Dyarn.app.mapreduce.am.resource.mb=1024 -Dmapreduce.reduce.memory.mb=1024
> /dir2 /preempt_62
> Issue
> =====
> when 2GB memory is in reserved state totoal memory is shown as
> 15GB and used as 15GB ( while total memory is 16GB)
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
