[ 
https://issues.apache.org/jira/browse/YARN-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lin Yiqun updated YARN-4396:
----------------------------
    Attachment: YARN-4396.003.patch

Add the debug infos in {{getAllowedLocalityLevelByTime}} and 
{{getAllowedLocalityLevel}} methods.A sample info:
* getAllowedLocalityLevelByTime:
{code}
2015-11-27 09:54:21,553 DEBUG 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: 
Waiting time is 32570 ms, more than nodeLocalityDelay time 1000 ms, change 
allowedLocality from NODE_LOCAL to RACK_LOCAL, priority:10, app attempt 
id:appattempt_1448589183973_0001_000001
2015-11-27 09:54:21,553 DEBUG 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: 
Assign container on qihe129040 node, requestType:OFF_SWITCH, 
allowedLocality:RACK_LOCAL, schedulingOpportunities:0, priority:10, app attempt 
id:appattempt_1448589183973_0001_000001
{code}

* getAllowedLocalityLevel:
{code}
2015-11-27 09:42:47,132 DEBUG 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: 
SchedulingOpportunities count is 2, more than nodeLocalityThreshold num 
0.8999999761581421, change allowedLocality from NODE_LOCAL to RACK_LOCAL, 
priority:10, app attempt id:appattempt_1448588357362_0001_000001
2015-11-27 09:42:47,132 DEBUG 
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: 
Assign container on qihe129040 node, requestType:OFF_SWITCH, 
allowedLocality:RACK_LOCAL, schedulingOpportunities:0, priority:10, app attempt 
id:appattempt_1448588357362_0001_000001
{code}

> Log the trance information on FSAppAttempt#assignContainer
> ----------------------------------------------------------
>
>                 Key: YARN-4396
>                 URL: https://issues.apache.org/jira/browse/YARN-4396
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: applications, scheduler
>    Affects Versions: 2.7.1
>            Reporter: Lin Yiqun
>            Assignee: Lin Yiqun
>         Attachments: YARN-4396.001.patch, YARN-4396.002.patch, 
> YARN-4396.003.patch
>
>
> When I configure the yarn.scheduler.fair.locality.threshold.node and 
> yarn.scheduler.fair.locality.threshold.rack to open this function, I have no 
> detail info of assigning container's locality. And it's important because it 
> will lead some delay scheduling and will have an influence on my cluster. If 
> I know these info, I can adjust param in cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to