[
https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371732#comment-16371732
]
Manikandan R commented on YARN-4488:
------------------------------------
[~leftnoteasy] Thanks.
Overall approach (as described in YARN-4485) is
# Set the request start time while creating ResourceRequest object
# Once container is allocated, subtract #1 from now() to compute the time
taken/duration
# Use #2 to update the corresponding queue metrics. For example, Lets say, for
a job using 2 containers, newly added Queue Metrics would look like
{"ContainerAllocationDelayNumOps" : 2, "ContainerAllocationDelayAvgTime" :
1755.5}
As described in YARN-7902, To set the start time in ResourceRequest (which is
in hadoop-yarn-api package), it requires SystemClock class and its dependent
Clock interface to be in hadoop-common instead of hadoop-yarn-common (which is
dependent on hadoop-yarn-api package). Hence, idea is to move SystemClock class
etc to hadoop-common package so that it can be used any packages (not only
related to YARN). Subsequently, we will need to do corresponding import changes
in all classes where those clock related classes has been used. Thoughts? If it
makes sense, Can we also move other classes like MonotonicClock class etc?
Main changes are in {{AppSchedulingInfo}}, {{QueueMetrics}} and
{{ResourceRequest}} class. Attached patch covers metrics per Queue only. Once
approach is confirmed, will do the same per app as it is also an requirement of
this JIRA.
> CapacityScheduler: Compute per-container allocation latency and roll up to
> get per-application and per-queue
> ------------------------------------------------------------------------------------------------------------
>
> Key: YARN-4488
> URL: https://issues.apache.org/jira/browse/YARN-4488
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Karthik Kambatla
> Assignee: Manikandan R
> Priority: Major
> Attachments: YARN-4485.001.patch
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
