[
https://issues.apache.org/jira/browse/YARN-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545607#comment-14545607
]
Xianyin Xin commented on YARN-3652:
-----------------------------------
Thanks for comments, [~sunilg].
{quote}
1. *Throughput* : Are you mentioning about #events processed over a period of
time? If so, how can we set the timeline by which throughput is calculated
(configurable?)?
A clear indicator from this will be like we can predict possible end timeline
for the pending events in dispatcher queue. Adding throughput with #no of
pending events may give much more better indication about RM overload.
{quote}
In fact the first comes in my mind is the #containers allocated by scheduler
per second, because the containers allocation what users care and the node
update event is the most important scheduler event. The rate of processing
events is also a nice indicator, just as you comment.
{quote}
2. However there are many events coming to scheduler, if possible a filter for
the events based on events type may be helpful to give an accuracy for
throughout and scheduling delay.
{quote}
+1 for the idea. Besides, the #events processed by scheduler per second is
large, so the indexes based on this is volatile. We may consider some method to
smooth the fluctuate, like making sampling or statistics.
> A SchedulerMetrics may be need for evaluating the scheduler's performance
> -------------------------------------------------------------------------
>
> Key: YARN-3652
> URL: https://issues.apache.org/jira/browse/YARN-3652
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager, scheduler
> Reporter: Xianyin Xin
>
> As discussed in YARN-3630, a {{SchedulerMetrics}} may be need for evaluating
> the scheduler's performance. The performance indexes includes #events waiting
> for being handled by scheduler, the throughput, the scheduling delay and/or
> other indicators.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
