[
https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539662#comment-14539662
]
Xianyin Xin commented on YARN-3630:
-----------------------------------
I think an adaptive heartbeat interval is need, especially the cluster's scale
is large, in which case the heartbeat will overload RM.
In fact I was also considering this problem. We need a policy for RM to
determine the interval, and set the interval in the AllocateResponse. For the
policy, I think the queue length of scheduler events could be a nice index of
RM's load, since the scheduler is the bottleneck of the cluster's scalability.
The nodeHeartbeat can also be considered, and the corresponding profobuf
message filed has existed in NodeHeartbeatResponse.
> YARN should suggest a heartbeat interval for applications
> ---------------------------------------------------------
>
> Key: YARN-3630
> URL: https://issues.apache.org/jira/browse/YARN-3630
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager, scheduler
> Affects Versions: 2.7.0
> Reporter: Zoltán Zvara
> Priority: Minor
>
> It seems currently applications - for example Spark - are not adaptive to RM
> regarding heartbeat intervals. RM should be able to suggest a desired
> heartbeat interval to applications.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
