[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3630: -- Attachment: YARN-3630.003.patch Upload a patch, adding a configured hard heartbeat interval upper limit, and following [~vvasudev]'s suggestion, making the calculated nodes heartbeat delays random to avoid clustered pings. > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, scheduler >Affects Versions: 2.7.0 >Reporter: Zoltán Zvara >Assignee: Xianyin Xin >Priority: Minor > Attachments: Notes_for_adaptive_heartbeat_policy.pdf, > YARN-3630.001.patch.patch, YARN-3630.002.patch, YARN-3630.003.patch > > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3630: -- Attachment: YARN-3630.002.patch Upload a patch for review. Currently, we can choose to turn off this feature forcibly if we need more evaluation on the real-life need. > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, scheduler >Affects Versions: 2.7.0 >Reporter: Zoltán Zvara >Assignee: Xianyin Xin >Priority: Minor > Attachments: Notes_for_adaptive_heartbeat_policy.pdf, > YARN-3630.001.patch.patch, YARN-3630.002.patch > > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3630: -- Attachment: Notes_for_adaptive_heartbeat_policy.pdf > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, scheduler >Affects Versions: 2.7.0 >Reporter: Zoltán Zvara >Assignee: Xianyin Xin >Priority: Minor > Attachments: Notes_for_adaptive_heartbeat_policy.pdf, > YARN-3630.001.patch.patch > > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3630: -- Attachment: YARN-3630.001.patch.patch Initial patch with adaptive heartbeat policy unimplemented. If we determine to implement a good enough adaptive heartbeat policy, this jira would depend YARN-3652, where we have enough information of the scheduler's load to determine the heartbeat interval. > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, scheduler >Affects Versions: 2.7.0 >Reporter: Zoltán Zvara >Assignee: Xianyin Xin >Priority: Minor > Attachments: YARN-3630.001.patch.patch > > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3630: - Component/s: (was: client) Priority: Minor (was: Major) Affects Version/s: 2.7.0 > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager, scheduler >Affects Versions: 2.7.0 >Reporter: Zoltán Zvara >Priority: Minor > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated YARN-3630: --- Description: It seems currently applications - for example Spark - are not adaptive to RM regarding heartbeat intervals. RM should be able to suggest a desired heartbeat interval to applications. (was: It seems currently applications - for example Spark - are not adaptive to RM regarding heartbeat intervals. RM should be able to suggest a desired heartbeat interval to application.) > YARN should suggest a heartbeat interval for applications > - > > Key: YARN-3630 > URL: https://issues.apache.org/jira/browse/YARN-3630 > Project: Hadoop YARN > Issue Type: Improvement > Components: client, resourcemanager, scheduler >Reporter: Zoltán Zvara > > It seems currently applications - for example Spark - are not adaptive to RM > regarding heartbeat intervals. RM should be able to suggest a desired > heartbeat interval to applications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
