[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689258#comment-16689258 ] Oleksandr Shevchenko commented on YARN-2267: Hi all, I created YARN-9023 to add Auxiliary Service support in all YARN services instead of creating separately for each service. Please look at the attached design doc for the details. Also, you can add your comments to this doc: https://docs.google.com/document/d/1Pxs8eeWZwnlwryPj7gyN8Ej1O-FRBSX_C0ispV9ORT8/edit?usp=sharing Thanks a lot for any comments and attention to this feature! > Auxiliary Service support in RM > --- > > Key: YARN-2267 > URL: https://issues.apache.org/jira/browse/YARN-2267 > Project: Hadoop YARN > Issue Type: New Feature > Components: resourcemanager >Reporter: Naganarasimha G R >Assignee: Rohith Sharma K S >Priority: Major > > Currently RM does not have a provision to run any Auxiliary services. For > health/monitoring in RM, its better to make a plugin mechanism in RM itself, > similar to NM. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528248#comment-14528248 ] Rohith commented on YARN-2267: -- Thanks [~sunilg] for your views and [~zjshen] for your inputs. As of now we are not working on this, I prefer to close this. Will make a note that when we reopen the JIRA will come up with better proposal document. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: New Feature Components: resourcemanager Reporter: Naganarasimha G R Assignee: Rohith Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526446#comment-14526446 ] Sunil G commented on YARN-2267: --- It would be a good feature if we can plugin few resource monitoring services to RM such as mentioned in *Scenario 1* above. Could you please share the design thoughts for same, and main question will be like how this can be done in controlled way. By this what i meant is, an introduction of plugin should not conflict the existing behavior of scheduler's etc. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: New Feature Components: resourcemanager Reporter: Naganarasimha G R Assignee: Rohith Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527084#comment-14527084 ] Zhijie Shen commented on YARN-2267: --- Sunil, my 2 cents: if you can have some detailed proposal doc to share with community, and use it for further discussion, it will be more easier to catch the community's eyes and better to understand you proposal. You may want to focus on stating your problem, why it's general, what are the possible solutions, what are their pros and cos and so on. For example, Vinod may want to understand why we need to make monitoring as a aux service instead of builtin func of RM. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: New Feature Components: resourcemanager Reporter: Naganarasimha G R Assignee: Rohith Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524226#comment-14524226 ] Zhijie Shen commented on YARN-2267: --- Are we still interested in this feature? Otherwise, we can close this jira as won't fix. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: New Feature Components: resourcemanager Reporter: Naganarasimha G R Assignee: Rohith Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057415#comment-14057415 ] Naganarasimha G R commented on YARN-2267: - Some scenarios for supporting Auxillary Service in RM: Scenario 1: [Overload Control type] a. Monitor plugin inside RM can open rpc port and can recieve feedback from other components in cluster (NM, HBase etc) b. Based on feedback, monitor plugin can take action such as remove a particular NM or change capacity of an NM etc. Scenario 2: [Alarming module] a. Any state changes such as RM moved to Standby/Active, NM added , NM removed/decommisioned etc can easily be informed/reported to central monitoring service. [instead of existing pull type thru REST api's ] b. This plugin should also be able to register to RM for critical state changes as mentioned above, so that these can be reported. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: Improvement Components: resourcemanager Reporter: Naganarasimha G R Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-2267) Auxiliary Service support in RM
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056460#comment-14056460 ] Vinod Kumar Vavilapalli commented on YARN-2267: --- bq. For health/monitoring in RM Any examples? Trying to understand if this should be a plugin or core functionality.. Auxiliary Service support in RM --- Key: YARN-2267 URL: https://issues.apache.org/jira/browse/YARN-2267 Project: Hadoop YARN Issue Type: Improvement Components: resourcemanager Reporter: Naganarasimha G R Currently RM does not have a provision to run any Auxiliary services. For health/monitoring in RM, its better to make a plugin mechanism in RM itself, similar to NM. -- This message was sent by Atlassian JIRA (v6.2#6252)
