[ 
https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640220#comment-14640220
 ] 

Dian Fu commented on YARN-3964:
-------------------------------

Hi [~leftnoteasy],
Thanks a lot for your review and feedback.
{quote}
According to the design doc, configuration of centralized provider also needs 
to consider 1) frequency of invoking fetch script. 
{quote}
User just need to configure it via configuration and a default value can be 
provided if user doesn't configure. 
{quote}
2) permission of script. 
{quote}
Sorry, I'm not sure what's your point? You mean the execution permission? I 
don't think that would be a problem. Actually the provider don't have to be 
script based.
{quote}
3) a customized provider
{quote}
The implementation of a customized provider will be very simple. User just need 
to implement interface {{NodeLabelsFetcher}}.
{quote}
4) configuration RM classpath to make use of it. 
{quote}
Yes, that's true.
{quote}
Configuration/executing provider script also needs YARN's admin permission.
{quote}
The provider will be part of Resource Manager, we don't need to start up a 
separate process to execute it. 

To clearly express the thoughts, I have uploaded an initial patch. 
Thanks again for your comments.

> Support NodeLabelsProvider at Resource Manager side
> ---------------------------------------------------
>
>                 Key: YARN-3964
>                 URL: https://issues.apache.org/jira/browse/YARN-3964
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Dian Fu
>            Assignee: Dian Fu
>         Attachments: YARN-3964 design doc.pdf, YARN-3964.1.patch
>
>
> Currently, CLI/REST API is provided in Resource Manager to allow users to 
> specify labels for nodes. For labels which may change over time, users will 
> have to start a cron job to update the labels. This has the following 
> limitations:
> - The cron job needs to be run in the YARN admin user.
> - This makes it a little complicate to maintain as users will have to make 
> sure this service/daemon is alive.
> Adding a Node Labels Provider in Resource Manager will provide user more 
> flexibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to