[jira] [Commented] (YARN-6254) Provide a mechanism to whitelist the RM REST API clients

2017-03-02 Thread Benoy Antony (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892954#comment-15892954
 ] 

Benoy Antony commented on YARN-6254:


I already have a jira with a patch for this capability via HADOOP-10679. 
Linking these two jiras.

> Provide a mechanism to whitelist the RM REST API clients
> 
>
> Key: YARN-6254
> URL: https://issues.apache.org/jira/browse/YARN-6254
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: resourcemanager
>Affects Versions: 2.7.1
>Reporter: Aroop Maliakkal
>
> Currently RM REST APIs are open to everyone. Can we provide a whitelist 
> feature so that we can control what frequency and what hosts can hit the RM 
> REST APIs ?
> Thanks,
> /Aroop



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6254) Provide a mechanism to whitelist the RM REST API clients

2017-03-01 Thread Allen Wittenauer (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891400#comment-15891400
 ] 

Allen Wittenauer commented on YARN-6254:


Hosts should be able to be controlled via the Service Level Authorization hook. 
 See 
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/ServiceLevelAuth.html
 for more info.

> Provide a mechanism to whitelist the RM REST API clients
> 
>
> Key: YARN-6254
> URL: https://issues.apache.org/jira/browse/YARN-6254
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: resourcemanager
>Affects Versions: 2.7.1
>Reporter: Aroop Maliakkal
>
> Currently RM REST APIs are open to everyone. Can we provide a whitelist 
> feature so that we can control what frequency and what hosts can hit the RM 
> REST APIs ?
> Thanks,
> /Aroop



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6254) Provide a mechanism to whitelist the RM REST API clients

2017-02-28 Thread yunjiong zhao (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889706#comment-15889706
 ] 

yunjiong zhao commented on YARN-6254:
-

Reduce yarn.resourcemanager.max-completed-applications from default value 1 
 to a small value like 500 should solve the problem.

> Provide a mechanism to whitelist the RM REST API clients
> 
>
> Key: YARN-6254
> URL: https://issues.apache.org/jira/browse/YARN-6254
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: resourcemanager
>Affects Versions: 2.7.1
>Reporter: Aroop Maliakkal
>
> Currently RM REST APIs are open to everyone. Can we provide a whitelist 
> feature so that we can control what frequency and what hosts can hit the RM 
> REST APIs ?
> Thanks,
> /Aroop



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-6254) Provide a mechanism to whitelist the RM REST API clients

2017-02-28 Thread Aroop Maliakkal (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889500#comment-15889500
 ] 

Aroop Maliakkal commented on YARN-6254:
---

Here is the symptom of this issue what we are seeing :-

We have some customers who crawls the resourcemanager REST APIs for monitoring 
and workflow purposes . Given that these resourcemanager responses are pretty 
heavy (in our case, /v1/cluster/apps is throwing around 300M of size_download 
data), we feel it is critical to have some kind of governance with platform 
team to control who all can access these REST APIs.

{quote}hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 
18:08:01,484 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Size of 
event-queue is 312000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,484 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 313000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 314000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 315000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 316000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 317000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 318000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 319000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 32
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 32
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 321000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,485 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 322000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,486 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 323000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 324000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 324000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 325000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 326000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 327000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 328000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 329000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 33
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 331000
hadoop-hadoop-resourcemanager.log.2017-02-24-18.gz:2017-02-24 18:08:01,487 INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Size of event-queue is 332000
{quote}

> Provide a mechanism to whitelist the RM REST API clients
> 
>
> Key: YARN-6254
> URL: https://issues.apache.org/jira/browse/YARN-6254
> Project: Hadoop YARN
>  Issue Type: New Feature
>  Components: resourcemanager
>Affects Versions: 2.7.1
>Reporter: Aroop Maliakkal
>
> Currently RM REST APIs are open to everyone. Can we provide a whitelist 
> feature so that we can control what frequency and what hosts can hit the RM 
> REST APIs ?
> Thanks,
> /Aroop



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)