[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895474#comment-15895474 ] Benoy Antony commented on YARN-6285: +1. [~sunilg], If you have time, could you please review? If there are no further review comments, I can commit this on Tuesday. > Add option to set max limit on ResourceManager for > ApplicationClientProtocol.getApplications > > > Key: YARN-6285 > URL: https://issues.apache.org/jira/browse/YARN-6285 > Project: Hadoop YARN > Issue Type: Improvement >Reporter: yunjiong zhao >Assignee: yunjiong zhao > Attachments: YARN-6285.001.patch, YARN-6285.002.patch, > YARN-6285.003.patch > > > When users called ApplicationClientProtocol.getApplications, it will return > lots of data, and generate lots of garbage on ResourceManager which caused > long time GC. > For example, on one of our RM, when called rest API " http:// address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944 > applications. > getApplications have limit parameter, but some user might not set it, and > then the limit will be Long.MAX_VALUE. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications
[
https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895289#comment-15895289
]
Benoy Antony edited comment on YARN-6285 at 3/4/17 12:05 AM:
-
Thanks for the patch, [~zhaoyunjiong].
Few comments:
1.
{code}
public static final long DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS =
DEFAULT_RM_MAX_COMPLETED_APPLICATIONS;
{code}
I think , it's better to keep the _DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS_
independent of _DEFAULT_RM_MAX_COMPLETED_APPLICATIONS_.
If we need to maintain backward compatibility, the default should be
Integer.MAX_VALUE.
I personally think that it should be set to 1000.
2. Please indicate the default value in the property description.
3.
{code}
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit);
{code}
Please indicate that the value is changed to the the max value.
{code}
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit + ". Changing it to " +
maxLimitGetApplications);
{code}
4.
{code}
protected void setMaxLimitGetApplications(long limit)
{code}
Can it be package access instead of protected ?
was (Author: benoyantony):
Thanks for the patch, [~zhaoyunjiong].
Few comments:
1.
{code}
public static final long DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS =
DEFAULT_RM_MAX_COMPLETED_APPLICATIONS;
{code}
I think , it's better to keep the _DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS_
independent of _DEFAULT_RM_MAX_COMPLETED_APPLICATIONS_.
If we need to maintain backward compatibility, the default should be
Integer.MAX_VALUE.
I personally think that it should be set to 1000.
2. Please indicate the default value in the property description.
3.
{code}
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit);
{code}
Please indicate that the value is changed to the the max value.
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit + ". Changing it to " +
maxLimitGetApplications);
{code}
4.
{code}
protected void setMaxLimitGetApplications(long limit)
{code}
Can it be package access instead of protected ?
> Add option to set max limit on ResourceManager for
> ApplicationClientProtocol.getApplications
>
>
> Key: YARN-6285
> URL: https://issues.apache.org/jira/browse/YARN-6285
> Project: Hadoop YARN
> Issue Type: Improvement
>Reporter: yunjiong zhao
>Assignee: yunjiong zhao
> Attachments: YARN-6285.001.patch, YARN-6285.002.patch
>
>
> When users called ApplicationClientProtocol.getApplications, it will return
> lots of data, and generate lots of garbage on ResourceManager which caused
> long time GC.
> For example, on one of our RM, when called rest API " http:// address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944
> applications.
> getApplications have limit parameter, but some user might not set it, and
> then the limit will be Long.MAX_VALUE.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications
[
https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895289#comment-15895289
]
Benoy Antony commented on YARN-6285:
Thanks for the patch, [~zhaoyunjiong].
Few comments:
1.
{code}
public static final long DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS =
DEFAULT_RM_MAX_COMPLETED_APPLICATIONS;
{code}
I think , it's better to keep the _DEFAULT_RM_MAX_LIMIT_GET_APPLICATIONS_
independent of _DEFAULT_RM_MAX_COMPLETED_APPLICATIONS_.
If we need to maintain backward compatibility, the default should be
Integer.MAX_VALUE.
I personally think that it should be set to 1000.
2. Please indicate the default value in the property description.
3.
{code}
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit);
{code}
Please indicate that the value is changed to the the max value.
LOG.info("User " + callerUGI.getUserName() +
" called getApplications with limit=" + limit + ". Changing it to " +
maxLimitGetApplications);
{code}
4.
{code}
protected void setMaxLimitGetApplications(long limit)
{code}
Can it be package access instead of protected ?
> Add option to set max limit on ResourceManager for
> ApplicationClientProtocol.getApplications
>
>
> Key: YARN-6285
> URL: https://issues.apache.org/jira/browse/YARN-6285
> Project: Hadoop YARN
> Issue Type: Improvement
>Reporter: yunjiong zhao
>Assignee: yunjiong zhao
> Attachments: YARN-6285.001.patch, YARN-6285.002.patch
>
>
> When users called ApplicationClientProtocol.getApplications, it will return
> lots of data, and generate lots of garbage on ResourceManager which caused
> long time GC.
> For example, on one of our RM, when called rest API " http:// address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944
> applications.
> getApplications have limit parameter, but some user might not set it, and
> then the limit will be Long.MAX_VALUE.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6254) Provide a mechanism to whitelist the RM REST API clients
[ https://issues.apache.org/jira/browse/YARN-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892954#comment-15892954 ] Benoy Antony commented on YARN-6254: I already have a jira with a patch for this capability via HADOOP-10679. Linking these two jiras. > Provide a mechanism to whitelist the RM REST API clients > > > Key: YARN-6254 > URL: https://issues.apache.org/jira/browse/YARN-6254 > Project: Hadoop YARN > Issue Type: New Feature > Components: resourcemanager >Affects Versions: 2.7.1 >Reporter: Aroop Maliakkal > > Currently RM REST APIs are open to everyone. Can we provide a whitelist > feature so that we can control what frequency and what hosts can hit the RM > REST APIs ? > Thanks, > /Aroop -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Attachment: YARN-2527.patch
Thanks for the code, [~zjshen].
I have updated the patch based on the comment.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Attachment: (was: YARN-2527.patch)
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Attachment: YARN-2527.patch
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157431#comment-14157431
]
Benoy Antony commented on YARN-2527:
Thanks a lot, [~zjshen].
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Fix For: 2.6.0
Attachments: YARN-2527.patch, YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137431#comment-14137431
]
Benoy Antony commented on YARN-2527:
[~zjshen], any comments ?
Since the ACLS are provided by Application Master and , isn't Null a valid
value ?
If not, we could log a warning.
Any other suggestions are welcome.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130383#comment-14130383
]
Benoy Antony commented on YARN-2527:
{code}
this.applicationACLsManager.addApplication(applicationId,
submissionContext.getAMContainerSpec().getApplicationACLs());
{code}
My guess is that
{code}submissionContext.getAMContainerSpec().getApplicationACLs(){code} could
be null for some Application types. (non mapreduce).
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128622#comment-14128622
]
Benoy Antony commented on YARN-2527:
Thank you [~zjshen].
I am investigating on how that happened and will probably open another jira
with the root cause.
But I believe, the NullPointer issue in _ApplicationACLsManager_ should be
fixed regardless of that. Based on the current logic, Admin and application
owner should be able to perform actions on the Application regardless of ACLS.
The NullPointer issue prevents it.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Attachment: YARN-2527.patch
Attaching a new patch. Added one more test case to test the case of partial set
of ACLS.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Assignee: Benoy Antony
Attachments: YARN-2527.patch, YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (YARN-2527) NPE in ApplicationACLsManager
Benoy Antony created YARN-2527:
--
Summary: NPE in ApplicationACLsManager
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127470#comment-14127470
]
Benoy Antony commented on YARN-2527:
working on a patch for this issue.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Description:
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
was:
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoy Antony updated YARN-2527:
---
Attachment: YARN-2527.patch
Attaching a patch which checks if the map of ACLs foran application is null.
If null, it uses the default ACL.
A new test case is added which checks the normal case as well as the case when
the ACLis not set for an application.
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Attachments: YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127755#comment-14127755
]
Benoy Antony commented on YARN-2527:
[~vinodkv], could you please review this jira ?
Could you also make me a Yarn contributor so that I can assign the jira to me?
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Attachments: YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager
[
https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128005#comment-14128005
]
Benoy Antony commented on YARN-2527:
[~zjshen], could you please review this jira ?
Could you also make me a Yarn contributor so that I can assign the jira to me?
NPE in ApplicationACLsManager
-
Key: YARN-2527
URL: https://issues.apache.org/jira/browse/YARN-2527
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager
Affects Versions: 2.5.0
Reporter: Benoy Antony
Attachments: YARN-2527.patch
NPE in _ApplicationACLsManager_ can result in 500 Internal Server Error.
The relevant stacktrace snippet from the ResourceManager logs is as below
{code}
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.security.ApplicationACLsManager.checkAccess(ApplicationACLsManager.java:104)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.AppBlock.render(AppBlock.java:101)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{code}
This issue was reported by [~miguenther].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (YARN-904) Enable multiple QOP for ResourceManager
[ https://issues.apache.org/jira/browse/YARN-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony resolved YARN-904. --- Resolution: Duplicate resolved via HDFS_5910 and HADOOP-10221 Enable multiple QOP for ResourceManager --- Key: YARN-904 URL: https://issues.apache.org/jira/browse/YARN-904 Project: Hadoop YARN Issue Type: Improvement Reporter: Benoy Antony Attachments: yarn-904.patch Currently ResourceManager supports only single QOP. The feature makes ResourceManager listen on two ports for RPC. One RPC port supports only authentication , other RPC port supports privacy. Please see HADOOP-9709 for general requirements. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (YARN-904) Enable multiple QOP for ResourceManager
Benoy Antony created YARN-904: - Summary: Enable multiple QOP for ResourceManager Key: YARN-904 URL: https://issues.apache.org/jira/browse/YARN-904 Project: Hadoop YARN Issue Type: Improvement Reporter: Benoy Antony Currently ResourceManager supports only single QOP. The feature makes ResourceManager listen on two ports for RPC. One RPC port supports only authentication , other RPC port supports privacy. Please see HADOOP-9709 for general requirements. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
