[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952141#comment-14952141
]
Karthik Kambatla commented on YARN-1550:
Just verified the fix was committed to trunk, branch-2, branch-2.5, and
branch-2.5.1. What makes you think the fix wasn't committed? Is it possible
there is another issue? Could you post logs from when you ran into this?
> NPE in FairSchedulerAppsBlock#render
>
>
> Key: YARN-1550
> URL: https://issues.apache.org/jira/browse/YARN-1550
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
>Affects Versions: 2.2.0
>Reporter: caolong
>Assignee: Anubhav Dhoot
>Priority: Critical
> Fix For: 2.5.0
>
> Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
> YARN-1550.003.patch, YARN-1550.patch
>
>
> three Steps :
> 1、debug at RMAppManager#submitApplication after code
> if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
> null) {
> String message = "Application with id " + applicationId
> + " is already present! Cannot add a duplicate!";
> LOG.warn(message);
> throw RPCUtil.getRemoteException(message);
> }
> 2、submit one application:hadoop jar
> ~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
> sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
> -r 1
> 3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
> the log:
> {noformat}
> 2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
> handling URI: /cluster/scheduler
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941191#comment-14941191
]
Michael England commented on YARN-1550:
---
I have hit this issue in Hadoop 2.5.1 - I am guessing this fix was never
committed into the master branch?
> NPE in FairSchedulerAppsBlock#render
>
>
> Key: YARN-1550
> URL: https://issues.apache.org/jira/browse/YARN-1550
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
>Affects Versions: 2.2.0
>Reporter: caolong
>Assignee: Anubhav Dhoot
>Priority: Critical
> Fix For: 2.5.0
>
> Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
> YARN-1550.003.patch, YARN-1550.patch
>
>
> three Steps :
> 1、debug at RMAppManager#submitApplication after code
> if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
> null) {
> String message = "Application with id " + applicationId
> + " is already present! Cannot add a duplicate!";
> LOG.warn(message);
> throw RPCUtil.getRemoteException(message);
> }
> 2、submit one application:hadoop jar
> ~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
> sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
> -r 1
> 3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
> the log:
> {noformat}
> 2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
> handling URI: /cluster/scheduler
> java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016408#comment-14016408
]
Hudson commented on YARN-1550:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #572 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/572/])
YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
(kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1599345)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/FairSchedulerAppsBlock.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebAppFairScheduler.java
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.5.0
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016626#comment-14016626
]
Hudson commented on YARN-1550:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #1763 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1763/])
YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
(kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1599345)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/FairSchedulerAppsBlock.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebAppFairScheduler.java
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.5.0
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016813#comment-14016813
]
Hudson commented on YARN-1550:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1790 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1790/])
YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
(kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1599345)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/FairSchedulerAppsBlock.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebAppFairScheduler.java
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.5.0
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015439#comment-14015439
]
Karthik Kambatla commented on YARN-1550:
Actually, I run into the following NPE when running the new test locally.
[~adhoot] - can you please take a look, it might be other changes that went in
the interim?
{noformat}
java.lang.NullPointerException: null
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.ClusterMetricsInfo.init(ClusterMetricsInfo.java:65)
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.MetricsOverviewTable.render(MetricsOverviewTable.java:58)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
{noformat}
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.002.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015798#comment-14015798
]
Hadoop QA commented on YARN-1550:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12647960/YARN-1550.003.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3889//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3889//console
This message is automatically generated.
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015844#comment-14015844
]
Karthik Kambatla commented on YARN-1550:
Thanks Anubhav. +1. Committing this shortly.
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015870#comment-14015870
]
Hudson commented on YARN-1550:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #5643 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/5643/])
YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
(kasha: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1599345)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/FairSchedulerAppsBlock.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebAppFairScheduler.java
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Assignee: Anubhav Dhoot
Priority: Critical
Fix For: 2.5.0
Attachments: YARN-1550.001.patch, YARN-1550.002.patch,
YARN-1550.003.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014370#comment-14014370
]
Hadoop QA commented on YARN-1550:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12647711/YARN-1550.002.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3870//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3870//console
This message is automatically generated.
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.002.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002406#comment-14002406
]
Anubhav Dhoot commented on YARN-1550:
-
Manually tested by commenting out the line that triggers the START transition
in RMAppManager submitApplication. This ensures the app is in NEW and without a
currentAttempt causing the null ref reported (which is now at line 111).
this.rmContext.getDispatcher().getEventHandler().handle(new
RMAppEvent(applicationId, RMAppEventType.START));
Before fix the web page skips rendering the FairScheduler block (some other
code path is catching exceptions so that the originally reported 500 does not
show up). After the fix the FairScheduler block renders with no apps listed.
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14000434#comment-14000434
]
Hadoop QA commented on YARN-1550:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12645277/YARN-1550.001.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3756//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3756//console
This message is automatically generated.
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.001.patch, YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-1550) NPE in FairSchedulerAppsBlock#render
[
https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997742#comment-13997742
]
Karthik Kambatla commented on YARN-1550:
The patch doesn't apply anymore. [~fengshen] - mind updating the patch against
latest trunk?
NPE in FairSchedulerAppsBlock#render
Key: YARN-1550
URL: https://issues.apache.org/jira/browse/YARN-1550
Project: Hadoop YARN
Issue Type: Bug
Components: scheduler
Affects Versions: 2.2.0
Reporter: caolong
Priority: Critical
Fix For: 2.2.1
Attachments: YARN-1550.patch
three Steps :
1、debug at RMAppManager#submitApplication after code
if (rmContext.getRMApps().putIfAbsent(applicationId, application) !=
null) {
String message = Application with id + applicationId
+ is already present! Cannot add a duplicate!;
LOG.warn(message);
throw RPCUtil.getRemoteException(message);
}
2、submit one application:hadoop jar
~/hadoop-current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-ydh2.2.0-tests.jar
sleep -Dhadoop.job.ugi=test2,#11 -Dmapreduce.job.queuename=p1 -m 1 -mt 1
-r 1
3、go in page :http://ip:50030/cluster/scheduler and find 500 ERROR！
the log:
{noformat}
2013-12-30 11:51:43,795 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error
handling URI: /cluster/scheduler
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.render(FairSchedulerAppsBlock.java:96)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:66)
at
org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:76)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
