[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842186#comment-13842186
]
Hudson commented on YARN-1450:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #414 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/414/])
YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its
dependency on distributed-shell. Contributed by Binglin Chang. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1548619)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Fix For: 2.4.0
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch, YARN-1450.v5.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842218#comment-13842218
]
Hudson commented on YARN-1450:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #1605 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1605/])
YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its
dependency on distributed-shell. Contributed by Binglin Chang. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1548619)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Fix For: 2.4.0
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch, YARN-1450.v5.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842236#comment-13842236
]
Hudson commented on YARN-1450:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1631 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1631/])
YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its
dependency on distributed-shell. Contributed by Binglin Chang. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1548619)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Fix For: 2.4.0
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch, YARN-1450.v5.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841487#comment-13841487
]
Hudson commented on YARN-1450:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #4845 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/4845/])
YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its
dependency on distributed-shell. Contributed by Binglin Chang. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1548619)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/pom.xml
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/java/org/apache/hadoop/yarn/applications/unmanagedamlauncher/TestUnmanagedAMLauncher.java
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Fix For: 2.4.0
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch, YARN-1450.v5.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840863#comment-13840863
]
Vinod Kumar Vavilapalli commented on YARN-1450:
---
bq. 1. What is the usage of UnmanagedAM? Support new special apps which need a
local AM or support all apps? If the later it is far from complete, so either
disable this test or writeuse a simple AM in test.
UnmanagedAM application was written to help developers debug their YARN
applications/frameworks by running AM on the client machine.
bq. 2. Is distributedshell.ApplicationMaster not supposed to be launched
standalone and must only be called by distributedshell.Client?
Not every AM ever runs by itself. More often than not, client sets up
something, then submits an app to the RM which then starts the AM. In case of
unmanaged AM, the flow should be similar, client sets up stuff, then submits
the app but runs the AM locally. It's the part about client setting up stuff
that is missing today and that IMO needs fixing.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840945#comment-13840945
]
Hadoop QA commented on YARN-1450:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12617330/YARN-1450.v5.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/2610//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2610//console
This message is automatically generated.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch, YARN-1450.v5.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839061#comment-13839061
]
Hadoop QA commented on YARN-1450:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12617005/YARN-1450.v4.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/2597//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2597//console
This message is automatically generated.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch, YARN-1450.v4.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837400#comment-13837400
]
Binglin Chang commented on YARN-1450:
-
Hi Vinod,
Thanks for the explanation, I think I am confused about the propose of
UnmanagedAM, the document of UnmanagedAM says:
bq. The UnmanagedLauncher is a simple client that launches and unmanaged AM. An
unmanagedAM is an AM that is not launched and managed by the RM.
I thought it is used as a tool, new apps can use this to launch AM locally
without create/start YarnClient. If old apps have a workable standalone AM, it
can be launched by this tool too. I did not consider it as a tool to launch old
client based apps, of course it will fail if it is used to launch arbitrarily
old apps. Which leads to the question:
1. What is the usage of UnmanagedAM? Support new special apps which need a
local AM or support all apps? If the later it is far from complete, so either
disable this test or writeuse a simple AM in test.
2. Is distributedshell.ApplicationMaster not supposed to be launched standalone
and must only be called by distributedshell.Client?
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833984#comment-13833984
]
Hadoop QA commented on YARN-1450:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12616079/YARN-1450.v1.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2547//console
This message is automatically generated.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834335#comment-13834335
]
Xuan Gong commented on YARN-1450:
-
[~decster] Thanks for taking this ticket.
Your solution can definitely solve the test case failure. But I do no think it
is the proper solution.
The ticket YARN-1303 is used to solve the issue that we can not allow multiple
commands separating with ; in distributed-shell. The reason why we can not do
that, you might need to check the comments at YARN-1303.
So, if we launch the AM with --shell_command, we will meet the same issue as
before (can not allow multiple commands separating with ; or |). Right ?
So, we may need to stick to the same solution as YARN-1303, create a file to
save the shell_command, and let AM find out whether this file exists or not.
We can either try to parse the cmd from --cmd option, to figure out which part
is --shell_command, and pull all the commands into a file. But this solution
may not be stable, since we need to get all the characters between
--shell_command and the next --. And it can be easily break.
The simplest but a little bit tedious solution could be that we just add all
the options that AM can support including --shell_command, --shell_args,
--shell_scripts and --log4j_properties , excluding --cmd option into
UnmanagedAMLaucher, and handle them as we did in
org.apache.hadoop.yarn.applications.distributedshell.Client.
thoughts ?
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834382#comment-13834382
]
Binglin Chang commented on YARN-1450:
-
bq. So, if we launch the AM with --shell_command, we will meet the same issue
as before (can not allow multiple commands separating with ; or |). Right ?
Actually there is no issue, the AM is started standalone(no client - RM - NM
- launch AM), we don't need to care about escaping/unescaping issues, allow
multiple commands separating with ;, ;, | or env variable should be fine.
There is nothing wrong about --shell_command, anything you can write to a file
you can pass with cmdline, the issue in YARN-1303 is cuased by client try to
construct a whole cmd without proper escaping support.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834389#comment-13834389
]
Hadoop QA commented on YARN-1450:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12616159/YARN-1450.v2.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2552//console
This message is automatically generated.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834399#comment-13834399
]
Xuan Gong commented on YARN-1450:
-
Let us take a look at an example:
This is the cmd we are giving:
JAVA_HOME /bin/java -Xmx512m
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
--shell_command pwd;ls --num_containers 5
because of ; in the shell_command we are giving, the actual cmd launched for
AM will become JAVA_HOME /bin/java -Xmx512m
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
--shell_command pwd.
Then AM will launch the container with --shell_command pwd.
Apparently, the container gets the wrong shell_command. Right ??
If we save --shell_command into a file, then the command launch for AM will
become:
JAVA_HOME /bin/java -Xmx512m
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
--num_containers 5.
Then AM can read shell_command back from the file, and launch 5 containers with
shell_command pwd;ls.
Of course, the container will not get expect result. But What we are doing here
is let containers launch exact the same shell_commands that the clients give us.
Make sense ?
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834410#comment-13834410
]
Binglin Chang commented on YARN-1450:
-
bq. JAVA_HOME /bin/java -Xmx512m
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
--shell_command pwd;ls --num_containers 5
if you pass this to current distshell client, it will fail too, like your final
example in
YARN-1303[https://issues.apache.org/jira/browse/YARN-1303?focusedCommentId=13828462page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13828462],
you should call:
JAVA_HOME /bin/java -Xmx512m
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster
--shell_command pwd;ls --num_containers 5
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834414#comment-13834414
]
Binglin Chang commented on YARN-1450:
-
bq. Seems like the patch is undoing what YARN-1303 did - shouldn't be doing
that.
This is not the undoing of YARN-1303, I just add another option so some
application need to call distshell.AppMaster directly can use. it is fine that
Distshell.Client can not benefit from it.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834424#comment-13834424
]
Binglin Chang commented on YARN-1450:
-
Let me state the problem more clearly:
Story in YARN-1303:
1. Client accept --shell_command pwd;ls
2. Client can not construct a whole cmdline with proper escape support if
shell_command contains special chars like ;, so it write the pwd;ls to file
instead
3. AM started, read shell_command from file, get pwd;ls
Story in this jira YARN-1450:
1. some app directly launch AM without client, AM directly accept
--shell_command pwd;ls
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834496#comment-13834496
]
Hadoop QA commented on YARN-1450:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12616189/YARN-1450.v3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/2559//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2559//console
This message is automatically generated.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834498#comment-13834498
]
Binglin Chang commented on YARN-1450:
-
The failed test TestUnmanagedAMLauncher#testDSShell can cover this code, so I
think new test case is not needed.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications/distributed-shell
Reporter: Akira AJISAKA
Assignee: Binglin Chang
Attachments: YARN-1450.v1.patch, YARN-1450.v2.patch,
YARN-1450.v3.patch,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher-output.txt,
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.txt
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1388#comment-1388
]
Akira AJISAKA commented on YARN-1450:
-
I'll attach the log which I reproduced because the above link became old.
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications
Reporter: Akira AJISAKA
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk
[
https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832302#comment-13832302
]
Akira AJISAKA commented on YARN-1450:
-
You can see more logs at
[Jenkins|https://builds.apache.org/job/Hadoop-Yarn-trunk/ws/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/target/surefire-reports/].
TestUnmanagedAMLauncher#testDSShell fails on trunk
--
Key: YARN-1450
URL: https://issues.apache.org/jira/browse/YARN-1450
Project: Hadoop YARN
Issue Type: Bug
Components: applications
Reporter: Akira AJISAKA
Fix For: 3.0.0
TestUnmanagedAMLauncher fails on trunk. The console output is
{code}
Running
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 35.937 sec
FAILURE! - in
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher
testDSShell(org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher)
Time elapsed: 14.558 sec ERROR!
java.lang.RuntimeException: Failed to receive final expected state in
ApplicationReport, CurrentState=ACCEPTED,
ExpectedStates=FINISHED,FAILED,KILLED
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.monitorApplication(UnmanagedAMLauncher.java:447)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:352)
at
org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:145)
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
