[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802784#comment-13802784 ] Hudson commented on MAPREDUCE-5561: --- FAILURE: Integrated in Hadoop-Yarn-trunk #371 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/371/]) MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla (jlowe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1534832) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Fix For: 3.0.0, 2.3.0, 0.23.10, 2.2.1 Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802812#comment-13802812 ] Hudson commented on MAPREDUCE-5561: --- FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #769 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/769/]) svn merge -c 1534832 FIXES: MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla (jlowe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1534840) * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Fix For: 3.0.0, 2.3.0, 0.23.10, 2.2.1 Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802818#comment-13802818 ] Hudson commented on MAPREDUCE-5561: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1561 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1561/]) MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla (jlowe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1534832) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Fix For: 3.0.0, 2.3.0, 0.23.10, 2.2.1 Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802884#comment-13802884 ] Hudson commented on MAPREDUCE-5561: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1587 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1587/]) MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla (jlowe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1534832) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Fix For: 3.0.0, 2.3.0, 0.23.10, 2.2.1 Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801874#comment-13801874 ] Jason Lowe commented on MAPREDUCE-5561: --- Yes, the test is definitely racy. There's no guarantee the job will be in the FAIL_ABORT state while when we look at it asynchronously. A couple of approaches to fixing this: # As [~kkambatl] points out, we can skip the FAIL_ABORT check. The real purpose of this test is to verify we eventually get to the FAILED state without hanging when tasks fail. # A more deterministic, explicit test for FAIL_ABORT would be to use an output committer with a barrier, similar to TestingOutputCommitter but with the barrier in the abortJob method, so we can guarantee the job will pause in the FAIL_ABORT state. Then we can release the committer from the barrier and verify the job proceeds to failed. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Attachments: org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802280#comment-13802280 ] Akira AJISAKA commented on MAPREDUCE-5561: -- +1, LGTM. I ran the test 3 times and haven't seen it fail. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[
https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802289#comment-13802289
]
Hadoop QA commented on MAPREDUCE-5561:
--
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12609720/mr-5561-1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The test build failed in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4130//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4130//console
This message is automatically generated.
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on
trunk
-
Key: MAPREDUCE-5561
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.2.0
Reporter: Cindy Li
Assignee: Karthik Kambatla
Priority: Critical
Attachments: mr-5561-1.patch,
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec
FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
Time elapsed: 5.507 sec FAILURE!
java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418)
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802357#comment-13802357 ] Jason Lowe commented on MAPREDUCE-5561: --- +1, lgtm. It's a reasonable approach. The test failure is unrelated and most likely caused by something like YARN-1183. I tested the patch locally and it does not fail. I'll commit this shortly. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802390#comment-13802390 ] Hudson commented on MAPREDUCE-5561: --- SUCCESS: Integrated in Hadoop-trunk-Commit #4645 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4645/]) MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla (jlowe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1534832) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestJobImpl.java org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Assignee: Karthik Kambatla Priority: Critical Fix For: 3.0.0, 2.3.0, 0.23.10, 2.2.1 Attachments: mr-5561-1.patch, org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801098#comment-13801098 ] Karthik Kambatla commented on MAPREDUCE-5561: - We see TestJobImpl failing occasionally. As [~ajisakaa] pointed out, it looks like a race. IIUC, the purpose of the test is to ensure entering FAIL_ABORT doesn't hang. Given that we know the job is in FAIL_ABORT, the assert might not be necessary. [~jlowe], [~raviprakash] - thoughts? org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.2.0 Reporter: Cindy Li Priority: Critical Attachments: org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[
https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785715#comment-13785715
]
Akira AJISAKA commented on MAPREDUCE-5561:
--
I reproduced this.
According to the end of the attachment, it seems that CommitterEventHandler had
transitioned jobInternalState from FAIL_ABORT to FAILED before assertion.
{noformat}
2013-10-03 15:17:58,409 INFO [AsyncDispatcher event handler] impl.JobImpl
(JobImpl.java:handle(984)) - job_123456789_0001Job Transitioned from SETUP
to FAIL_ABORT
2013-10-03 15:17:58,409 INFO [CommitterEvent Processor #1]
commit.CommitterEventHandler (CommitterEventHandler.java:run(210)) - Processing
the event EventType: JOB_ABORT
2013-10-03 15:17:58,409 INFO [AsyncDispatcher event handler] impl.JobImpl
(JobImpl.java:handle(984)) - job_123456789_0001Job Transitioned from
FAIL_ABORT to FAILED
{noformat}
I think CommitterEventHandler might be stopped when failing the task and it
start after assertion.
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on
trunk
-
Key: MAPREDUCE-5561
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.1.2-beta
Reporter: Cindy Li
Priority: Critical
Attachments:
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt
Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec
FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
Time elapsed: 5.507 sec FAILURE!
java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418)
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (MAPREDUCE-5561) org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk
[ https://issues.apache.org/jira/browse/MAPREDUCE-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785762#comment-13785762 ] Akira AJISAKA commented on MAPREDUCE-5561: -- The failure doesn't always occur on my environment (Mac OS X 10.8 + Java7). The test often successes but sometimes fails. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk - Key: MAPREDUCE-5561 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5561 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.2-beta Reporter: Cindy Li Priority: Critical Attachments: org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl-output.txt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 9.029 sec FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testFailAbortDoesntHang(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.507 sec FAILURE! java.lang.AssertionError: expected:FAIL_ABORT but was:FAILED at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:817) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testFailAbortDoesntHang(TestJobImpl.java:418) -- This message was sent by Atlassian JIRA (v6.1#6144)
