Hadoop-Mapreduce-trunk - Build # 2030 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2030/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 31003 lines...] Tests in error: TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:107 ยป IO Jo... Tests run: 519, Failures: 0, Errors: 1, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ... SUCCESS [ 2.663 s] [INFO] hadoop-mapreduce-client-core .. SUCCESS [01:48 min] [INFO] hadoop-mapreduce-client-common SUCCESS [ 31.430 s] [INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [ 4.573 s] [INFO] hadoop-mapreduce-client-app ... SUCCESS [11:47 min] [INFO] hadoop-mapreduce-client-hs SUCCESS [05:56 min] [INFO] hadoop-mapreduce-client-jobclient . FAILURE [ 01:42 h] [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED [INFO] hadoop-mapreduce-client-nativetask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:02 h [INFO] Finished at: 2015-01-20T15:28:08+00:00 [INFO] Final Memory: 31M/609M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2029 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20272569 bytes Compression is 0.0% Took 6.7 sec Recording test results Updating HDFS-5631 Updating HADOOP-10668 Updating HADOOP-11489 Updating HDFS-7637 Updating HDFS-7638 Updating YARN-2933 Updating YARN-3015 Updating HDFS-7640 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. REGRESSION: org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled Error Message: Job didn't finish in 30 seconds Stack Trace: java.io.IOException: Job didn't finish in 30 seconds at org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622) at org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled(TestMRTimelineEventHandling.java:107)
Hadoop-Mapreduce-trunk-Java8 - Build # 80 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/80/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10482 lines...] TestCombineFileInputFormat.testSplitPlacementForCompressedFiles:911 expected:2 but was:1 TestCombineFileInputFormat.testSplitPlacement:368 expected:2 but was:1 Tests run: 519, Failures: 2, Errors: 0, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ... SUCCESS [ 2.062 s] [INFO] hadoop-mapreduce-client-core .. SUCCESS [01:15 min] [INFO] hadoop-mapreduce-client-common SUCCESS [ 25.500 s] [INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [ 3.752 s] [INFO] hadoop-mapreduce-client-app ... SUCCESS [12:05 min] [INFO] hadoop-mapreduce-client-hs SUCCESS [06:07 min] [INFO] hadoop-mapreduce-client-jobclient . FAILURE [ 01:42 h] [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED [INFO] hadoop-mapreduce-client-nativetask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] hadoop-mapreduce .. SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:02 h [INFO] Finished at: 2015-01-20T15:09:56+00:00 [INFO] Final Memory: 31M/185M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #28 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20279497 bytes Compression is 0.0% Took 6.5 sec Recording test results Updating HDFS-5631 Updating HADOOP-10668 Updating HADOOP-11489 Updating HDFS-7637 Updating HDFS-7638 Updating YARN-2933 Updating YARN-3015 Updating HDFS-7640 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 2 tests failed. FAILED: org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacementForCompressedFiles Error Message: expected:2 but was:1 Stack Trace: junit.framework.AssertionFailedError: expected:2 but was:1 at junit.framework.Assert.fail(Assert.java:57) at junit.framework.Assert.failNotEquals(Assert.java:329) at junit.framework.Assert.assertEquals(Assert.java:78) at junit.framework.Assert.assertEquals(Assert.java:234) at junit.framework.Assert.assertEquals(Assert.java:241) at junit.framework.TestCase.assertEquals(TestCase.java:409) at org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacementForCompressedFiles(TestCombineFileInputFormat.java:911) FAILED: org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacement Error Message: expected:2 but was:1 Stack Trace: junit.framework.AssertionFailedError: expected:2 but was:1 at junit.framework.Assert.fail(Assert.java:57) at junit.framework.Assert.failNotEquals(Assert.java:329) at junit.framework.Assert.assertEquals(Assert.java:78) at junit.framework.Assert.assertEquals(Assert.java:234) at junit.framework.Assert.assertEquals(Assert.java:241) at junit.framework.TestCase.assertEquals(TestCase.java:409) at org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testSplitPlacement(TestCombineFileInputFormat.java:368)
[jira] [Created] (MAPREDUCE-6219) Reduce memory required for FileInputFormat located status optimization
Jason Lowe created MAPREDUCE-6219: - Summary: Reduce memory required for FileInputFormat located status optimization Key: MAPREDUCE-6219 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6219 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.1-beta Reporter: Jason Lowe Priority: Minor MAPREDUCE-1981 introduced an optimization to drastically reduce the number of namenode operations required to compute input splits when processing a directory. However it requires more memory to perform this optimization as it retains the full LocatedFileStatus object for all input files while computing the splits. This can lead to odd situations for users where using a directory as input can run the job client out of heap space but using directory/* as the input spec allows it to run within the original heap space. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
