[jira] [Created] (MAPREDUCE-3807) JobTracker needs fix similar to HDFS-94
JobTracker needs fix similar to HDFS-94
---
Key: MAPREDUCE-3807
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3807
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 1.0.0
Reporter: Harsh J
1.0 JobTracker's jobtracker.jsp page currently shows:
{code}
Cluster Summary (Heap Size is <%=
StringUtils.byteDesc(Runtime.getRuntime().totalMemory()) %>/<%=
StringUtils.byteDesc(Runtime.getRuntime().maxMemory()) %>)
{code}
It could use an improvement same as HDFS-94 to reflect live heap usage more
accurately.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3806) [Gridmix] TestGridmixSubmission fails due to incorrect version of jackson
[Gridmix] TestGridmixSubmission fails due to incorrect version of jackson
-
Key: MAPREDUCE-3806
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3806
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/gridmix
Affects Versions: 0.24.0
Reporter: Amar Kamat
Fix For: 0.24.0
{{TestGridmixSubmission}} fails with the following error
{code}
org.codehaus.jackson.type.JavaType.isMapLikeType()Z
java.lang.NoSuchMethodError: org.codehaus.jackson.type.JavaType.isMapLikeType()Z
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createDeserializer(StdDeserializerProvider.java:374)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCache2(StdDeserializerProvider.java:307)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCacheValueDeserializer(StdDeserializerProvider.java:287)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider.findValueDeserializer(StdDeserializerProvider.java:136)
at
org.codehaus.jackson.map.deser.StdDeserializer.findDeserializer(StdDeserializer.java:551)
at
org.codehaus.jackson.map.deser.BeanDeserializer.resolve(BeanDeserializer.java:268)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._resolveDeserializer(StdDeserializerProvider.java:404)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCache2(StdDeserializerProvider.java:349)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider._createAndCacheValueDeserializer(StdDeserializerProvider.java:287)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider.findValueDeserializer(StdDeserializerProvider.java:136)
at
org.codehaus.jackson.map.deser.StdDeserializerProvider.findTypedValueDeserializer(StdDeserializerProvider.java:157)
at
org.codehaus.jackson.map.ObjectMapper._findRootDeserializer(ObjectMapper.java:2468)
at
org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2383)
at
org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1094)
at
org.apache.hadoop.tools.rumen.JsonObjectMapperParser.getNext(JsonObjectMapperParser.java:84)
at
org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:117)
at
org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:29)
at
org.apache.hadoop.mapred.gridmix.TestGridmixSubmission.testTraceReader(TestGridmixSubmission.java:440)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-trunk-Commit - Build # 1672 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1672/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14457 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.794 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.371 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.23 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.515 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.307 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.663 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.768 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.039 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.475 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.98 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.1 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.366 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 103.564 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:778: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:741: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:802: Tests failed! Total time: 5 min
Hadoop-Mapreduce-trunk-Commit - Build # 1670 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1670/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14458 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.76 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.438 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.259 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.417 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.361 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.669 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.768 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.036 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.339 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.836 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.048 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.291 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 102.546 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:778: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:741: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build.xml:802: Tests failed! Total time: 5 minutes 51 seconds Build step 'Execute shell' marked build as failure Recording test results Updating HDFS-2889 Updating HDFS-2408 Updating MAPREDUCE-3711 Email was triggered for: Failure Sending email for trigger: Failure
[jira] [Resolved] (MAPREDUCE-3797) lGridMix fails to Run with NPE with latest branch-0.23 code
[ https://issues.apache.org/jira/browse/MAPREDUCE-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-3797. Resolution: Duplicate This is a duplicate of MAPREDUCE-3770. Karam, I am closing this and marking MAPREDUCE-3770 for 0.23. I am also adding you to the watch list there. > lGridMix fails to Run with NPE with latest branch-0.23 code > --- > > Key: MAPREDUCE-3797 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3797 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/gridmix, tools/rumen >Affects Versions: 0.23.1 >Reporter: Karam Singh > Fix For: 0.23.1 > > > GridMix fails to start trowing NPE after gendata -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-0.23-Commit - Build # 495 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/495/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14272 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.676 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.235 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.265 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.468 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.22 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.676 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.737 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.033 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.37 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.939 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 1.994 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 118.339 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 102.567 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:778: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:741: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:802: Tests failed! Total time: 5 minutes 50 seconds Build step 'Execute shell' marked build as failure Recording test results Updating HDFS-2889 Updating MAPREDUCE-3711 Updating HDFS-2408 Email was triggered for: Failure Sending email for trigger: Failure ### ###
Hadoop-Mapreduce-0.23-Commit - Build # 494 - Failure
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/494/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 39331 lines...] [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/cache [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/concat run-commit-test: [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/data [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/logs [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/extraconf [junit] Running org.apache.hadoop.mapred.TestJobHistoryParsing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.764 sec [junit] Running org.apache.hadoop.mapred.TestJobInProgress [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.173 sec [junit] Running org.apache.hadoop.mapred.TestJobQueueTaskScheduler [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.207 sec [junit] Running org.apache.hadoop.mapred.TestKillCompletedJob [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.438 sec [junit] Running org.apache.hadoop.mapred.TestLostTracker [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.313 sec [junit] Running org.apache.hadoop.mapred.TestQueueAclsForCurrentUser [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.67 sec [junit] Running org.apache.hadoop.mapred.TestRackAwareTaskPlacement [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.808 sec [junit] Running org.apache.hadoop.mapred.TestSeveral [junit] Tests run: 0, Failures: 0, Errors: 0, Time elapsed: 0.033 sec [junit] Running org.apache.hadoop.mapred.TestSpeculativeExecution [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 4.286 sec [junit] Running org.apache.hadoop.mapred.TestTaskLimits [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.933 sec [junit] Running org.apache.hadoop.mapred.TestTaskTrackerBlacklisting [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 2.069 sec [junit] Running org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 117.404 sec [junit] Test org.apache.hadoop.mapred.TestTrackerBlacklistAcrossJobs FAILED [junit] Running org.apache.hadoop.mapreduce.TestMapReduceLocal [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 102.273 sec [junit] Test org.apache.hadoop.mapreduce.TestMapReduceLocal FAILED checkfailure: [touch] Creating /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build/test/testsfailed BUILD FAILED /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:778: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:741: The following error occurred while executing this line: /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Commit/trunk/hadoop-mapreduce-project/build.xml:802: Tests failed! Total time: 5 minutes 54 seconds Build step 'Execute shell' marked build as failure Recording test results Updating HADOOP-8013 Updating MAPREDUCE-3727 Email was triggered for: Fai
[jira] [Created] (MAPREDUCE-3805) MR AM not respecting MaxReduceRampUpLimit
MR AM not respecting MaxReduceRampUpLimit - Key: MAPREDUCE-3805 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3805 Project: Hadoop Map/Reduce Issue Type: Bug Components: mr-am, mrv2 Affects Versions: 0.23.0 Reporter: Vinod Kumar Vavilapalli Fix For: 0.23.1 While running GridMixV3 with high memory reduces, we ran into issues where for jobs with significant number of maps and reduces, when the map progress hits 98-99% but still there are maps pending, reduces get every new container that RM allocates. And the job takes much longer time than with usual reduces. For addressing precisely these issues, a configurable limit was introduced to limit the reduce ramp up. Unfortunately this limit is not working correctly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3804) yarn webapp interface vulnerable to cross scripting attacks
yarn webapp interface vulnerable to cross scripting attacks --- Key: MAPREDUCE-3804 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3804 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobhistoryserver, resourcemanager Affects Versions: 0.23.0 Reporter: Dave Thompson Assignee: Dave Thompson Fix For: 0.23.1 Yarn webapp interface may be vulnerable to certain cross scripting attacks, injected through URL request. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3802) If an MR AM dies twice it looks like the process freezes
If an MR AM dies twice it looks like the process freezes
-
Key: MAPREDUCE-3802
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3802
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: applicationmaster, mrv2
Affects Versions: 0.23.1, 0.24.0
Reporter: Robert Joseph Evans
It looks like recovering from an RM AM dieing works very well on a single
failure. But if it fails multiple times we appear to get into a live lock
situation.
{noformat}
yarn jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-*-SNAPSHOT.jar
wordcount -Dyarn.app.mapreduce.am.log.level=DEBUG -Dmapreduce.job.reduces=30
input output
12/02/03 21:06:57 WARN conf.Configuration: fs.default.name is deprecated.
Instead, use fs.defaultFS
12/02/03 21:06:57 WARN conf.Configuration: mapred.used.genericoptionsparser is
deprecated. Instead, use mapreduce.client.genericoptionsparser.used
12/02/03 21:06:57 INFO input.FileInputFormat: Total input paths to process : 17
12/02/03 21:06:57 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/02/03 21:06:57 WARN snappy.LoadSnappy: Snappy native library not loaded
12/02/03 21:06:57 INFO mapreduce.JobSubmitter: number of splits:17
12/02/03 21:06:57 INFO mapred.ResourceMgrDelegate: Submitted application
application_1328302034486_0003 to ResourceManager at HOST/IP:8040
12/02/03 21:06:57 INFO mapreduce.Job: The url to track the job:
http://HOST:8088/proxy/application_1328302034486_0003/
12/02/03 21:06:57 INFO mapreduce.Job: Running job: job_1328302034486_0003
12/02/03 21:07:03 INFO mapreduce.Job: Job job_1328302034486_0003 running in
uber mode : false
12/02/03 21:07:03 INFO mapreduce.Job: map 0% reduce 0%
12/02/03 21:07:09 INFO mapreduce.Job: map 5% reduce 0%
12/02/03 21:07:10 INFO mapreduce.Job: map 17% reduce 0%
#KILLED AM with kill -9 here
12/02/03 21:07:16 INFO mapreduce.Job: map 29% reduce 0%
12/02/03 21:07:17 INFO mapreduce.Job: map 35% reduce 0%
12/02/03 21:07:30 INFO mapreduce.Job: map 52% reduce 0%
12/02/03 21:07:35 INFO mapreduce.Job: map 58% reduce 0%
12/02/03 21:07:37 INFO mapreduce.Job: map 70% reduce 0%
12/02/03 21:07:41 INFO mapreduce.Job: map 76% reduce 0%
12/02/03 21:07:43 INFO mapreduce.Job: map 82% reduce 0%
12/02/03 21:07:44 INFO mapreduce.Job: map 88% reduce 0%
12/02/03 21:07:47 INFO mapreduce.Job: map 94% reduce 0%
12/02/03 21:07:49 INFO mapreduce.Job: map 100% reduce 0%
12/02/03 21:07:53 INFO mapreduce.Job: map 100% reduce 3%
12/02/03 21:08:00 INFO mapreduce.Job: map 100% reduce 6%
12/02/03 21:08:06 INFO mapreduce.Job: map 100% reduce 10%
12/02/03 21:08:12 INFO mapreduce.Job: map 100% reduce 13%
12/02/03 21:08:18 INFO mapreduce.Job: map 100% reduce 16%
#killed AM with kill -9 here
12/02/03 21:08:20 INFO ipc.Client: Retrying connect to server: HOST/IP:44223.
Already tried 0 time(s).
12/02/03 21:08:21 INFO ipc.Client: Retrying connect to server: HOST/IP:44223.
Already tried 1 time(s).
12/02/03 21:08:22 INFO ipc.Client: Retrying connect to server: HOST/IP:44223.
Already tried 2 time(s).
12/02/03 21:08:26 INFO mapreduce.Job: map 64% reduce 16%
#It never makes any more progress...
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators,testExponentialEstimator fails intermittently
org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators,testExponentialEstimator fails intermittently -- Key: MAPREDUCE-3801 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3801 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: 0.24.0 Reporter: Robert Joseph Evans org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators,testExponentialEstimator fails intermittently -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3800) TestHarFileSystem testRelativeArchives
TestHarFileSystem testRelativeArchives -- Key: MAPREDUCE-3800 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3800 Project: Hadoop Map/Reduce Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Ravi Prakash *Error Message* failed test *Stacktrace* junit.framework.AssertionFailedError: failed test at org.apache.hadoop.tools.TestHarFileSystem.testRelativeArchives(TestHarFileSystem.java:227) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3799) TestServiceLevelAuthorization testServiceLevelAuthorization failing
TestServiceLevelAuthorization testServiceLevelAuthorization failing --- Key: MAPREDUCE-3799 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3799 Project: Hadoop Map/Reduce Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Ravi Prakash *Error Message* Expected file distcache not found *Stacktrace* junit.framework.AssertionFailedError: Expected file distcache not found at org.apache.hadoop.mapred.TestMiniMRWithDFS.verifyContents(TestMiniMRWithDFS.java:200) at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:149) at org.apache.hadoop.mapred.TestMiniMRWithDFS.runWordCount(TestMiniMRWithDFS.java:240) at org.apache.hadoop.security.authorize.TestServiceLevelAuthorization.testServiceLevelAuthorization(TestServiceLevelAuthorization.java:95) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3798) TestJobCleanup testCustomCleanup is failing
TestJobCleanup testCustomCleanup is failing --- Key: MAPREDUCE-3798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3798 Project: Hadoop Map/Reduce Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Ravi Prakash File /hadoop-mapreduce-project/build/test/data/test-job-cleanup/output-8/_custom_cleanup missing for job job_20120203035807432_0009 junit.framework.AssertionFailedError: File /hadoop-mapreduce-project/build/test/data/test-job-cleanup/output-8/_custom_cleanup missing for job job_20120203035807432_0009 at org.apache.hadoop.mapred.TestJobCleanup.testKilledJob(TestJobCleanup.java:228) at org.apache.hadoop.mapred.TestJobCleanup.testCustomCleanup(TestJobCleanup.java:302) at junit.extensions.TestDecorator.basicRun(TestDecorator.java:24) at junit.extensions.TestSetup$1.protect(TestSetup.java:23) at junit.extensions.TestSetup.run(TestSetup.java:27) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-3797) lGridMix fails to Run with NPE with latest branch-0.23 code
lGridMix fails to Run with NPE with latest branch-0.23 code --- Key: MAPREDUCE-3797 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3797 Project: Hadoop Map/Reduce Issue Type: Bug Components: contrib/gridmix, tools/rumen Affects Versions: 0.23.1 Reporter: Karam Singh Fix For: 0.23.1 GridMix fails to start trowing NPE after gendata -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hadoop-Mapreduce-0.23-Build - Build # 180 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/180/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 27733 lines...] [INFO] --- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-mapreduce --- [INFO] [INFO] --- maven-antrun-plugin:1.6:run (tar) @ hadoop-mapreduce --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ hadoop-mapreduce --- [INFO] Installing /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-0.23-Build/trunk/hadoop-mapreduce-project/pom.xml to /home/jenkins/.m2/repository/org/apache/hadoop/hadoop-mapreduce/0.23.1-SNAPSHOT/hadoop-mapreduce-0.23.1-SNAPSHOT.pom [INFO] [INFO] Reactor Summary: [INFO] [INFO] hadoop-yarn ... SUCCESS [1.881s] [INFO] hadoop-yarn-api ... SUCCESS [9.245s] [INFO] hadoop-yarn-common SUCCESS [22.926s] [INFO] hadoop-yarn-server SUCCESS [0.106s] [INFO] hadoop-yarn-server-common . SUCCESS [4.106s] [INFO] hadoop-yarn-server-nodemanager SUCCESS [2:01.961s] [INFO] hadoop-yarn-server-web-proxy .. SUCCESS [1.537s] [INFO] hadoop-yarn-server-resourcemanager SUCCESS [2:55.163s] [INFO] hadoop-yarn-server-tests .. SUCCESS [39.506s] [INFO] hadoop-mapreduce-client ... SUCCESS [0.060s] [INFO] hadoop-mapreduce-client-core .. SUCCESS [7.856s] [INFO] hadoop-yarn-applications .. SUCCESS [0.142s] [INFO] hadoop-yarn-applications-distributedshell . SUCCESS [23.402s] [INFO] hadoop-yarn-site .. SUCCESS [0.146s] [INFO] hadoop-mapreduce-client-common SUCCESS [29.315s] [INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [1.034s] [INFO] hadoop-mapreduce-client-app ... SUCCESS [3:49.642s] [INFO] hadoop-mapreduce-client-hs SUCCESS [1:04.929s] [INFO] hadoop-mapreduce-client-jobclient . SUCCESS [42:52.372s] [INFO] Apache Hadoop MapReduce Examples .. SUCCESS [43.248s] [INFO] hadoop-mapreduce .. SUCCESS [0.083s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 55:49.328s [INFO] Finished at: Fri Feb 03 14:17:27 UTC 2012 [INFO] Final Memory: 78M/350M [INFO] + [[ 2 -ne 0 ]] + echo 'Build failed' Build failed + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Updating HDFS-2879 Updating HDFS-2718 Updating MAPREDUCE-3784 Updating HDFS-2877 Updating HADOOP-8012 Updating HDFS-2784 Updating HDFS-2814 Updating HADOOP-8001 Updating MAPREDUCE-3708 Updating HADOOP-8015 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
