Hadoop-Mapreduce-trunk-Java8 - Build # 400 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/400/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10809 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.29 sec - in org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapred.TestLocalContainerLauncher Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.619 sec - in org.apache.hadoop.mapred.TestLocalContainerLauncher Results : Failed tests: TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException Expected exception: org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocationException Tests run: 335, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.609 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:23 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 27.288 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.389 s] [INFO] Apache Hadoop MapReduce App ... FAILURE [10:36 min] [INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED [INFO] Apache Hadoop MapReduce JobClient . SKIPPED [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 12:35 min [INFO] Finished at: 2015-09-17T07:35:06+00:00 [INFO] Final Memory: 40M/270M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-app: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #378 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20472841 bytes Compression is 0.0% Took 5.2 sec Recording test results Updating YARN-4034 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. REGRESSION: org.apache.hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException Error Message: Expected exception: org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocationException Stack Trace: java.lang.AssertionError: Expected exception: org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocationException at org.junit.internal.runners.statements.ExpectException.evaluate(ExpectException.java:32) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at
Hadoop-Mapreduce-trunk - Build # 2346 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2346/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33302 lines...] Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.512 sec - in org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Running org.apache.hadoop.mapred.TestReporter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.546 sec - in org.apache.hadoop.mapred.TestReporter Results : Tests in error: TestNetworkedJob.testNetworkedJob:260 » IO org.apache.hadoop.yarn.exceptions.Y... Tests run: 523, Failures: 0, Errors: 1, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.707 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:31 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 29.962 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.933 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [08:48 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:34 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:38 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:55 h [INFO] Finished at: 2015-09-17T06:30:13+00:00 [INFO] Final Memory: 35M/719M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2330 Archived 1 artifacts Archive block size is 32768 Received 7 blocks and 20235831 bytes Compression is 1.1% Took 5.2 sec Recording test results Updating HADOOP-12417 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. FAILED: org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob Error Message: org.apache.hadoop.yarn.exceptions.YarnException: java.io.IOException: Delegation Token can be issued only with kerberos authentication at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38) at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:959) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getDelegationToken(ApplicationClientProtocolPBServiceImpl.java:301) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:449) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2230) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2226) Caused by: java.io.IOException: Delegation Token can be issued
Hadoop-Mapreduce-trunk - Build # 2347 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2347/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33304 lines...] Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.412 sec - in org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Running org.apache.hadoop.ipc.TestMRCJCSocketFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.16 sec - in org.apache.hadoop.ipc.TestMRCJCSocketFactory Results : Tests in error: TestNetworkedJob.testNetworkedJob:260 » IO org.apache.hadoop.yarn.exceptions.Y... Tests run: 523, Failures: 0, Errors: 1, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.761 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:30 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 28.174 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.794 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [08:49 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:34 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:45 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:02 h [INFO] Finished at: 2015-09-17T10:05:43+00:00 [INFO] Final Memory: 35M/719M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2330 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20466898 bytes Compression is 0.0% Took 12 sec Recording test results Updating YARN-4034 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. FAILED: org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob Error Message: org.apache.hadoop.yarn.exceptions.YarnException: java.io.IOException: Delegation Token can be issued only with kerberos authentication at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38) at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:959) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getDelegationToken(ApplicationClientProtocolPBServiceImpl.java:301) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:449) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2230) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2224) Caused by: java.io.IOException: Delegation Token can be
[jira] [Created] (MAPREDUCE-6482) Since jvm reuse is not supported in hadoop 2.x, why I still find mapreduce.job.jvm.numtasks in mapre-default.xml
Wei Chen created MAPREDUCE-6482: --- Summary: Since jvm reuse is not supported in hadoop 2.x, why I still find mapreduce.job.jvm.numtasks in mapre-default.xml Key: MAPREDUCE-6482 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6482 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.7.1, 2.7.0, 2.6.0 Reporter: Wei Chen -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (MAPREDUCE-6483) Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri()
Mingliang Liu created MAPREDUCE-6483: Summary: Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() Key: MAPREDUCE-6483 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6483 Project: Hadoop Map/Reduce Issue Type: Task Components: test Reporter: Mingliang Liu Assignee: Mingliang Liu Test {{TestMRCredentials}} uses the {{NameNode.getUri()}} method which is deprecated in [HDFS-9022]. We should use {{DFSUtilClient.getNNUri()}} instead to get the name node URI given NN address. To make the Jenkins pass unit tests, jira [HDFS-9022] focuses on changes in {{hadoop-hdfs}} module. This jira tracks the effort of replacing usage of {{NameNode.getUri()}} with {{DFSUtilClient.getNNUri()}} in {{TestMRCredentials}}. As this is the last usage of the deprecated static method {{NameNode.getUri()}}, we also remove it from code trunk. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Hadoop-Mapreduce-trunk - Build # 2348 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2348/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33305 lines...] Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.308 sec - in org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath Running org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.309 sec - in org.apache.hadoop.mapred.TestSequenceFileAsBinaryOutputFormat Results : Tests in error: TestNetworkedJob.testNetworkedJob:260 » IO org.apache.hadoop.yarn.exceptions.Y... Tests run: 523, Failures: 0, Errors: 1, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 3.094 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:39 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 30.526 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 5.288 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [09:12 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:45 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:55 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:12 h [INFO] Finished at: 2015-09-17T18:13:53+00:00 [INFO] Final Memory: 35M/719M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2330 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20469115 bytes Compression is 0.0% Took 8.1 sec Recording test results Updating MAPREDUCE-6481 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. FAILED: org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob Error Message: org.apache.hadoop.yarn.exceptions.YarnException: java.io.IOException: Delegation Token can be issued only with kerberos authentication at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38) at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:959) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getDelegationToken(ApplicationClientProtocolPBServiceImpl.java:301) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:449) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2230) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2224) Caused by:
Hadoop-Mapreduce-trunk-Java8 - Build # 402 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/402/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11648 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.ipc.TestMRCJCSocketFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.491 sec - in org.apache.hadoop.ipc.TestMRCJCSocketFactory Results : Tests in error: TestNetworkedJob.testNetworkedJob:261 » IO org.apache.hadoop.yarn.exceptions.Y... TestJHSSecurity.testDelegationToken:77 » NoClassDefFound org/apache/hadoop/uti... TestLargeSort.setup:40 » NoClassDefFound org/apache/hadoop/metrics2/impl/Metri... Tests run: 515, Failures: 0, Errors: 3, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.272 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:19 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 26.510 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 5.067 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [10:20 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [06:10 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:40 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:59 h [INFO] Finished at: 2015-09-17T21:44:39+00:00 [INFO] Final Memory: 35M/151M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire/surefirebooter4090522431178967297.jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire/surefire5139883619269291837tmp /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire/surefire_2744065358836699794252tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #378 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20477050 bytes Compression is 0.0% Took 5.5 sec Recording test results Updating MAPREDUCE-5002 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 3 tests failed. REGRESSION: org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort Error Message: org/apache/hadoop/metrics2/impl/MetricGaugeInt Stack Trace: java.lang.NoClassDefFoundError: org/apache/hadoop/metrics2/impl/MetricGaugeInt at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at
Re: [VOTE] Release Apache Hadoop 2.6.1 RC1
+1 (non-binding) Download and compile the source code, run several MR jobs. Xuan Gong > On Sep 16, 2015, at 7:10 PM, Vinod Kumar Vavilapalli> wrote: > > Hi all, > > After a nearly month long [1] toil, with loads of help from Sangjin Lee and > Akira Ajisaka, and 153 (RC0)+7(RC1) commits later, I've created a release > candidate RC1 for hadoop-2.6.1. > > RC1 is RC0 [0] (for which I opened and closed a vote last week) + UI fixes > for the issue Sangjin raised (YARN-3171 and the dependencies YARN-3779, > YARN-3248), additional fix to avoid incompatibility (YARN-3740), other UI > bugs (YARN-1884, YARN-3544) and the MiniYARNCluster issue (right patch for > YARN-2890) that Jeff Zhang raised. > > The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.6.1-RC1/ > > The RC tag in git is: release-2.6.1-RC1 > > The maven artifacts are available via repository.apache.org at > https://repository.apache.org/content/repositories/orgapachehadoop-1021 > > Some notes from our release process > - - Sangjin and I moved out a bunch of items pending from 2.6.1 [2] - > non-committed but desired patches. 2.6.1 is already big as is and is late > by any standard, we can definitely include them in the next release. > - The 2.6.1 wiki page [3] captures some (but not all) of the context of > the patches that we pushed in. > - Given the number of fixes pushed [4] in, we had to make a bunch of > changes to our original plan - we added a few improvements that helped us > backport patches easier (or in many cases made backports possible), and we > dropped a few that didn't make sense (HDFS-7831, HDFS-7926, HDFS-7676, > HDFS-7611, HDFS-7843, HDFS-8850). > - I ran all the unit tests which (surprisingly?) passed. (Except for one, > which pointed out a missing fix HDFS-7552). > > As discussed before [5] > - This release is the first point release after 2.6.0 > - I’d like to use this as a starting release for 2.6.2 in a few weeks and > then follow up with more of these. > > Please try the release and vote; the vote will run for the usual 5 days. > > Thanks, > Vinod > > [0] Hadoop 2.6.1 RC0 vote: http://markmail.org/thread/ubut2rn3lodc55iy > [1] Hadoop 2.6.1 Release process thread: > http://markmail.org/thread/wkbgkxkhntx5tlux > [2] 2.6.1 Pending tickets: > https://issues.apache.org/jira/issues/?filter=12331711 > [3] 2.6.1 Wiki page: https://wiki.apache.org/hadoop/Release-2.6.1 > -Working-Notes > [4] List of 2.6.1 patches pushed: > https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%202.6.1 > %20and%20labels%20%3D%20%222.6.1-candidate%22 > [5] Planning Hadoop 2.6.1 release: > http://markmail.org/thread/sbykjn5xgnksh6wg > > PS: > - Note that branch-2.6 which will be the base for 2.6.2 doesn't have these > fixes yet. Once 2.6.1 goes through, I plan to rebase branch-2.6 based off > 2.6.1. > - The additional patches in RC1 that got into 2.6.1 all the way from 2.8 > are NOT in 2.7.2 yet, this will be done as a followup.
Re: [VOTE] Release Apache Hadoop 2.6.1 RC1
Update my vote from +1 (non-binding) to +1 binding Thanks Xuan Gong > On Sep 17, 2015, at 2:05 PM, Xuan Gongwrote: > > +1 (non-binding) > Download and compile the source code, run several MR jobs. > > Xuan Gong > >> On Sep 16, 2015, at 7:10 PM, Vinod Kumar Vavilapalli >> wrote: >> >> Hi all, >> >> After a nearly month long [1] toil, with loads of help from Sangjin Lee and >> Akira Ajisaka, and 153 (RC0)+7(RC1) commits later, I've created a release >> candidate RC1 for hadoop-2.6.1. >> >> RC1 is RC0 [0] (for which I opened and closed a vote last week) + UI fixes >> for the issue Sangjin raised (YARN-3171 and the dependencies YARN-3779, >> YARN-3248), additional fix to avoid incompatibility (YARN-3740), other UI >> bugs (YARN-1884, YARN-3544) and the MiniYARNCluster issue (right patch for >> YARN-2890) that Jeff Zhang raised. >> >> The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.6.1-RC1/ >> >> The RC tag in git is: release-2.6.1-RC1 >> >> The maven artifacts are available via repository.apache.org at >> https://repository.apache.org/content/repositories/orgapachehadoop-1021 >> >> Some notes from our release process >> - - Sangjin and I moved out a bunch of items pending from 2.6.1 [2] - >> non-committed but desired patches. 2.6.1 is already big as is and is late >> by any standard, we can definitely include them in the next release. >> - The 2.6.1 wiki page [3] captures some (but not all) of the context of >> the patches that we pushed in. >> - Given the number of fixes pushed [4] in, we had to make a bunch of >> changes to our original plan - we added a few improvements that helped us >> backport patches easier (or in many cases made backports possible), and we >> dropped a few that didn't make sense (HDFS-7831, HDFS-7926, HDFS-7676, >> HDFS-7611, HDFS-7843, HDFS-8850). >> - I ran all the unit tests which (surprisingly?) passed. (Except for one, >> which pointed out a missing fix HDFS-7552). >> >> As discussed before [5] >> - This release is the first point release after 2.6.0 >> - I’d like to use this as a starting release for 2.6.2 in a few weeks and >> then follow up with more of these. >> >> Please try the release and vote; the vote will run for the usual 5 days. >> >> Thanks, >> Vinod >> >> [0] Hadoop 2.6.1 RC0 vote: http://markmail.org/thread/ubut2rn3lodc55iy >> [1] Hadoop 2.6.1 Release process thread: >> http://markmail.org/thread/wkbgkxkhntx5tlux >> [2] 2.6.1 Pending tickets: >> https://issues.apache.org/jira/issues/?filter=12331711 >> [3] 2.6.1 Wiki page: https://wiki.apache.org/hadoop/Release-2.6.1 >> -Working-Notes >> [4] List of 2.6.1 patches pushed: >> https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%202.6.1 >> %20and%20labels%20%3D%20%222.6.1-candidate%22 >> [5] Planning Hadoop 2.6.1 release: >> http://markmail.org/thread/sbykjn5xgnksh6wg >> >> PS: >> - Note that branch-2.6 which will be the base for 2.6.2 doesn't have these >> fixes yet. Once 2.6.1 goes through, I plan to rebase branch-2.6 based off >> 2.6.1. >> - The additional patches in RC1 that got into 2.6.1 all the way from 2.8 >> are NOT in 2.7.2 yet, this will be done as a followup. >
Hadoop-Mapreduce-trunk - Build # 2349 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2349/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33304 lines...] Running org.apache.hadoop.util.TestMRCJCReflectionUtils Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.645 sec - in org.apache.hadoop.util.TestMRCJCReflectionUtils Running org.apache.hadoop.util.TestMRCJCRunJar Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.248 sec - in org.apache.hadoop.util.TestMRCJCRunJar Results : Tests in error: TestNetworkedJob.testNetworkedJob:260 » IO org.apache.hadoop.yarn.exceptions.Y... Tests run: 523, Failures: 0, Errors: 1, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.731 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:32 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 28.715 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 5.680 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [08:51 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:35 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:44 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:00 h [INFO] Finished at: 2015-09-17T21:00:23+00:00 [INFO] Final Memory: 34M/719M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2330 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20466592 bytes Compression is 0.0% Took 6.9 sec Recording test results Updating MAPREDUCE-5002 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 1 tests failed. FAILED: org.apache.hadoop.mapred.TestNetworkedJob.testNetworkedJob Error Message: org.apache.hadoop.yarn.exceptions.YarnException: java.io.IOException: Delegation Token can be issued only with kerberos authentication at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38) at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getDelegationToken(ClientRMService.java:959) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getDelegationToken(ApplicationClientProtocolPBServiceImpl.java:301) at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:449) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2230) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2226) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2224) Caused by: java.io.IOException: Delegation Token can be issued only with kerberos
Re: [VOTE] Release Apache Hadoop 2.6.1 RC1
+1 (binding) Build from source code. Deployed a local cluster. Validated sample jobs passed. Jian > On Sep 18, 2015, at 7:34 AM, Wangda Tanwrote: > > Deployed a local cluster, verified configured cluster with node labels, run > jobs with/without node labels. > > +1 (non-binding) > > Thanks! > > On Thu, Sep 17, 2015 at 2:40 PM, Xuan Gong wrote: > >> Update my vote from +1 (non-binding) to +1 binding >> >> Thanks >> >> Xuan Gong >> >>> On Sep 17, 2015, at 2:05 PM, Xuan Gong wrote: >>> >>> +1 (non-binding) >>> Download and compile the source code, run several MR jobs. >>> >>> Xuan Gong >>> On Sep 16, 2015, at 7:10 PM, Vinod Kumar Vavilapalli < >> vino...@apache.org> wrote: Hi all, After a nearly month long [1] toil, with loads of help from Sangjin Lee >> and Akira Ajisaka, and 153 (RC0)+7(RC1) commits later, I've created a >> release candidate RC1 for hadoop-2.6.1. RC1 is RC0 [0] (for which I opened and closed a vote last week) + UI >> fixes for the issue Sangjin raised (YARN-3171 and the dependencies YARN-3779, YARN-3248), additional fix to avoid incompatibility (YARN-3740), other >> UI bugs (YARN-1884, YARN-3544) and the MiniYARNCluster issue (right patch >> for YARN-2890) that Jeff Zhang raised. The RC is available at: >> http://people.apache.org/~vinodkv/hadoop-2.6.1-RC1/ The RC tag in git is: release-2.6.1-RC1 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1021 Some notes from our release process - - Sangjin and I moved out a bunch of items pending from 2.6.1 [2] - non-committed but desired patches. 2.6.1 is already big as is and is >> late by any standard, we can definitely include them in the next release. - The 2.6.1 wiki page [3] captures some (but not all) of the context of the patches that we pushed in. - Given the number of fixes pushed [4] in, we had to make a bunch of changes to our original plan - we added a few improvements that helped >> us backport patches easier (or in many cases made backports possible), and >> we dropped a few that didn't make sense (HDFS-7831, HDFS-7926, HDFS-7676, HDFS-7611, HDFS-7843, HDFS-8850). - I ran all the unit tests which (surprisingly?) passed. (Except for >> one, which pointed out a missing fix HDFS-7552). As discussed before [5] - This release is the first point release after 2.6.0 - I’d like to use this as a starting release for 2.6.2 in a few weeks >> and then follow up with more of these. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [0] Hadoop 2.6.1 RC0 vote: http://markmail.org/thread/ubut2rn3lodc55iy [1] Hadoop 2.6.1 Release process thread: http://markmail.org/thread/wkbgkxkhntx5tlux [2] 2.6.1 Pending tickets: https://issues.apache.org/jira/issues/?filter=12331711 [3] 2.6.1 Wiki page: https://wiki.apache.org/hadoop/Release-2.6.1 -Working-Notes [4] List of 2.6.1 patches pushed: https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%202.6.1 %20and%20labels%20%3D%20%222.6.1-candidate%22 [5] Planning Hadoop 2.6.1 release: http://markmail.org/thread/sbykjn5xgnksh6wg PS: - Note that branch-2.6 which will be the base for 2.6.2 doesn't have >> these fixes yet. Once 2.6.1 goes through, I plan to rebase branch-2.6 based >> off 2.6.1. - The additional patches in RC1 that got into 2.6.1 all the way from 2.8 are NOT in 2.7.2 yet, this will be done as a followup. >>> >> >>
Hadoop-Mapreduce-trunk-Java8 - Build # 404 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/404/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10783 lines...] Running org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.277 sec - in org.apache.hadoop.mapred.TestTaskAttemptFinishingMonitor Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.086 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapred.TestLocalContainerLauncher Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.514 sec - in org.apache.hadoop.mapred.TestLocalContainerLauncher Results : Tests run: 331, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.392 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:19 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 26.446 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.200 s] [INFO] Apache Hadoop MapReduce App ... FAILURE [10:34 min] [INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED [INFO] Apache Hadoop MapReduce JobClient . SKIPPED [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 12:27 min [INFO] Finished at: 2015-09-18T01:49:58+00:00 [INFO] Final Memory: 40M/263M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter7307088019337434010.jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire1629726429769612404tmp /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_786854967775561630049tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #378 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20476204 bytes Compression is 0.0% Took 5.1 sec Recording test results Updating HADOOP-12386 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## All tests passed
Hadoop-Mapreduce-trunk-Java8 - Build # 403 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/403/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10781 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.34 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobSummary Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.579 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapreduce.jobhistory.TestEvents Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.596 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents Results : Tests run: 331, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.261 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:15 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 25.575 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.094 s] [INFO] Apache Hadoop MapReduce App ... FAILURE [10:29 min] [INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED [INFO] Apache Hadoop MapReduce JobClient . SKIPPED [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 12:18 min [INFO] Finished at: 2015-09-17T23:10:01+00:00 [INFO] Final Memory: 40M/274M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter460093387113838606.jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire2194623033772845290tmp /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_795767716730865045206tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #378 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20472013 bytes Compression is 0.0% Took 5.7 sec Recording test results Updating MAPREDUCE-5982 Updating HDFS-9022 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## All tests passed
Re: [VOTE] Release Apache Hadoop 2.6.1 RC1
Deployed a local cluster, verified configured cluster with node labels, run jobs with/without node labels. +1 (non-binding) Thanks! On Thu, Sep 17, 2015 at 2:40 PM, Xuan Gongwrote: > Update my vote from +1 (non-binding) to +1 binding > > Thanks > > Xuan Gong > > > On Sep 17, 2015, at 2:05 PM, Xuan Gong wrote: > > > > +1 (non-binding) > > Download and compile the source code, run several MR jobs. > > > > Xuan Gong > > > >> On Sep 16, 2015, at 7:10 PM, Vinod Kumar Vavilapalli < > vino...@apache.org> wrote: > >> > >> Hi all, > >> > >> After a nearly month long [1] toil, with loads of help from Sangjin Lee > and > >> Akira Ajisaka, and 153 (RC0)+7(RC1) commits later, I've created a > release > >> candidate RC1 for hadoop-2.6.1. > >> > >> RC1 is RC0 [0] (for which I opened and closed a vote last week) + UI > fixes > >> for the issue Sangjin raised (YARN-3171 and the dependencies YARN-3779, > >> YARN-3248), additional fix to avoid incompatibility (YARN-3740), other > UI > >> bugs (YARN-1884, YARN-3544) and the MiniYARNCluster issue (right patch > for > >> YARN-2890) that Jeff Zhang raised. > >> > >> The RC is available at: > http://people.apache.org/~vinodkv/hadoop-2.6.1-RC1/ > >> > >> The RC tag in git is: release-2.6.1-RC1 > >> > >> The maven artifacts are available via repository.apache.org at > >> https://repository.apache.org/content/repositories/orgapachehadoop-1021 > >> > >> Some notes from our release process > >> - - Sangjin and I moved out a bunch of items pending from 2.6.1 [2] - > >> non-committed but desired patches. 2.6.1 is already big as is and is > late > >> by any standard, we can definitely include them in the next release. > >> - The 2.6.1 wiki page [3] captures some (but not all) of the context of > >> the patches that we pushed in. > >> - Given the number of fixes pushed [4] in, we had to make a bunch of > >> changes to our original plan - we added a few improvements that helped > us > >> backport patches easier (or in many cases made backports possible), and > we > >> dropped a few that didn't make sense (HDFS-7831, HDFS-7926, HDFS-7676, > >> HDFS-7611, HDFS-7843, HDFS-8850). > >> - I ran all the unit tests which (surprisingly?) passed. (Except for > one, > >> which pointed out a missing fix HDFS-7552). > >> > >> As discussed before [5] > >> - This release is the first point release after 2.6.0 > >> - I’d like to use this as a starting release for 2.6.2 in a few weeks > and > >> then follow up with more of these. > >> > >> Please try the release and vote; the vote will run for the usual 5 days. > >> > >> Thanks, > >> Vinod > >> > >> [0] Hadoop 2.6.1 RC0 vote: http://markmail.org/thread/ubut2rn3lodc55iy > >> [1] Hadoop 2.6.1 Release process thread: > >> http://markmail.org/thread/wkbgkxkhntx5tlux > >> [2] 2.6.1 Pending tickets: > >> https://issues.apache.org/jira/issues/?filter=12331711 > >> [3] 2.6.1 Wiki page: https://wiki.apache.org/hadoop/Release-2.6.1 > >> -Working-Notes > >> [4] List of 2.6.1 patches pushed: > >> https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%202.6.1 > >> %20and%20labels%20%3D%20%222.6.1-candidate%22 > >> [5] Planning Hadoop 2.6.1 release: > >> http://markmail.org/thread/sbykjn5xgnksh6wg > >> > >> PS: > >> - Note that branch-2.6 which will be the base for 2.6.2 doesn't have > these > >> fixes yet. Once 2.6.1 goes through, I plan to rebase branch-2.6 based > off > >> 2.6.1. > >> - The additional patches in RC1 that got into 2.6.1 all the way from 2.8 > >> are NOT in 2.7.2 yet, this will be done as a followup. > > > >
Hadoop-Mapreduce-trunk-Java8 - Build # 405 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/405/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10781 lines...] Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.951 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapreduce.jobhistory.TestJobSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.337 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobSummary Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.mapreduce.jobhistory.TestEvents Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.641 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents Results : Tests run: 331, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.161 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:16 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 25.703 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.102 s] [INFO] Apache Hadoop MapReduce App ... FAILURE [10:25 min] [INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED [INFO] Apache Hadoop MapReduce JobClient . SKIPPED [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 12:14 min [INFO] Finished at: 2015-09-18T04:34:13+00:00 [INFO] Final Memory: 39M/257M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter5765005522952924781.jar /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire2818050216689807807tmp /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_987445907393423600499tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-app Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk-Java8 #378 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20474598 bytes Compression is 0.0% Took 5.6 sec Recording test results Updating YARN-4135 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## All tests passed
Hadoop-Mapreduce-trunk - Build # 2351 - Still Failing
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2351/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 33411 lines...] TestJobOutputCommitter.testCustomCleanup:279->testKilledJob:205 File /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/test-dir/test-job-output-committer/output-2/_custom_cleanup missing for job job_1442542688375_0003 TestJobOutputCommitter.testCustomAbort:255->testKilledJob:205 File /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/test-dir/test-job-output-committer/output-8/_custom_abort_killed missing for job job_1442542866202_0003 TestMRTimelineEventHandling.testMRTimelineEventHandling:127 expected:but was: Tests in error: TestNetworkedJob.testNetworkedJob:260 » IO org.apache.hadoop.yarn.exceptions.Y... TestReduceFetchFromPartialMem.testReduceFromPartialMem:93->runJob:300 » IO Job... TestClusterMRNotification>NotificationTestCase.testMR:178 » IO Job cleanup did... TestMRIntermediateDataEncryption.testSingleReducer:55->doEncryptionTest:75->doEncryptionTest:95->runMergeTest:161->verifyOutput:176 » FileNotFound Tests run: 523, Failures: 3, Errors: 4, Skipped: 11 [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop MapReduce Client SUCCESS [ 2.719 s] [INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:30 min] [INFO] Apache Hadoop MapReduce Common SUCCESS [ 28.255 s] [INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 4.815 s] [INFO] Apache Hadoop MapReduce App ... SUCCESS [08:57 min] [INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:34 min] [INFO] Apache Hadoop MapReduce JobClient . FAILURE [ 01:40 h] [INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED [INFO] Apache Hadoop MapReduce NativeTask SKIPPED [INFO] Apache Hadoop MapReduce Examples .. SKIPPED [INFO] Apache Hadoop MapReduce ... SKIPPED [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:56 h [INFO] Finished at: 2015-09-18T03:57:32+00:00 [INFO] Final Memory: 35M/708M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-mapreduce-client-jobclient: There are test failures. [ERROR] [ERROR] Please refer to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :hadoop-mapreduce-client-jobclient Build step 'Execute shell' marked build as failure [FINDBUGS] Skipping publisher since build result is FAILURE Archiving artifacts Sending artifact delta relative to Hadoop-Mapreduce-trunk #2330 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 20467329 bytes Compression is 0.0% Took 5.5 sec Recording test results Updating HADOOP-12386 Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## 7 tests failed. FAILED: org.apache.hadoop.mapred.TestClusterMRNotification.testMR Error Message: Job cleanup didn't start in 20 seconds Stack Trace: java.io.IOException: Job cleanup didn't start in 20 seconds at org.apache.hadoop.mapred.UtilsForTests.runJobKill(UtilsForTests.java:685) at org.apache.hadoop.mapred.NotificationTestCase.testMR(NotificationTestCase.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at
Re: [VOTE] Release Apache Hadoop 2.6.1 RC1
+1 (non-binding) Verified the signatures, set up a pseudo-distributed cluster, ran several test jobs, and ran an uber job. Also verified that the UI issue I saw on RC0 is now gone. Thanks Vinod! Sangjin On Thu, Sep 17, 2015 at 7:24 PM, Jian Hewrote: > +1 (binding) > > Build from source code. > Deployed a local cluster. > Validated sample jobs passed. > > Jian > > > On Sep 18, 2015, at 7:34 AM, Wangda Tan wrote: > > > > Deployed a local cluster, verified configured cluster with node labels, > run > > jobs with/without node labels. > > > > +1 (non-binding) > > > > Thanks! > > > > On Thu, Sep 17, 2015 at 2:40 PM, Xuan Gong > wrote: > > > >> Update my vote from +1 (non-binding) to +1 binding > >> > >> Thanks > >> > >> Xuan Gong > >> > >>> On Sep 17, 2015, at 2:05 PM, Xuan Gong wrote: > >>> > >>> +1 (non-binding) > >>> Download and compile the source code, run several MR jobs. > >>> > >>> Xuan Gong > >>> > On Sep 16, 2015, at 7:10 PM, Vinod Kumar Vavilapalli < > >> vino...@apache.org> wrote: > > Hi all, > > After a nearly month long [1] toil, with loads of help from Sangjin > Lee > >> and > Akira Ajisaka, and 153 (RC0)+7(RC1) commits later, I've created a > >> release > candidate RC1 for hadoop-2.6.1. > > RC1 is RC0 [0] (for which I opened and closed a vote last week) + UI > >> fixes > for the issue Sangjin raised (YARN-3171 and the dependencies > YARN-3779, > YARN-3248), additional fix to avoid incompatibility (YARN-3740), other > >> UI > bugs (YARN-1884, YARN-3544) and the MiniYARNCluster issue (right patch > >> for > YARN-2890) that Jeff Zhang raised. > > The RC is available at: > >> http://people.apache.org/~vinodkv/hadoop-2.6.1-RC1/ > > The RC tag in git is: release-2.6.1-RC1 > > The maven artifacts are available via repository.apache.org at > > https://repository.apache.org/content/repositories/orgapachehadoop-1021 > > Some notes from our release process > - - Sangjin and I moved out a bunch of items pending from 2.6.1 [2] - > non-committed but desired patches. 2.6.1 is already big as is and is > >> late > by any standard, we can definitely include them in the next release. > - The 2.6.1 wiki page [3] captures some (but not all) of the context > of > the patches that we pushed in. > - Given the number of fixes pushed [4] in, we had to make a bunch of > changes to our original plan - we added a few improvements that helped > >> us > backport patches easier (or in many cases made backports possible), > and > >> we > dropped a few that didn't make sense (HDFS-7831, HDFS-7926, HDFS-7676, > HDFS-7611, HDFS-7843, HDFS-8850). > - I ran all the unit tests which (surprisingly?) passed. (Except for > >> one, > which pointed out a missing fix HDFS-7552). > > As discussed before [5] > - This release is the first point release after 2.6.0 > - I’d like to use this as a starting release for 2.6.2 in a few weeks > >> and > then follow up with more of these. > > Please try the release and vote; the vote will run for the usual 5 > days. > > Thanks, > Vinod > > [0] Hadoop 2.6.1 RC0 vote: > http://markmail.org/thread/ubut2rn3lodc55iy > [1] Hadoop 2.6.1 Release process thread: > http://markmail.org/thread/wkbgkxkhntx5tlux > [2] 2.6.1 Pending tickets: > https://issues.apache.org/jira/issues/?filter=12331711 > [3] 2.6.1 Wiki page: https://wiki.apache.org/hadoop/Release-2.6.1 > -Working-Notes > [4] List of 2.6.1 patches pushed: > https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%202.6.1 > %20and%20labels%20%3D%20%222.6.1-candidate%22 > [5] Planning Hadoop 2.6.1 release: > http://markmail.org/thread/sbykjn5xgnksh6wg > > PS: > - Note that branch-2.6 which will be the base for 2.6.2 doesn't have > >> these > fixes yet. Once 2.6.1 goes through, I plan to rebase branch-2.6 based > >> off > 2.6.1. > - The additional patches in RC1 that got into 2.6.1 all the way from > 2.8 > are NOT in 2.7.2 yet, this will be done as a followup. > >>> > >> > >> > >