See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/9/changes>
Changes: [vinayakumarb] HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B) [wheat9] HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. [atm] HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. [jlowe] YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan [brandonli] HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang [wang] HADOOP-11311. Restrict uppercase key names from being created with JCEKS. [jlowe] MAPREDUCE-6162. mapred hsadmin fails on a secure cluster. Contributed by Jason Lowe [kasha] YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha) [wang] HDFS-6982. nntop: topÂ-like tool for name node users. (Maysam Yabandeh via wang) [wheat9] HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. ------------------------------------------ [...truncated 6646 lines...] at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:637) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:966) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2125) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2121) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1683) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2119) at org.apache.hadoop.ipc.Client.call(Client.java:1468) at org.apache.hadoop.ipc.Client.call(Client.java:1399) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230) at com.sun.proxy.$Proxy21.addBlock(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:399) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101) at com.sun.proxy.$Proxy22.addBlock(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1544) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1361) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:600) Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.002 sec - in org.apache.hadoop.hdfs.TestClientReportBadBlock Running org.apache.hadoop.hdfs.TestWriteRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.234 sec - in org.apache.hadoop.hdfs.TestWriteRead Running org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.154 sec - in org.apache.hadoop.hdfs.TestClientProtocolForPipelineRecovery Running org.apache.hadoop.hdfs.TestBalancerBandwidth Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.535 sec - in org.apache.hadoop.hdfs.TestBalancerBandwidth Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.356 sec - in org.apache.hadoop.hdfs.TestDFSUpgrade Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.88 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.696 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestBlockReaderFactory Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.425 sec - in org.apache.hadoop.hdfs.TestBlockReaderFactory Running org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.897 sec - in org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Running org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.515 sec - in org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.455 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Running org.apache.hadoop.hdfs.qjournal.server.TestJournal Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.668 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournal Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.793 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Running org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.073 sec - in org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Running org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 151.444 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Running org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.387 sec - in org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.301 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Running org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.254 sec - in org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.22 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.611 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Running org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.771 sec - in org.apache.hadoop.hdfs.TestFileCreationEmpty Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.069 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.354 sec - in org.apache.hadoop.hdfs.TestDataTransferKeepalive Running org.apache.hadoop.hdfs.TestModTime Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.629 sec - in org.apache.hadoop.hdfs.TestModTime Running org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.952 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeDowngrade Running org.apache.hadoop.hdfs.TestLease Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.128 sec - in org.apache.hadoop.hdfs.TestLease Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.045 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.474 sec - in org.apache.hadoop.hdfs.TestDeprecatedKeys Running org.apache.hadoop.hdfs.TestFSOutputSummer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.156 sec - in org.apache.hadoop.hdfs.TestFSOutputSummer Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.338 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.619 sec - in org.apache.hadoop.hdfs.TestDFSInotifyEventInputStream Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.647 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestGetBlocks Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.85 sec - in org.apache.hadoop.hdfs.TestGetBlocks Running org.apache.hadoop.hdfs.TestDataTransferProtocol Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.189 sec - in org.apache.hadoop.hdfs.TestDataTransferProtocol Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.256 sec - in org.apache.hadoop.hdfs.TestReadWhileWriting Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.784 sec - in org.apache.hadoop.net.TestNetworkTopology Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.727 sec - in org.apache.hadoop.tracing.TestTraceAdmin Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.096 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Running org.apache.hadoop.tracing.TestTracing Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.619 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.609 sec - in org.apache.hadoop.TestRefreshCallQueue Results : Tests in error: TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestEncryptionZonesWithKMS.setup:56->TestEncryptionZones.setup:154 » IllegalArgument TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestReservedRawPaths.setup:86 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZones.setup:154 » IllegalArgument Uppercase key names are unsupp... TestEncryptionZonesWithHA.setupCluster:75 » IllegalArgument Uppercase key name... TestLargeBlock.testLargeBlockSize » IO All datanodes 127.0.0.1:59794 are bad. ... TestHDFSTrash.testTrash » Remote File /test/mkdirs/myFile could only be replic... Tests run: 3174, Failures: 0, Errors: 48, Skipped: 19 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is missing, no dependency information available [WARNING] Failed to retrieve plugin descriptor for org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in http://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.1.2:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.1.2:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.6:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:2.3.2:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ****** FindBugsMojo execute ******* [INFO] canGenerate is false [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:42 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 2.212 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:42 h [INFO] Finished at: 2014-11-18T14:16:36+00:00 [INFO] Final Memory: 67M/866M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-hdfs: There was a timeout or other error in the fork -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating YARN-2414 Updating YARN-2690 Updating HDFS-7146 Updating HADOOP-11157 Updating HDFS-7279 Updating HDFS-6982 Updating MAPREDUCE-6162 Updating YARN-2574 Updating HDFS-7404 Updating HADOOP-11311 Updating HDFS-7399