See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1129/changes>
Changes: [raviprak] Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token [wangda] YARN-4846. Fix random failures for [kihwal] HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. [aajisaka] HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed ------------------------------------------ [...truncated 5806 lines...] at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:118) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) at java.io.DataOutputStream.flush(DataOutputStream.java:123) at java.io.FilterOutputStream.close(FilterOutputStream.java:158) at org.apache.hadoop.hdfs.DataStreamer.closeStream(DataStreamer.java:877) at org.apache.hadoop.hdfs.DataStreamer.closeInternal(DataStreamer.java:726) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:721) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestErasureCodingPolicies Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.821 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicies Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRemoteBlockReader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.659 sec - in org.apache.hadoop.hdfs.TestRemoteBlockReader Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestHdfsAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.14 sec - in org.apache.hadoop.hdfs.TestHdfsAdmin Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.053 sec - in org.apache.hadoop.hdfs.TestDistributedFileSystem Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRollingUpgradeRollback Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.099 sec - in org.apache.hadoop.hdfs.TestRollingUpgradeRollback Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRollingUpgrade Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 126.952 sec - in org.apache.hadoop.hdfs.TestRollingUpgrade Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.51 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.7 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFsShellPermission Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.862 sec - in org.apache.hadoop.hdfs.TestFsShellPermission Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.TestLocatedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.27 sec - in org.apache.hadoop.hdfs.protocol.TestLocatedBlock Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.293 sec - in org.apache.hadoop.hdfs.protocol.TestLayoutVersion Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.845 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.424 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.TestAnnotations Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.159 sec - in org.apache.hadoop.hdfs.protocol.TestAnnotations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.07 sec - in org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.219 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure170 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.308 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure190 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.056 sec - in org.apache.hadoop.hdfs.TestDFSAddressConfig Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSConfigKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.199 sec - in org.apache.hadoop.hdfs.TestDFSConfigKeys Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.328 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.8 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.256 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestReplication Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.828 sec - in org.apache.hadoop.hdfs.TestReplication Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFileChecksum Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.61 sec - in org.apache.hadoop.hdfs.TestFileChecksum Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.076 sec - in org.apache.hadoop.hdfs.TestRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestPipelines Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.553 sec - in org.apache.hadoop.hdfs.TestPipelines Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.496 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDeprecatedKeys Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.594 sec - in org.apache.hadoop.hdfs.TestDeprecatedKeys Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestAclsEndToEnd Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.225 sec - in org.apache.hadoop.hdfs.TestAclsEndToEnd Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.223 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestParallelShortCircuitRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.451 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitRead Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.261 sec - in org.apache.hadoop.hdfs.TestHDFSTrash Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 41.205 sec <<< FAILURE! - in org.apache.hadoop.hdfs.TestFileAppend testMultipleAppends(org.apache.hadoop.hdfs.TestFileAppend) Time elapsed: 6.232 sec <<< ERROR! java.io.IOException: Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try. (Nodes: current=[DatanodeInfoWithStorage[127.0.0.1:37413,DS-95ae003a-bb9f-4b5f-bcb3-4cf1eed3b682,DISK], DatanodeInfoWithStorage[127.0.0.1:58520,DS-9f932289-2cd6-465d-9434-d66f473c6ed9,DISK]], original=[DatanodeInfoWithStorage[127.0.0.1:37413,DS-95ae003a-bb9f-4b5f-bcb3-4cf1eed3b682,DISK], DatanodeInfoWithStorage[127.0.0.1:58520,DS-9f932289-2cd6-465d-9434-d66f473c6ed9,DISK]]). The current failed datanode replacement policy is DEFAULT, and a client may configure this via 'dfs.client.block.write.replace-datanode-on-failure.policy' in its configuration. at org.apache.hadoop.hdfs.DataStreamer.findNewDatanode(DataStreamer.java:1166) at org.apache.hadoop.hdfs.DataStreamer.addDatanode2ExistingPipeline(DataStreamer.java:1232) at org.apache.hadoop.hdfs.DataStreamer.handleDatanodeReplacement(DataStreamer.java:1423) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1338) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1321) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:599) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.854 sec - in org.apache.hadoop.hdfs.TestDFSRemove Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestErasureCodingPolicyWithSnapshot Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.875 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicyWithSnapshot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.047 sec - in org.apache.hadoop.hdfs.TestDFSRollback Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.271 sec - in org.apache.hadoop.hdfs.TestReadWhileWriting Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.551 sec - in org.apache.hadoop.hdfs.TestConnCache Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.688 sec - in org.apache.hadoop.hdfs.TestPersistBlocks Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestSetrepDecreasing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.901 sec - in org.apache.hadoop.hdfs.TestSetrepDecreasing Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.948 sec - in org.apache.hadoop.hdfs.TestDatanodeLayoutUpgrade Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestFileCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.745 sec - in org.apache.hadoop.hdfs.TestFileCorruption Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.767 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.009 sec - in org.apache.hadoop.hdfs.TestWriteConfigurationToDFS Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.324 sec - in org.apache.hadoop.hdfs.TestListFilesInDFS Results : Failed tests: TestFsDatasetImpl.testCleanShutdownOfVolume:683 null Tests in error: TestHFlush.testHFlushInterrupted » IO The stream is closed TestFileAppend.testMultipleAppends » IO Failed to replace a bad datanode on th... Tests run: 4391, Failures: 1, Errors: 2, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [04:11 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 04:14 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.092 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 04:18 h [INFO] Finished at: 2016-04-23T01:47:23+00:00 [INFO] Final Memory: 56M/432M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results