See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2934/changes>
Changes: [xgong] Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every [kasha] YARN-4560. Make scheduler error checking message more user friendly. ------------------------------------------ [...truncated 5489 lines...] at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:555) at org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA.testRefreshSuperUserGroupsConfiguration(TestDFSAdminWithHA.java:236) Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.003 sec - in org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer Running org.apache.hadoop.hdfs.tools.TestDFSAdmin Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.136 sec - in org.apache.hadoop.hdfs.tools.TestDFSAdmin Running org.apache.hadoop.hdfs.tools.TestDebugAdmin Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.764 sec - in org.apache.hadoop.hdfs.tools.TestDebugAdmin Running org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.788 sec - in org.apache.hadoop.hdfs.tools.TestDFSHAAdmin Running org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.694 sec - in org.apache.hadoop.hdfs.tools.TestDelegationTokenFetcher Running org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.889 sec - in org.apache.hadoop.hdfs.tools.TestDFSZKFailoverController Running org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.609 sec - in org.apache.hadoop.hdfs.tools.TestStoragePolicyCommands Running org.apache.hadoop.hdfs.tools.TestGetGroups Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.59 sec - in org.apache.hadoop.hdfs.tools.TestGetGroups Running org.apache.hadoop.hdfs.TestGetFileChecksum Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.516 sec - in org.apache.hadoop.hdfs.TestGetFileChecksum Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 143.398 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.736 sec - in org.apache.hadoop.hdfs.TestBlockMissingException Running org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.396 sec - in org.apache.hadoop.hdfs.TestReadStripedFileWithMissingBlocks Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.794 sec - in org.apache.hadoop.hdfs.TestPersistBlocks Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 13.835 sec - in org.apache.hadoop.hdfs.TestAppendDifferentChecksum Running org.apache.hadoop.hdfs.TestHttpPolicy Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.753 sec - in org.apache.hadoop.hdfs.TestHttpPolicy Running org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.594 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitLegacyRead Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.126 sec - in org.apache.hadoop.hdfs.TestHDFSTrash Running org.apache.hadoop.hdfs.TestParallelUnixDomainRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.651 sec - in org.apache.hadoop.hdfs.TestParallelUnixDomainRead Running org.apache.hadoop.hdfs.TestErasureCodingPolicies Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.2 sec - in org.apache.hadoop.hdfs.TestErasureCodingPolicies Running org.apache.hadoop.hdfs.TestRollingUpgrade Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 138.407 sec - in org.apache.hadoop.hdfs.TestRollingUpgrade Running org.apache.hadoop.hdfs.TestFetchImage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.747 sec - in org.apache.hadoop.hdfs.TestFetchImage Running org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.517 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestReplication Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.981 sec - in org.apache.hadoop.hdfs.TestReplication Running org.apache.hadoop.hdfs.TestQuota Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.433 sec - in org.apache.hadoop.hdfs.TestQuota Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.054 sec - in org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.667 sec - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Running org.apache.hadoop.hdfs.TestDFSStripedOutputStream Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.91 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStream Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.215 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Running org.apache.hadoop.hdfs.TestWriteStripedFileWithFailure Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.14 sec - in org.apache.hadoop.hdfs.TestWriteStripedFileWithFailure Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.545 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 79.88 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure180 Running org.apache.hadoop.hdfs.TestDFSStripedInputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.23 sec - in org.apache.hadoop.hdfs.TestDFSStripedInputStream Running org.apache.hadoop.hdfs.TestDisableConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.414 sec - in org.apache.hadoop.hdfs.TestDisableConnCache Running org.apache.hadoop.hdfs.TestApplyingStoragePolicy Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.448 sec - in org.apache.hadoop.hdfs.TestApplyingStoragePolicy Running org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.868 sec - in org.apache.hadoop.hdfs.qjournal.TestSecureNNWithQJM Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.965 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNode Running org.apache.hadoop.hdfs.qjournal.server.TestJournal Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.144 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournal Running org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.738 sec - in org.apache.hadoop.hdfs.qjournal.server.TestJournalNodeMXBean Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.024 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManagerUnit Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.315 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager Running org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.481 sec - in org.apache.hadoop.hdfs.qjournal.client.TestSegmentRecoveryComparator Running org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.703 sec - in org.apache.hadoop.hdfs.qjournal.client.TestIPCLoggerChannel Running org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.106 sec - in org.apache.hadoop.hdfs.qjournal.client.TestEpochsAreUnique Running org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 397.218 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults Running org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.445 sec - in org.apache.hadoop.hdfs.qjournal.client.TestQuorumCall Running org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.949 sec - in org.apache.hadoop.hdfs.qjournal.TestMiniJournalCluster Running org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.53 sec - in org.apache.hadoop.hdfs.qjournal.TestNNWithQJM Running org.apache.hadoop.hdfs.TestConnCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.441 sec - in org.apache.hadoop.hdfs.TestConnCache Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 132.029 sec - in org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Running org.apache.hadoop.hdfs.TestDFSInputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.713 sec - in org.apache.hadoop.hdfs.TestDFSInputStream Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.978 sec - in org.apache.hadoop.hdfs.TestFileAppend Running org.apache.hadoop.hdfs.TestFileAppend3 Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.048 sec - in org.apache.hadoop.hdfs.TestFileAppend3 Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.289 sec - in org.apache.hadoop.hdfs.TestClientReportBadBlock Running org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 222.388 sec - in org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding Running org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.199 sec - in org.apache.hadoop.hdfs.TestParallelShortCircuitReadNoChecksum Running org.apache.hadoop.hdfs.TestFileCreation Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.63 sec - in org.apache.hadoop.hdfs.TestFileCreation Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.439 sec - in org.apache.hadoop.hdfs.TestDFSRemove Running org.apache.hadoop.hdfs.TestDFSClientSocketSize Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.797 sec - in org.apache.hadoop.hdfs.TestDFSClientSocketSize Running org.apache.hadoop.hdfs.TestHdfsAdmin Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.696 sec - in org.apache.hadoop.hdfs.TestHdfsAdmin Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.576 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130 Running org.apache.hadoop.hdfs.TestDFSUtil Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.18 sec - in org.apache.hadoop.hdfs.TestDFSUtil Running org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.435 sec - in org.apache.hadoop.hdfs.TestErasureCodeBenchmarkThroughput Running org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.627 sec - in org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.473 sec - in org.apache.hadoop.hdfs.TestDataTransferKeepalive Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 137.774 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure060 Running org.apache.hadoop.hdfs.TestLease Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.941 sec - in org.apache.hadoop.hdfs.TestLease Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 168.216 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.556 sec - in org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 Running org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.975 sec - in org.apache.hadoop.hdfs.TestEncryptionZonesWithKMS Running org.apache.hadoop.hdfs.TestReconstructStripedFile Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.973 sec - in org.apache.hadoop.hdfs.TestReconstructStripedFile Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.134 sec - in org.apache.hadoop.hdfs.TestAbandonBlock Running org.apache.hadoop.hdfs.TestExternalBlockReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.3 sec - in org.apache.hadoop.hdfs.TestExternalBlockReader Running org.apache.hadoop.hdfs.TestFileCreationClient Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.112 sec - in org.apache.hadoop.hdfs.TestFileCreationClient Running org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure020 Results : Failed tests: TestDecommissioningStatus.testDecommissionStatus:291->checkDecommissionStatus:196 Unexpected num under-replicated blocks expected:<3> but was:<4> TestHAAppend.testMultipleAppendsDuringCatchupTailing:125 inode should complete in ~60000 ms. Expected: is <true> but: was <false> TestDFSAdminWithHA.testRefreshSuperUserGroupsConfiguration:236 refreshSuperUserGroupsConfiguration: End of File Exception between local host is: "asf909.gq1.ygridcore.net/67.195.81.153"; destination host is: "localhost":13684; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException expected:<0> but was:<-1> Tests in error: TestDirectoryScanner.testThrottling:584->createFile:108->Object.wait:503->Object.wait:-2 ยป Tests run: 3550, Failures: 3, Errors: 1, Skipped: 8 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.5:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [05:31 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 05:18 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.168 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:23 h [INFO] Finished at: 2016-03-16T13:43:30+00:00 [INFO] Final Memory: 69M/685M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Stream Closed -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results