See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1282/changes>
Changes: [atm] HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth. [eli] HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins [eyang] HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) [eyang] HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) [suresh] HDFS-4382. Fix typo MAX_NOT_CHANGED_INTERATIONS. Contributed by Ted Yu. [tucu] MAPREDUCE-4907. Ammendment, forgot to svn add testcase in original commit [suresh] HDFS-4367. GetDataEncryptionKeyResponseProto does not handle null response. Contributed by Suresh Srinivas. ------------------------------------------ [...truncated 10474 lines...] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75) testOverWriteAndRead(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract) Time elapsed: 10 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException(java.io.IOException): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:169) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:310) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$500(WebHdfsFileSystem.java:111) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$1.close(WebHdfsFileSystem.java:710) at org.apache.hadoop.fs.FileSystemContractBaseTest.writeAndRead(FileSystemContractBaseTest.java:530) at org.apache.hadoop.fs.FileSystemContractBaseTest.testOverWriteAndRead(FileSystemContractBaseTest.java:489) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165) at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75) Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.553 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.503 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.5 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.161 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.977 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.058 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.382 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.638 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 128.019 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.174 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.266 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.02 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.51 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 87.531 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.031 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.23 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.834 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.806 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.396 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.847 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.068 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.141 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.154 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.663 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.475 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.678 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.894 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.806 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.394 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.846 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.032 sec Running org.apache.hadoop.hdfs.TestParallelLocalRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.82 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.117 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.694 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.211 sec Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.827 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.685 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.891 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.323 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.002 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.969 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.979 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.818 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.109 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.444 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.453 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.618 sec Running org.apache.hadoop.hdfs.util.TestBestEffortLongFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.178 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.218 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.09 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.16 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.576 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.332 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.819 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.874 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.292 sec Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.131 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.068 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.018 sec Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.192 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.173 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.209 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.634 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.542 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.758 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.113 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.187 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.767 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.978 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.07 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.066 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.266 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.18 sec Running org.apache.hadoop.fs.TestVolumeId Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.066 sec Results : Tests in error: testResponseCode(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): All datanodes 127.0.0.1:35985 are bad. Aborting... testWriteReadAndDeleteHalfABlock(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): DFSOutputStream is closed testWriteReadAndDeleteOneBlock(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): DFSOutputStream is closed testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): File /test/hadoop/file could only be replicated to 0 nodes instead of minReplication (=1). There are 2 datanode(s) running and 2 node(s) are excluded in this operation.(..) testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testOverwrite(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testWriteInNonExistentDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; testDeleteRecursively(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testRenameFileMoveToExistingDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testRenameFileAsExistingFile(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; testRenameFileAsExistingDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testRenameDirectoryAsExistingFile(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testRenameDirectoryAsExistingDirectory(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; testInputStreamClosedTwice(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; testOutputStreamClosedTwice(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Unexpected HTTP response: code=500 != 201, op=CREATE, message=unable to create new native thread testOverWriteAndRead(org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract): Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "asf005.sp2.ygridcore.net/67.195.138.27"; destination host is: "localhost":50208; Tests run: 1660, Failures: 0, Errors: 18, Skipped: 6 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:34:12.330s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:34:13.108s [INFO] Finished at: Fri Jan 11 13:07:50 UTC 2013 [INFO] Final Memory: 48M/388M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.3:test (default-test) on project hadoop-hdfs: Failure or timeout -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException Build step 'Execute shell' marked build as failure Archiving artifacts Updating HADOOP-8419 Updating HDFS-4382 Updating HDFS-4377 Updating HDFS-4367 Updating MAPREDUCE-4907 Updating HDFS-4328