See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/653/
################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ########################### [...truncated 793589 lines...] [junit] at java.lang.Thread.run(Thread.java:662) [junit] [junit] 2011-05-01 12:45:11,446 INFO datanode.DataNode (DataNode.java:shutdown(1638)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-05-01 12:45:11,446 WARN datanode.DataNode (DataNode.java:offerService(1065)) - BPOfferService for block pool=BP-1341144136-127.0.1.1-1304253910343 received exception:java.lang.InterruptedException [junit] 2011-05-01 12:45:11,447 WARN datanode.DataNode (DataNode.java:run(1218)) - DatanodeRegistration(127.0.0.1:48963, storageID=DS-1047671927-127.0.1.1-48963-1304253910889, infoPort=56864, ipcPort=35171, storageInfo=lv=-35;cid=testClusterID;nsid=1148492682;c=0) ending block pool service for: BP-1341144136-127.0.1.1-1304253910343 [junit] 2011-05-01 12:45:11,447 INFO datanode.DataBlockScanner (DataBlockScanner.java:removeBlockPool(277)) - Removed bpid=BP-1341144136-127.0.1.1-1304253910343 from blockPoolScannerMap [junit] 2011-05-01 12:45:11,447 INFO datanode.DataNode (FSDataset.java:shutdownBlockPool(2547)) - Removing block pool BP-1341144136-127.0.1.1-1304253910343 [junit] 2011-05-01 12:45:11,447 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk service threads... [junit] 2011-05-01 12:45:11,447 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads have been shut down. [junit] 2011-05-01 12:45:11,447 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdownDataNodes(1041)) - Shutting down DataNode 0 [junit] 2011-05-01 12:45:11,448 WARN datanode.DirectoryScanner (DirectoryScanner.java:shutdown(297)) - DirectoryScanner: shutdown has been called [junit] 2011-05-01 12:45:11,448 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:startNewPeriod(591)) - Starting a new period : work left in prev period : 100.00% [junit] 2011-05-01 12:45:11,548 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 48933 [junit] 2011-05-01 12:45:11,549 INFO ipc.Server (Server.java:run(1459)) - IPC Server handler 0 on 48933: exiting [junit] 2011-05-01 12:45:11,549 INFO ipc.Server (Server.java:run(487)) - Stopping IPC Server listener on 48933 [junit] 2011-05-01 12:45:11,549 INFO ipc.Server (Server.java:run(691)) - Stopping IPC Server Responder [junit] 2011-05-01 12:45:11,549 INFO datanode.DataNode (DataNode.java:shutdown(1638)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2011-05-01 12:45:11,549 WARN datanode.DataNode (DataXceiverServer.java:run(143)) - 127.0.0.1:38074:DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:159) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:136) [junit] at java.lang.Thread.run(Thread.java:662) [junit] [junit] 2011-05-01 12:45:11,551 INFO datanode.DataNode (DataNode.java:shutdown(1638)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-05-01 12:45:11,551 WARN datanode.DataNode (DataNode.java:offerService(1065)) - BPOfferService for block pool=BP-1341144136-127.0.1.1-1304253910343 received exception:java.lang.InterruptedException [junit] 2011-05-01 12:45:11,552 WARN datanode.DataNode (DataNode.java:run(1218)) - DatanodeRegistration(127.0.0.1:38074, storageID=DS-1493942583-127.0.1.1-38074-1304253910765, infoPort=54191, ipcPort=48933, storageInfo=lv=-35;cid=testClusterID;nsid=1148492682;c=0) ending block pool service for: BP-1341144136-127.0.1.1-1304253910343 [junit] 2011-05-01 12:45:11,652 INFO datanode.DataBlockScanner (DataBlockScanner.java:removeBlockPool(277)) - Removed bpid=BP-1341144136-127.0.1.1-1304253910343 from blockPoolScannerMap [junit] 2011-05-01 12:45:11,652 INFO datanode.DataNode (FSDataset.java:shutdownBlockPool(2547)) - Removing block pool BP-1341144136-127.0.1.1-1304253910343 [junit] 2011-05-01 12:45:11,652 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk service threads... [junit] 2011-05-01 12:45:11,652 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads have been shut down. [junit] 2011-05-01 12:45:11,753 WARN namenode.FSNamesystem (FSNamesystem.java:run(3009)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted [junit] 2011-05-01 12:45:11,753 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(573)) - Number of transactions: 6 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 11 12 [junit] 2011-05-01 12:45:11,753 WARN namenode.DecommissionManager (DecommissionManager.java:run(70)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted [junit] 2011-05-01 12:45:11,756 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 53867 [junit] 2011-05-01 12:45:11,756 INFO ipc.Server (Server.java:run(1459)) - IPC Server handler 0 on 53867: exiting [junit] 2011-05-01 12:45:11,756 INFO ipc.Server (Server.java:run(487)) - Stopping IPC Server listener on 53867 [junit] 2011-05-01 12:45:11,756 INFO ipc.Server (Server.java:run(691)) - Stopping IPC Server Responder [junit] Tests run: 16, Failures: 0, Errors: 0, Time elapsed: 100.368 sec checkfailure: -run-test-hdfs-fault-inject-withtestcaseonly: run-test-hdfs-fault-inject: BUILD FAILED /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build.xml:749: Tests failed! Total time: 72 minutes 6 seconds [FINDBUGS] Skipping publisher since build result is FAILURE Publishing Javadoc Archiving artifacts Recording test results Recording fingerprints Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ################################################################################### ############################## FAILED TESTS (if any) ############################## 4 tests failed. REGRESSION: org.apache.hadoop.hdfs.TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy2 Error Message: Timed out waiting for corrupt replicas. Waiting for 2, but only found 1 Stack Trace: java.util.concurrent.TimeoutException: Timed out waiting for corrupt replicas. Waiting for 2, but only found 1 at org.apache.hadoop.hdfs.DFSTestUtil.waitCorruptReplicas(DFSTestUtil.java:308) at org.apache.hadoop.hdfs.TestDatanodeBlockScanner.blockCorruptionRecoveryPolicy(TestDatanodeBlockScanner.java:288) at org.apache.hadoop.hdfs.TestDatanodeBlockScanner.__CLR3_0_2t1dvact92(TestDatanodeBlockScanner.java:242) at org.apache.hadoop.hdfs.TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy2(TestDatanodeBlockScanner.java:239) REGRESSION: org.apache.hadoop.hdfs.TestDatanodeBlockScanner.testTruncatedBlockReport Error Message: Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1. The directory is already locked. Stack Trace: java.io.IOException: Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1. The directory is already locked. at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:642) at org.apache.hadoop.hdfs.server.namenode.FSImage.formatOccurred(FSImage.java:1191) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:577) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:598) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1489) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:210) at org.apache.hadoop.test.GenericTestUtils.formatNamenode(GenericTestUtils.java:48) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:596) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:511) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:241) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:80) at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:227) at org.apache.hadoop.hdfs.TestDatanodeBlockScanner.__CLR3_0_226b7dwta1(TestDatanodeBlockScanner.java:314) at org.apache.hadoop.hdfs.TestDatanodeBlockScanner.testTruncatedBlockReport(TestDatanodeBlockScanner.java:303) FAILED: org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testCheckpoint Error Message: null Stack Trace: junit.framework.AssertionFailedError: null at org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testCheckpoint(TestBackupNode.java:152) at org.apache.hadoop.hdfs.server.namenode.TestBackupNode.__CLR3_0_2xuql33qjy(TestBackupNode.java:103) at org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testCheckpoint(TestBackupNode.java:101) FAILED: org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testBackupRegistration Error Message: Only one backup node should be able to start Stack Trace: junit.framework.AssertionFailedError: Only one backup node should be able to start at org.apache.hadoop.hdfs.server.namenode.TestBackupNode.__CLR3_0_2ygtwtwqm3(TestBackupNode.java:231) at org.apache.hadoop.hdfs.server.namenode.TestBackupNode.testBackupRegistration(TestBackupNode.java:211)