See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/614/
################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ########################### [...truncated 729780 lines...] [junit] at java.lang.Thread.run(Thread.java:662) [junit] [junit] 2011-03-22 12:24:42,983 INFO datanode.DataNode (DataNode.java:shutdown(788)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-03-22 12:24:42,983 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(624)) - Exiting DataBlockScanner thread. [junit] 2011-03-22 12:24:42,984 INFO datanode.DataNode (DataNode.java:run(1464)) - DatanodeRegistration(127.0.0.1:57260, storageID=DS-91605065-127.0.1.1-57260-1300796672283, infoPort=35711, ipcPort=34865):Finishing DataNode in: FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data3/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data4/current/finalized'} [junit] 2011-03-22 12:24:42,984 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 34865 [junit] 2011-03-22 12:24:42,984 INFO datanode.DataNode (DataNode.java:shutdown(788)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-03-22 12:24:42,984 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk service threads... [junit] 2011-03-22 12:24:42,985 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads have been shut down. [junit] 2011-03-22 12:24:42,985 WARN datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already shut down. [junit] 2011-03-22 12:24:42,985 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdownDataNodes(835)) - Shutting down DataNode 0 [junit] 2011-03-22 12:24:42,990 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 38522 [junit] 2011-03-22 12:24:42,990 INFO ipc.Server (Server.java:run(691)) - Stopping IPC Server Responder [junit] 2011-03-22 12:24:42,990 INFO datanode.DataNode (DataNode.java:shutdown(788)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2011-03-22 12:24:42,991 INFO ipc.Server (Server.java:run(487)) - Stopping IPC Server listener on 38522 [junit] 2011-03-22 12:24:42,991 WARN datanode.DataNode (DataXceiverServer.java:run(142)) - DatanodeRegistration(127.0.0.1:49868, storageID=DS-1067466969-127.0.1.1-49868-1300796672121, infoPort=48806, ipcPort=38522):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:159) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:135) [junit] at java.lang.Thread.run(Thread.java:662) [junit] [junit] 2011-03-22 12:24:42,993 INFO datanode.DataNode (DataNode.java:shutdown(788)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-03-22 12:24:42,995 INFO ipc.Server (Server.java:run(1459)) - IPC Server handler 0 on 38522: exiting [junit] 2011-03-22 12:24:43,093 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(624)) - Exiting DataBlockScanner thread. [junit] 2011-03-22 12:24:43,093 INFO datanode.DataNode (DataNode.java:run(1464)) - DatanodeRegistration(127.0.0.1:49868, storageID=DS-1067466969-127.0.1.1-49868-1300796672121, infoPort=48806, ipcPort=38522):Finishing DataNode in: FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build-fi/test/data/dfs/data/data2/current/finalized'} [junit] 2011-03-22 12:24:43,094 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 38522 [junit] 2011-03-22 12:24:43,094 INFO datanode.DataNode (DataNode.java:shutdown(788)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2011-03-22 12:24:43,094 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk service threads... [junit] 2011-03-22 12:24:43,094 INFO datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads have been shut down. [junit] 2011-03-22 12:24:43,095 WARN datanode.FSDatasetAsyncDiskService (FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already shut down. [junit] 2011-03-22 12:24:43,196 WARN namenode.DecommissionManager (DecommissionManager.java:run(70)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted [junit] 2011-03-22 12:24:43,196 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(559)) - Number of transactions: 6 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 9 4 [junit] 2011-03-22 12:24:43,197 WARN namenode.FSNamesystem (FSNamesystem.java:run(2856)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted [junit] 2011-03-22 12:24:43,198 INFO ipc.Server (Server.java:stop(1626)) - Stopping server on 34268 [junit] 2011-03-22 12:24:43,198 INFO ipc.Server (Server.java:run(1459)) - IPC Server handler 0 on 34268: exiting [junit] 2011-03-22 12:24:43,199 INFO ipc.Server (Server.java:run(691)) - Stopping IPC Server Responder [junit] 2011-03-22 12:24:43,199 INFO ipc.Server (Server.java:run(487)) - Stopping IPC Server listener on 34268 [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 35.379 sec checkfailure: -run-test-hdfs-fault-inject-withtestcaseonly: run-test-hdfs-fault-inject: BUILD FAILED /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build.xml:749: Tests failed! Total time: 51 minutes 22 seconds [FINDBUGS] Skipping publisher since build result is FAILURE Publishing Javadoc Archiving artifacts Recording test results Recording fingerprints Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ################################################################################### ############################## FAILED TESTS (if any) ############################## 1 tests failed. FAILED: org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.testTransferRbw Error Message: 65536 = numBytes < visible = 95378, r=ReplicaInPipeline, blk_1818901318025178337_1001, TEMPORARY getNumBytes() = 65536 getBytesOnDisk() = 0 getVisibleLength()= -1 getVolume() = /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data3/current/finalized getBlockFile() = /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data3/tmp/blk_1818901318025178337 bytesAcked=0 bytesOnDisk=0 Stack Trace: org.apache.hadoop.hdfs.server.datanode.ReplicaNotFoundException: 65536 = numBytes < visible = 95378, r=ReplicaInPipeline, blk_1818901318025178337_1001, TEMPORARY getNumBytes() = 65536 getBytesOnDisk() = 0 getVisibleLength()= -1 getVolume() = /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data3/current/finalized getBlockFile() = /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data3/tmp/blk_1818901318025178337 bytesAcked=0 bytesOnDisk=0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.convertTemporaryToRbw(FSDataset.java:1387) at org.apache.hadoop.hdfs.server.datanode.DataNode.convertTemporaryToRbw(DataNode.java:2021) at org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.__CLR3_0_2r95sa9tg4(TestTransferRbw.java:121) at org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.testTransferRbw(TestTransferRbw.java:63)