See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/548/
################################################################################### ########################## LAST 60 LINES OF THE CONSOLE ########################### [...truncated 486448 lines...] [junit] 2011-01-10 12:03:47,966 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@localhost:50089 [junit] 2011-01-10 12:03:47,967 INFO namenode.NameNode (NameNode.java:run(523)) - NameNode Web-server up at: localhost/127.0.0.1:50089 [junit] 2011-01-10 12:03:47,968 INFO ipc.Server (Server.java:run(443)) - IPC Server listener on 36943: starting [junit] 2011-01-10 12:03:47,968 INFO ipc.Server (Server.java:run(608)) - IPC Server Responder: starting [junit] 2011-01-10 12:03:47,968 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 0 on 36943: starting [junit] 2011-01-10 12:03:47,969 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 2 on 36943: starting [junit] 2011-01-10 12:03:47,969 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 1 on 36943: starting [junit] 2011-01-10 12:03:47,969 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 3 on 36943: starting [junit] 2011-01-10 12:03:47,969 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 4 on 36943: starting [junit] 2011-01-10 12:03:47,970 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 5 on 36943: starting [junit] 2011-01-10 12:03:47,970 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 6 on 36943: starting [junit] 2011-01-10 12:03:47,970 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 7 on 36943: starting [junit] 2011-01-10 12:03:47,970 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 9 on 36943: starting [junit] 2011-01-10 12:03:47,970 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 8 on 36943: starting [junit] 2011-01-10 12:03:47,971 INFO namenode.NameNode (NameNode.java:initialize(390)) - NameNode up at: localhost/127.0.0.1:36943 [junit] Starting DataNode 0 with dfs.datanode.data.dir: file:/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1/,file:/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2/ [junit] 2011-01-10 12:03:48,145 INFO datanode.DataNode (DataNode.java:initDataXceiver(472)) - Opened info server at 51231 [junit] 2011-01-10 12:03:48,149 INFO datanode.DataNode (DataXceiverServer.java:<init>(77)) - Balancing bandwith is 1048576 bytes/s [junit] 2011-01-10 12:03:48,155 INFO common.Storage (DataStorage.java:recoverTransitionRead(127)) - Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1 is not formatted. [junit] 2011-01-10 12:03:48,156 INFO common.Storage (DataStorage.java:recoverTransitionRead(128)) - Formatting ... [junit] 2011-01-10 12:03:48,159 INFO common.Storage (DataStorage.java:recoverTransitionRead(127)) - Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2 is not formatted. [junit] 2011-01-10 12:03:48,159 INFO common.Storage (DataStorage.java:recoverTransitionRead(128)) - Formatting ... [junit] 2011-01-10 12:03:48,213 INFO datanode.DataNode (FSDataset.java:registerMBean(1772)) - Registered FSDatasetStatusMBean [junit] 2011-01-10 12:03:48,221 INFO datanode.DirectoryScanner (DirectoryScanner.java:<init>(149)) - scan starts at 1294678853221 with interval 21600000 [junit] 2011-01-10 12:03:48,223 INFO http.HttpServer (HttpServer.java:addGlobalFilter(409)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) [junit] 2011-01-10 12:03:48,226 INFO http.HttpServer (HttpServer.java:start(579)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2011-01-10 12:03:48,227 INFO http.HttpServer (HttpServer.java:start(584)) - listener.getLocalPort() returned 35084 webServer.getConnectors()[0].getLocalPort() returned 35084 [junit] 2011-01-10 12:03:48,227 INFO http.HttpServer (HttpServer.java:start(617)) - Jetty bound to port 35084 [junit] 2011-01-10 12:03:48,228 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2011-01-10 12:03:48,385 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@localhost:35084 [junit] 2011-01-10 12:03:48,387 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2011-01-10 12:03:48,391 INFO ipc.Server (Server.java:run(338)) - Starting SocketReader [junit] 2011-01-10 12:03:48,392 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(63)) - Initializing RPC Metrics with hostName=DataNode, port=48972 [junit] 2011-01-10 12:03:48,392 INFO metrics.RpcDetailedMetrics (RpcDetailedMetrics.java:<init>(57)) - Initializing RPC Metrics with hostName=DataNode, port=48972 [junit] 2011-01-10 12:03:48,394 INFO datanode.DataNode (DataNode.java:initIpcServer(432)) - dnRegistration = DatanodeRegistration(h9.grid.sp2.yahoo.net:51231, storageID=, infoPort=35084, ipcPort=48972) [junit] 2011-01-10 12:03:48,399 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2514)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:51231 storage DS-261089149-127.0.1.1-51231-1294661028397 [junit] 2011-01-10 12:03:48,406 INFO net.NetworkTopology (NetworkTopology.java:add(331)) - Adding a new node: /default-rack/127.0.0.1:51231 [junit] 2011-01-10 12:03:48,411 INFO datanode.DataNode (DataNode.java:register(714)) - New storage id DS-261089149-127.0.1.1-51231-1294661028397 is assigned to data-node 127.0.0.1:51231 [junit] 2011-01-10 12:03:48,412 INFO datanode.DataNode (DataNode.java:run(1438)) - DatanodeRegistration(127.0.0.1:51231, storageID=DS-261089149-127.0.1.1-51231-1294661028397, infoPort=35084, ipcPort=48972)In DataNode.run, data = FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2/current/finalized'} [junit] 2011-01-10 12:03:48,413 INFO ipc.Server (Server.java:run(608)) - IPC Server Responder: starting [junit] 2011-01-10 12:03:48,413 INFO ipc.Server (Server.java:run(443)) - IPC Server listener on 48972: starting [junit] 2011-01-10 12:03:48,413 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 0 on 48972: starting [junit] 2011-01-10 12:03:48,413 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 1 on 48972: starting [junit] 2011-01-10 12:03:48,414 INFO ipc.Server (Server.java:run(1369)) - IPC Server handler 2 on 48972: starting [junit] 2011-01-10 12:03:48,414 INFO datanode.DataNode (DataNode.java:offerService(904)) - using BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec [junit] 2011-01-10 12:03:48,426 INFO datanode.DataNode (DataNode.java:blockReport(1143)) - BlockReport of 0 blocks got processed in 8 msecs [junit] 2011-01-10 12:03:48,426 INFO datanode.DataNode (DataNode.java:offerService(946)) - Starting Periodic block scanner. [junit] 2011-01-10 12:03:48,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(148)) - ugi=hudson ip=/127.0.0.1 cmd=create src=/testWriteConf.xml dst=null perm=hudson:supergroup:rw-r--r-- [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 60.073 sec Build timed out. Aborting [FINDBUGS] Skipping publisher since build result is FAILURE Publishing Javadoc Archiving artifacts Recording test results Recording fingerprints Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ################################################################################### ############################## FAILED TESTS (if any) ############################## 3 tests failed. FAILED: org.apache.hadoop.hdfs.TestFileConcurrentReader.testUnfinishedBlockCRCErrorTransferToVerySmallWrite Error Message: java.io.FileNotFoundException: /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/classes/hdfs-default.xml (Too many open files) Stack Trace: java.lang.RuntimeException: java.io.FileNotFoundException: /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/classes/hdfs-default.xml (Too many open files) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1523) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1388) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1334) at org.apache.hadoop.conf.Configuration.set(Configuration.java:577) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:781) at org.apache.hadoop.hdfs.TestFileConcurrentReader.runTestUnfinishedBlockCRCError(TestFileConcurrentReader.java:313) at org.apache.hadoop.hdfs.TestFileConcurrentReader.runTestUnfinishedBlockCRCError(TestFileConcurrentReader.java:302) at org.apache.hadoop.hdfs.TestFileConcurrentReader.__CLR3_0_2u5mf5tqxn(TestFileConcurrentReader.java:275) at org.apache.hadoop.hdfs.TestFileConcurrentReader.testUnfinishedBlockCRCErrorTransferToVerySmallWrite(TestFileConcurrentReader.java:274) Caused by: java.io.FileNotFoundException: /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/classes/hdfs-default.xml (Too many open files) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.<init>(FileInputStream.java:106) at java.io.FileInputStream.<init>(FileInputStream.java:66) at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:70) at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:161) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:653) at com.sun.org.apache.xerces.internal.impl.XMLVersionDetector.determineDocVersion(XMLVersionDetector.java:186) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:225) at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:283) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:180) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1437) FAILED: org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.testWriteConf Error Message: test timed out after 60000 milliseconds Stack Trace: java.lang.Exception: test timed out after 60000 milliseconds at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at org.apache.hadoop.hdfs.DFSOutputStream.waitAndQueueCurrentPacket(DFSOutputStream.java:1169) at org.apache.hadoop.hdfs.DFSOutputStream.writeChunk(DFSOutputStream.java:1228) at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunk(FSOutputSummer.java:161) at org.apache.hadoop.fs.FSOutputSummer.write1(FSOutputSummer.java:104) at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:90) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:54) at java.io.DataOutputStream.write(DataOutputStream.java:90) at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202) at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:263) at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:106) at java.io.OutputStreamWriter.write(OutputStreamWriter.java:190) at com.sun.org.apache.xml.internal.serializer.ToStream.characters(ToStream.java:1499) at com.sun.org.apache.xml.internal.serializer.ToUnknownStream.characters(ToUnknownStream.java:789) at com.sun.org.apache.xml.internal.serializer.ToUnknownStream.characters(ToUnknownStream.java:323) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:240) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:132) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:94) at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662) at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708) at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313) at org.apache.hadoop.conf.Configuration.writeXml(Configuration.java:1608) at org.apache.hadoop.conf.Configuration.writeXml(Configuration.java:1559) at org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.__CLR3_0_28n7kbs1103(TestWriteConfigurationToDFS.java:46) at org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.testWriteConf(TestWriteConfigurationToDFS.java:33) FAILED: org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.testStorageRestore Error Message: Image file /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/secondary/current/fsimage is corrupt with MD5 checksum of 8ae344dba36f40d8329436e071f0f82a but expecting a3f08ee8cfb2a2902201330479fdd343 Stack Trace: java.io.IOException: Image file /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/secondary/current/fsimage is corrupt with MD5 checksum of 8ae344dba36f40d8329436e071f0f82a but expecting a3f08ee8cfb2a2902201330479fdd343 at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:1063) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:702) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$500(SecondaryNameNode.java:600) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:477) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:438) at org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.__CLR3_0_2dn2tm4tka(TestStorageRestore.java:316) at org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.testStorageRestore(TestStorageRestore.java:286)