See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/808/changes
Changes: [cdouglas] HADOOP-5652. Fix a bug where in-memory segments are incorrectly retained in memory. [cdouglas] HADOOP-5494. Modify sorted map output merger to lazily read values, rather than buffering at least one record for each segment. Contributed by Devaraj Das. ------------------------------------------ [...truncated 422349 lines...] [junit] Starting DataNode 0 with dfs.data.dir: http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2 [junit] 2009-04-16 00:31:45,692 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1 is not formatted. [junit] 2009-04-16 00:31:45,692 INFO common.Storage (DataStorage.java:recoverTransitionRead(124)) - Formatting ... [junit] 2009-04-16 00:31:45,696 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data2 is not formatted. [junit] 2009-04-16 00:31:45,697 INFO common.Storage (DataStorage.java:recoverTransitionRead(124)) - Formatting ... [junit] 2009-04-16 00:31:45,723 INFO datanode.DataNode (FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean [junit] 2009-04-16 00:31:45,724 INFO datanode.DataNode (DataNode.java:startDataNode(317)) - Opened info server at 58652 [junit] 2009-04-16 00:31:45,724 INFO datanode.DataNode (DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s [junit] 2009-04-16 00:31:45,725 INFO datanode.DirectoryScanner (DirectoryScanner.java:<init>(133)) - scan starts at 1239852806725 with interval 21600000 [junit] 2009-04-16 00:31:45,726 INFO http.HttpServer (HttpServer.java:start(454)) - Jetty bound to port 41871 [junit] 2009-04-16 00:31:45,727 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2009-04-16 00:31:45,795 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@localhost:41871 [junit] 2009-04-16 00:31:45,796 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2009-04-16 00:31:45,797 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, port=51107 [junit] 2009-04-16 00:31:45,798 INFO ipc.Server (Server.java:run(471)) - IPC Server Responder: starting [junit] 2009-04-16 00:31:45,798 INFO datanode.DataNode (DataNode.java:startDataNode(396)) - dnRegistration = DatanodeRegistration(vesta.apache.org:58652, storageID=, infoPort=41871, ipcPort=51107) [junit] 2009-04-16 00:31:45,798 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 2 on 51107: starting [junit] 2009-04-16 00:31:45,798 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 1 on 51107: starting [junit] 2009-04-16 00:31:45,798 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 0 on 51107: starting [junit] 2009-04-16 00:31:45,798 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 51107: starting [junit] 2009-04-16 00:31:45,800 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2084)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:58652 storage DS-1049361957-67.195.138.9-58652-1239841905799 [junit] 2009-04-16 00:31:45,800 INFO net.NetworkTopology (NetworkTopology.java:add(328)) - Adding a new node: /default-rack/127.0.0.1:58652 [junit] 2009-04-16 00:31:45,803 INFO datanode.DataNode (DataNode.java:register(554)) - New storage id DS-1049361957-67.195.138.9-58652-1239841905799 is assigned to data-node 127.0.0.1:58652 [junit] 2009-04-16 00:31:45,803 INFO datanode.DataNode (DataNode.java:run(1214)) - DatanodeRegistration(127.0.0.1:58652, storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, ipcPort=51107)In DataNode.run, data = FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2/current'} [junit] Starting DataNode 1 with dfs.data.dir: http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4 [junit] 2009-04-16 00:31:45,804 INFO datanode.DataNode (DataNode.java:offerService(696)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec [junit] 2009-04-16 00:31:45,813 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3 is not formatted. [junit] 2009-04-16 00:31:45,814 INFO common.Storage (DataStorage.java:recoverTransitionRead(124)) - Formatting ... [junit] 2009-04-16 00:31:45,823 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Storage directory http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data4 is not formatted. [junit] 2009-04-16 00:31:45,824 INFO common.Storage (DataStorage.java:recoverTransitionRead(124)) - Formatting ... [junit] 2009-04-16 00:31:45,840 INFO datanode.DataNode (DataNode.java:blockReport(925)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2009-04-16 00:31:45,841 INFO datanode.DataNode (DataNode.java:offerService(739)) - Starting Periodic block scanner. [junit] 2009-04-16 00:31:45,862 INFO datanode.DataNode (FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean [junit] 2009-04-16 00:31:45,863 INFO datanode.DataNode (DataNode.java:startDataNode(317)) - Opened info server at 50214 [junit] 2009-04-16 00:31:45,863 INFO datanode.DataNode (DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s [junit] 2009-04-16 00:31:45,863 INFO datanode.DirectoryScanner (DirectoryScanner.java:<init>(133)) - scan starts at 1239856900863 with interval 21600000 [junit] 2009-04-16 00:31:45,865 INFO http.HttpServer (HttpServer.java:start(454)) - Jetty bound to port 52520 [junit] 2009-04-16 00:31:45,865 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2009-04-16 00:31:45,933 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@localhost:52520 [junit] 2009-04-16 00:31:45,934 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2009-04-16 00:31:45,936 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, port=39335 [junit] 2009-04-16 00:31:45,938 INFO ipc.Server (Server.java:run(471)) - IPC Server Responder: starting [junit] 2009-04-16 00:31:45,938 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 1 on 39335: starting [junit] 2009-04-16 00:31:45,938 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 0 on 39335: starting [junit] 2009-04-16 00:31:45,938 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 39335: starting [junit] 2009-04-16 00:31:45,939 INFO datanode.DataNode (DataNode.java:startDataNode(396)) - dnRegistration = DatanodeRegistration(vesta.apache.org:50214, storageID=, infoPort=52520, ipcPort=39335) [junit] 2009-04-16 00:31:45,939 INFO ipc.Server (Server.java:run(934)) - IPC Server handler 2 on 39335: starting [junit] 2009-04-16 00:31:45,942 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2084)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:50214 storage DS-1482098445-67.195.138.9-50214-1239841905941 [junit] 2009-04-16 00:31:45,942 INFO net.NetworkTopology (NetworkTopology.java:add(328)) - Adding a new node: /default-rack/127.0.0.1:50214 [junit] 2009-04-16 00:31:45,945 INFO datanode.DataNode (DataNode.java:register(554)) - New storage id DS-1482098445-67.195.138.9-50214-1239841905941 is assigned to data-node 127.0.0.1:50214 [junit] 2009-04-16 00:31:45,945 INFO datanode.DataNode (DataNode.java:run(1214)) - DatanodeRegistration(127.0.0.1:50214, storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, ipcPort=39335)In DataNode.run, data = FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4/current'} [junit] 2009-04-16 00:31:45,945 INFO datanode.DataNode (DataNode.java:offerService(696)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec [junit] 2009-04-16 00:31:45,969 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] 2009-04-16 00:31:45,970 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] 2009-04-16 00:31:45,998 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] 2009-04-16 00:31:45,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(110)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=create src=/test dst=null perm=hudson:supergroup:rw-r--r-- [junit] 2009-04-16 00:31:46,012 WARN namenode.FSNamesystem (ReplicationTargetChooser.java:chooseTarget(184)) - Not able to place enough replicas, still in need of 1 [junit] 2009-04-16 00:31:46,013 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1479)) - BLOCK* NameSystem.allocateBlock: /test. blk_-5749979104287390356_1001 [junit] 2009-04-16 00:31:46,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(228)) - Receiving block blk_-5749979104287390356_1001 src: /127.0.0.1:49399 dest: /127.0.0.1:58652 [junit] 2009-04-16 00:31:46,016 INFO DataNode.clienttrace (BlockReceiver.java:lastDataNodeRun(805)) - src: /127.0.0.1:49399, dest: /127.0.0.1:58652, bytes: 4096, op: HDFS_WRITE, cliID: DFSClient_845888485, offset: 0, srvID: DS-1049361957-67.195.138.9-58652-1239841905799, blockid: blk_-5749979104287390356_1001 [junit] 2009-04-16 00:31:46,017 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(829)) - PacketResponder 0 for block blk_-5749979104287390356_1001 terminating [junit] 2009-04-16 00:31:46,018 WARN namenode.FSNamesystem (ReplicationTargetChooser.java:chooseTarget(184)) - Not able to place enough replicas, still in need of 1 [junit] 2009-04-16 00:31:46,018 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1479)) - BLOCK* NameSystem.allocateBlock: /test. blk_1711424159161289677_1001 [junit] 2009-04-16 00:31:46,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(228)) - Receiving block blk_1711424159161289677_1001 src: /127.0.0.1:49400 dest: /127.0.0.1:58652 [junit] 2009-04-16 00:31:46,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3086)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:58652 is added to blk_-5749979104287390356_1001 size 4096 [junit] 2009-04-16 00:31:46,021 INFO DataNode.clienttrace (BlockReceiver.java:lastDataNodeRun(805)) - src: /127.0.0.1:49400, dest: /127.0.0.1:58652, bytes: 4096, op: HDFS_WRITE, cliID: DFSClient_845888485, offset: 0, srvID: DS-1049361957-67.195.138.9-58652-1239841905799, blockid: blk_1711424159161289677_1001 [junit] 2009-04-16 00:31:46,022 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(829)) - PacketResponder 0 for block blk_1711424159161289677_1001 terminating [junit] 2009-04-16 00:31:46,023 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3086)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:58652 is added to blk_1711424159161289677_1001 size 4096 [junit] 2009-04-16 00:31:46,023 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] 2009-04-16 00:31:46,024 INFO datanode.DataNode (DataNode.java:blockReport(925)) - BlockReport of 0 blocks got processed in 2 msecs [junit] 2009-04-16 00:31:46,025 INFO datanode.DataNode (DataNode.java:offerService(739)) - Starting Periodic block scanner. [junit] 2009-04-16 00:31:46,029 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] init: server=localhost;port=;service=DataNode;localVMUrl=null [junit] [junit] Domains: [junit] Domain = JMImplementation [junit] Domain = com.sun.management [junit] Domain = hadoop [junit] Domain = java.lang [junit] Domain = java.util.logging [junit] [junit] MBeanServer default domain = DefaultDomain [junit] [junit] MBean count = 26 [junit] [junit] Query MBeanServer MBeans: [junit] hadoop services: hadoop:service=DataNode,name=DataNodeActivity-UndefinedStorageId-1940080771 [junit] hadoop services: hadoop:service=DataNode,name=DataNodeActivity-UndefinedStorageId822741109 [junit] hadoop services: hadoop:service=DataNode,name=FSDatasetState-UndefinedStorageId-295578041 [junit] hadoop services: hadoop:service=DataNode,name=FSDatasetState-UndefinedStorageId-570316769 [junit] hadoop services: hadoop:service=DataNode,name=RpcActivityForPort39335 [junit] hadoop services: hadoop:service=DataNode,name=RpcActivityForPort51107 [junit] Info: key = bytes_written; val = 0 [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 1 [junit] 2009-04-16 00:31:46,170 INFO ipc.Server (Server.java:stop(1098)) - Stopping server on 39335 [junit] 2009-04-16 00:31:46,170 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 0 on 39335: exiting [junit] 2009-04-16 00:31:46,171 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 39335 [junit] 2009-04-16 00:31:46,171 INFO ipc.Server (Server.java:run(536)) - Stopping IPC Server Responder [junit] 2009-04-16 00:31:46,171 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:50214, storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, ipcPort=39335):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-04-16 00:31:46,171 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 1 on 39335: exiting [junit] 2009-04-16 00:31:46,171 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 2 on 39335: exiting [junit] 2009-04-16 00:31:46,172 INFO datanode.DataNode (DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-04-16 00:31:46,172 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(618)) - Exiting DataBlockScanner thread. [junit] 2009-04-16 00:31:46,173 INFO datanode.DataNode (DataNode.java:run(1234)) - DatanodeRegistration(127.0.0.1:50214, storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, ipcPort=39335):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4/current'} [junit] 2009-04-16 00:31:46,173 INFO ipc.Server (Server.java:stop(1098)) - Stopping server on 39335 [junit] 2009-04-16 00:31:46,173 INFO datanode.DataNode (DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 0 [junit] 2009-04-16 00:31:46,275 INFO ipc.Server (Server.java:stop(1098)) - Stopping server on 51107 [junit] 2009-04-16 00:31:46,275 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 0 on 51107: exiting [junit] 2009-04-16 00:31:46,275 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 51107 [junit] 2009-04-16 00:31:46,275 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:58652, storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, ipcPort=51107):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-04-16 00:31:46,275 INFO ipc.Server (Server.java:run(536)) - Stopping IPC Server Responder [junit] 2009-04-16 00:31:46,276 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 1 on 51107: exiting [junit] 2009-04-16 00:31:46,276 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 2 on 51107: exiting [junit] 2009-04-16 00:31:46,277 INFO datanode.DataNode (DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-04-16 00:31:46,277 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(618)) - Exiting DataBlockScanner thread. [junit] 2009-04-16 00:31:46,277 INFO datanode.DataNode (DataNode.java:run(1234)) - DatanodeRegistration(127.0.0.1:58652, storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, ipcPort=51107):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2/current'} [junit] 2009-04-16 00:31:46,278 INFO ipc.Server (Server.java:stop(1098)) - Stopping server on 51107 [junit] 2009-04-16 00:31:46,278 INFO datanode.DataNode (DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-04-16 00:31:46,379 WARN namenode.DecommissionManager (DecommissionManager.java:run(67)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted [junit] 2009-04-16 00:31:46,379 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1082)) - Number of transactions: 3 Total time for transactions(ms): 1Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 22 11 [junit] 2009-04-16 00:31:46,380 WARN namenode.FSNamesystem (FSNamesystem.java:run(2359)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted [junit] 2009-04-16 00:31:46,380 INFO namenode.FSNamesystem (FSEditLog.java:processIOError(471)) - current list of storage dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS); [junit] 2009-04-16 00:31:46,381 INFO ipc.Server (Server.java:stop(1098)) - Stopping server on 60071 [junit] 2009-04-16 00:31:46,381 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 0 on 60071: exiting [junit] 2009-04-16 00:31:46,381 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 1 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(536)) - Stopping IPC Server Responder [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 4 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 6 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 8 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 5 on 60071: exiting [junit] 2009-04-16 00:31:46,383 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 60071 [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 2 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 7 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 9 on 60071: exiting [junit] 2009-04-16 00:31:46,382 INFO ipc.Server (Server.java:run(992)) - IPC Server handler 3 on 60071: exiting [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 4.047 sec [junit] Running org.apache.hadoop.util.TestCyclicIteration [junit] [junit] [junit] integers=[] [junit] map={} [junit] start=-1, iteration=[] [junit] [junit] [junit] integers=[0] [junit] map={0=0} [junit] start=-1, iteration=[0] [junit] start=0, iteration=[0] [junit] start=1, iteration=[0] [junit] [junit] [junit] integers=[0, 2] [junit] map={0=0, 2=2} [junit] start=-1, iteration=[0, 2] [junit] start=0, iteration=[2, 0] [junit] start=1, iteration=[2, 0] [junit] start=2, iteration=[0, 2] [junit] start=3, iteration=[0, 2] [junit] [junit] [junit] integers=[0, 2, 4] [junit] map={0=0, 2=2, 4=4} [junit] start=-1, iteration=[0, 2, 4] [junit] start=0, iteration=[2, 4, 0] [junit] start=1, iteration=[2, 4, 0] [junit] start=2, iteration=[4, 0, 2] [junit] start=3, iteration=[4, 0, 2] [junit] start=4, iteration=[0, 2, 4] [junit] start=5, iteration=[0, 2, 4] [junit] [junit] [junit] integers=[0, 2, 4, 6] [junit] map={0=0, 2=2, 4=4, 6=6} [junit] start=-1, iteration=[0, 2, 4, 6] [junit] start=0, iteration=[2, 4, 6, 0] [junit] start=1, iteration=[2, 4, 6, 0] [junit] start=2, iteration=[4, 6, 0, 2] [junit] start=3, iteration=[4, 6, 0, 2] [junit] start=4, iteration=[6, 0, 2, 4] [junit] start=5, iteration=[6, 0, 2, 4] [junit] start=6, iteration=[0, 2, 4, 6] [junit] start=7, iteration=[0, 2, 4, 6] [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.095 sec [junit] Running org.apache.hadoop.util.TestGenericsUtil [junit] 2009-04-16 00:31:47,228 WARN conf.Configuration (Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively [junit] 2009-04-16 00:31:47,241 WARN util.GenericOptionsParser (GenericOptionsParser.java:parseGeneralOptions(377)) - options parsing failed: Missing argument for option:jt [junit] usage: general options are: [junit] -archives <paths> comma separated archives to be unarchived [junit] on the compute machines. [junit] -conf <configuration file> specify an application configuration file [junit] -D <property=value> use value for given property [junit] -files <paths> comma separated files to be copied to the [junit] map reduce cluster [junit] -fs <local|namenode:port> specify a namenode [junit] -jt <local|jobtracker:port> specify a job tracker [junit] -libjars <paths> comma separated jar files to include in the [junit] classpath. [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.183 sec [junit] Running org.apache.hadoop.util.TestIndexedSort [junit] sortRandom seed: 6220126095491457729(org.apache.hadoop.util.QuickSort) [junit] testSorted seed: 6879880268530561606(org.apache.hadoop.util.QuickSort) [junit] testAllEqual setting min/max at 127/110(org.apache.hadoop.util.QuickSort) [junit] sortWritable seed: -5012941041600628027(org.apache.hadoop.util.QuickSort) [junit] QuickSort degen cmp/swp: 23252/3713(org.apache.hadoop.util.QuickSort) [junit] sortRandom seed: -3620411627411460254(org.apache.hadoop.util.HeapSort) [junit] testSorted seed: -6153794192447161273(org.apache.hadoop.util.HeapSort) [junit] testAllEqual setting min/max at 102/161(org.apache.hadoop.util.HeapSort) [junit] sortWritable seed: -8717493133462479910(org.apache.hadoop.util.HeapSort) [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.004 sec [junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree [junit] 2009-04-16 00:31:49,054 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(54)) - setsid exited with exit code 0 [junit] 2009-04-16 00:31:49,559 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:testProcessTree(141)) - Root process pid: 10373 [junit] 2009-04-16 00:31:49,606 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:testProcessTree(146)) - ProcessTree: [ 10376 10375 10373 ] [junit] 2009-04-16 00:31:56,144 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:testProcessTree(159)) - ProcessTree: [ 10377 10393 10382 10386 10384 10390 10375 10388 10373 ] [junit] 2009-04-16 00:31:56,158 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:run(64)) - Shell Command exit with a non-zero exit code. This is expected as we are killing the subprocesses of the task intentionally. org.apache.hadoop.util.Shell$ExitCodeException: [junit] 2009-04-16 00:31:56,158 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:run(70)) - Exit code: 143 [junit] 2009-04-16 00:31:56,160 INFO util.ProcessTree (ProcessTree.java:destroyProcessGroup(160)) - Killing all processes in the process group 10373 with SIGTERM. Exit code 0 [junit] 2009-04-16 00:31:56,211 INFO util.TestProcfsBasedProcessTree (TestProcfsBasedProcessTree.java:testProcessTree(173)) - RogueTaskThread successfully joined. [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.247 sec [junit] Running org.apache.hadoop.util.TestReflectionUtils [junit] 2009-04-16 00:31:57,124 WARN conf.Configuration (Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.573 sec [junit] Running org.apache.hadoop.util.TestShell [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.188 sec [junit] Running org.apache.hadoop.util.TestStringUtils [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.09 sec BUILD FAILED http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build.xml :770: Tests failed! Total time: 186 minutes 22 seconds Publishing Javadoc Recording test results Recording fingerprints Publishing Clover coverage report...