See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/808/changes

Changes:

[cdouglas] HADOOP-5652. Fix a bug where in-memory segments are incorrectly 
retained in memory.

[cdouglas] HADOOP-5494. Modify sorted map output merger to lazily read values,
rather than buffering at least one record for each segment. Contributed by 
Devaraj Das.

------------------------------------------
[...truncated 422349 lines...]
    [junit] Starting DataNode 0 with dfs.data.dir: 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2
 
    [junit] 2009-04-16 00:31:45,692 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(123)) - Storage directory 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1
  is not formatted.
    [junit] 2009-04-16 00:31:45,692 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(124)) - Formatting ...
    [junit] 2009-04-16 00:31:45,696 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(123)) - Storage directory 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data2
  is not formatted.
    [junit] 2009-04-16 00:31:45,697 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(124)) - Formatting ...
    [junit] 2009-04-16 00:31:45,723 INFO  datanode.DataNode 
(FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean
    [junit] 2009-04-16 00:31:45,724 INFO  datanode.DataNode 
(DataNode.java:startDataNode(317)) - Opened info server at 58652
    [junit] 2009-04-16 00:31:45,724 INFO  datanode.DataNode 
(DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s
    [junit] 2009-04-16 00:31:45,725 INFO  datanode.DirectoryScanner 
(DirectoryScanner.java:<init>(133)) - scan starts at 1239852806725 with 
interval 21600000
    [junit] 2009-04-16 00:31:45,726 INFO  http.HttpServer 
(HttpServer.java:start(454)) - Jetty bound to port 41871
    [junit] 2009-04-16 00:31:45,727 INFO  mortbay.log (?:invoke0(?)) - 
jetty-6.1.14
    [junit] 2009-04-16 00:31:45,795 INFO  mortbay.log (?:invoke0(?)) - Started 
selectchannelconnec...@localhost:41871
    [junit] 2009-04-16 00:31:45,796 INFO  jvm.JvmMetrics 
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with 
processName=DataNode, sessionId=null - already initialized
    [junit] 2009-04-16 00:31:45,797 INFO  metrics.RpcMetrics 
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, 
port=51107
    [junit] 2009-04-16 00:31:45,798 INFO  ipc.Server (Server.java:run(471)) - 
IPC Server Responder: starting
    [junit] 2009-04-16 00:31:45,798 INFO  datanode.DataNode 
(DataNode.java:startDataNode(396)) - dnRegistration = 
DatanodeRegistration(vesta.apache.org:58652, storageID=, infoPort=41871, 
ipcPort=51107)
    [junit] 2009-04-16 00:31:45,798 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 2 on 51107: starting
    [junit] 2009-04-16 00:31:45,798 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 1 on 51107: starting
    [junit] 2009-04-16 00:31:45,798 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 0 on 51107: starting
    [junit] 2009-04-16 00:31:45,798 INFO  ipc.Server (Server.java:run(313)) - 
IPC Server listener on 51107: starting
    [junit] 2009-04-16 00:31:45,800 INFO  hdfs.StateChange 
(FSNamesystem.java:registerDatanode(2084)) - BLOCK* 
NameSystem.registerDatanode: node registration from 127.0.0.1:58652 storage 
DS-1049361957-67.195.138.9-58652-1239841905799
    [junit] 2009-04-16 00:31:45,800 INFO  net.NetworkTopology 
(NetworkTopology.java:add(328)) - Adding a new node: 
/default-rack/127.0.0.1:58652
    [junit] 2009-04-16 00:31:45,803 INFO  datanode.DataNode 
(DataNode.java:register(554)) - New storage id 
DS-1049361957-67.195.138.9-58652-1239841905799 is assigned to data-node 
127.0.0.1:58652
    [junit] 2009-04-16 00:31:45,803 INFO  datanode.DataNode 
(DataNode.java:run(1214)) - DatanodeRegistration(127.0.0.1:58652, 
storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, 
ipcPort=51107)In DataNode.run, data = 
FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2/current'}
 
    [junit] Starting DataNode 1 with dfs.data.dir: 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4
 
    [junit] 2009-04-16 00:31:45,804 INFO  datanode.DataNode 
(DataNode.java:offerService(696)) - using BLOCKREPORT_INTERVAL of 3600000msec 
Initial delay: 0msec
    [junit] 2009-04-16 00:31:45,813 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(123)) - Storage directory 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3
  is not formatted.
    [junit] 2009-04-16 00:31:45,814 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(124)) - Formatting ...
    [junit] 2009-04-16 00:31:45,823 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(123)) - Storage directory 
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data4
  is not formatted.
    [junit] 2009-04-16 00:31:45,824 INFO  common.Storage 
(DataStorage.java:recoverTransitionRead(124)) - Formatting ...
    [junit] 2009-04-16 00:31:45,840 INFO  datanode.DataNode 
(DataNode.java:blockReport(925)) - BlockReport of 0 blocks got processed in 1 
msecs
    [junit] 2009-04-16 00:31:45,841 INFO  datanode.DataNode 
(DataNode.java:offerService(739)) - Starting Periodic block scanner.
    [junit] 2009-04-16 00:31:45,862 INFO  datanode.DataNode 
(FSDataset.java:registerMBean(1417)) - Registered FSDatasetStatusMBean
    [junit] 2009-04-16 00:31:45,863 INFO  datanode.DataNode 
(DataNode.java:startDataNode(317)) - Opened info server at 50214
    [junit] 2009-04-16 00:31:45,863 INFO  datanode.DataNode 
(DataXceiverServer.java:<init>(74)) - Balancing bandwith is 1048576 bytes/s
    [junit] 2009-04-16 00:31:45,863 INFO  datanode.DirectoryScanner 
(DirectoryScanner.java:<init>(133)) - scan starts at 1239856900863 with 
interval 21600000
    [junit] 2009-04-16 00:31:45,865 INFO  http.HttpServer 
(HttpServer.java:start(454)) - Jetty bound to port 52520
    [junit] 2009-04-16 00:31:45,865 INFO  mortbay.log (?:invoke0(?)) - 
jetty-6.1.14
    [junit] 2009-04-16 00:31:45,933 INFO  mortbay.log (?:invoke0(?)) - Started 
selectchannelconnec...@localhost:52520
    [junit] 2009-04-16 00:31:45,934 INFO  jvm.JvmMetrics 
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with 
processName=DataNode, sessionId=null - already initialized
    [junit] 2009-04-16 00:31:45,936 INFO  metrics.RpcMetrics 
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=DataNode, 
port=39335
    [junit] 2009-04-16 00:31:45,938 INFO  ipc.Server (Server.java:run(471)) - 
IPC Server Responder: starting
    [junit] 2009-04-16 00:31:45,938 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 1 on 39335: starting
    [junit] 2009-04-16 00:31:45,938 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 0 on 39335: starting
    [junit] 2009-04-16 00:31:45,938 INFO  ipc.Server (Server.java:run(313)) - 
IPC Server listener on 39335: starting
    [junit] 2009-04-16 00:31:45,939 INFO  datanode.DataNode 
(DataNode.java:startDataNode(396)) - dnRegistration = 
DatanodeRegistration(vesta.apache.org:50214, storageID=, infoPort=52520, 
ipcPort=39335)
    [junit] 2009-04-16 00:31:45,939 INFO  ipc.Server (Server.java:run(934)) - 
IPC Server handler 2 on 39335: starting
    [junit] 2009-04-16 00:31:45,942 INFO  hdfs.StateChange 
(FSNamesystem.java:registerDatanode(2084)) - BLOCK* 
NameSystem.registerDatanode: node registration from 127.0.0.1:50214 storage 
DS-1482098445-67.195.138.9-50214-1239841905941
    [junit] 2009-04-16 00:31:45,942 INFO  net.NetworkTopology 
(NetworkTopology.java:add(328)) - Adding a new node: 
/default-rack/127.0.0.1:50214
    [junit] 2009-04-16 00:31:45,945 INFO  datanode.DataNode 
(DataNode.java:register(554)) - New storage id 
DS-1482098445-67.195.138.9-50214-1239841905941 is assigned to data-node 
127.0.0.1:50214
    [junit] 2009-04-16 00:31:45,945 INFO  datanode.DataNode 
(DataNode.java:run(1214)) - DatanodeRegistration(127.0.0.1:50214, 
storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, 
ipcPort=39335)In DataNode.run, data = 
FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4/current'}
 
    [junit] 2009-04-16 00:31:45,945 INFO  datanode.DataNode 
(DataNode.java:offerService(696)) - using BLOCKREPORT_INTERVAL of 3600000msec 
Initial delay: 0msec
    [junit] 2009-04-16 00:31:45,969 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] 2009-04-16 00:31:45,970 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] 2009-04-16 00:31:45,998 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] 2009-04-16 00:31:45,999 INFO  FSNamesystem.audit 
(FSNamesystem.java:logAuditEvent(110)) - ugi=hudson,hudson ip=/127.0.0.1   
cmd=create      src=/test       dst=null        perm=hudson:supergroup:rw-r--r--
    [junit] 2009-04-16 00:31:46,012 WARN  namenode.FSNamesystem 
(ReplicationTargetChooser.java:chooseTarget(184)) - Not able to place enough 
replicas, still in need of 1
    [junit] 2009-04-16 00:31:46,013 INFO  hdfs.StateChange 
(FSNamesystem.java:allocateBlock(1479)) - BLOCK* NameSystem.allocateBlock: 
/test. blk_-5749979104287390356_1001
    [junit] 2009-04-16 00:31:46,014 INFO  datanode.DataNode 
(DataXceiver.java:writeBlock(228)) - Receiving block 
blk_-5749979104287390356_1001 src: /127.0.0.1:49399 dest: /127.0.0.1:58652
    [junit] 2009-04-16 00:31:46,016 INFO  DataNode.clienttrace 
(BlockReceiver.java:lastDataNodeRun(805)) - src: /127.0.0.1:49399, dest: 
/127.0.0.1:58652, bytes: 4096, op: HDFS_WRITE, cliID: DFSClient_845888485, 
offset: 0, srvID: DS-1049361957-67.195.138.9-58652-1239841905799, blockid: 
blk_-5749979104287390356_1001
    [junit] 2009-04-16 00:31:46,017 INFO  datanode.DataNode 
(BlockReceiver.java:lastDataNodeRun(829)) - PacketResponder 0 for block 
blk_-5749979104287390356_1001 terminating
    [junit] 2009-04-16 00:31:46,018 WARN  namenode.FSNamesystem 
(ReplicationTargetChooser.java:chooseTarget(184)) - Not able to place enough 
replicas, still in need of 1
    [junit] 2009-04-16 00:31:46,018 INFO  hdfs.StateChange 
(FSNamesystem.java:allocateBlock(1479)) - BLOCK* NameSystem.allocateBlock: 
/test. blk_1711424159161289677_1001
    [junit] 2009-04-16 00:31:46,020 INFO  datanode.DataNode 
(DataXceiver.java:writeBlock(228)) - Receiving block 
blk_1711424159161289677_1001 src: /127.0.0.1:49400 dest: /127.0.0.1:58652
    [junit] 2009-04-16 00:31:46,021 INFO  hdfs.StateChange 
(FSNamesystem.java:addStoredBlock(3086)) - BLOCK* NameSystem.addStoredBlock: 
blockMap updated: 127.0.0.1:58652 is added to blk_-5749979104287390356_1001 
size 4096
    [junit] 2009-04-16 00:31:46,021 INFO  DataNode.clienttrace 
(BlockReceiver.java:lastDataNodeRun(805)) - src: /127.0.0.1:49400, dest: 
/127.0.0.1:58652, bytes: 4096, op: HDFS_WRITE, cliID: DFSClient_845888485, 
offset: 0, srvID: DS-1049361957-67.195.138.9-58652-1239841905799, blockid: 
blk_1711424159161289677_1001
    [junit] 2009-04-16 00:31:46,022 INFO  datanode.DataNode 
(BlockReceiver.java:lastDataNodeRun(829)) - PacketResponder 0 for block 
blk_1711424159161289677_1001 terminating
    [junit] 2009-04-16 00:31:46,023 INFO  hdfs.StateChange 
(FSNamesystem.java:addStoredBlock(3086)) - BLOCK* NameSystem.addStoredBlock: 
blockMap updated: 127.0.0.1:58652 is added to blk_1711424159161289677_1001 size 
4096
    [junit] 2009-04-16 00:31:46,023 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] 2009-04-16 00:31:46,024 INFO  datanode.DataNode 
(DataNode.java:blockReport(925)) - BlockReport of 0 blocks got processed in 2 
msecs
    [junit] 2009-04-16 00:31:46,025 INFO  datanode.DataNode 
(DataNode.java:offerService(739)) - Starting Periodic block scanner.
    [junit] 2009-04-16 00:31:46,029 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] init: server=localhost;port=;service=DataNode;localVMUrl=null
    [junit] 
    [junit] Domains:
    [junit]     Domain = JMImplementation
    [junit]     Domain = com.sun.management
    [junit]     Domain = hadoop
    [junit]     Domain = java.lang
    [junit]     Domain = java.util.logging
    [junit] 
    [junit] MBeanServer default domain = DefaultDomain
    [junit] 
    [junit] MBean count = 26
    [junit] 
    [junit] Query MBeanServer MBeans:
    [junit] hadoop services: 
hadoop:service=DataNode,name=DataNodeActivity-UndefinedStorageId-1940080771
    [junit] hadoop services: 
hadoop:service=DataNode,name=DataNodeActivity-UndefinedStorageId822741109
    [junit] hadoop services: 
hadoop:service=DataNode,name=FSDatasetState-UndefinedStorageId-295578041
    [junit] hadoop services: 
hadoop:service=DataNode,name=FSDatasetState-UndefinedStorageId-570316769
    [junit] hadoop services: 
hadoop:service=DataNode,name=RpcActivityForPort39335
    [junit] hadoop services: 
hadoop:service=DataNode,name=RpcActivityForPort51107
    [junit] Info: key = bytes_written; val = 0
    [junit] Shutting down the Mini HDFS Cluster
    [junit] Shutting down DataNode 1
    [junit] 2009-04-16 00:31:46,170 INFO  ipc.Server (Server.java:stop(1098)) - 
Stopping server on 39335
    [junit] 2009-04-16 00:31:46,170 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 0 on 39335: exiting
    [junit] 2009-04-16 00:31:46,171 INFO  ipc.Server (Server.java:run(352)) - 
Stopping IPC Server listener on 39335
    [junit] 2009-04-16 00:31:46,171 INFO  ipc.Server (Server.java:run(536)) - 
Stopping IPC Server Responder
    [junit] 2009-04-16 00:31:46,171 WARN  datanode.DataNode 
(DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:50214, 
storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, 
ipcPort=39335):DataXceiveServer: java.nio.channels.AsynchronousCloseException
    [junit]     at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
    [junit]     at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
    [junit]     at 
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
    [junit]     at 
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
    [junit]     at java.lang.Thread.run(Thread.java:619)
    [junit] 
    [junit] 2009-04-16 00:31:46,171 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 1 on 39335: exiting
    [junit] 2009-04-16 00:31:46,171 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 2 on 39335: exiting
    [junit] 2009-04-16 00:31:46,172 INFO  datanode.DataNode 
(DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads 
is 0
    [junit] 2009-04-16 00:31:46,172 INFO  datanode.DataBlockScanner 
(DataBlockScanner.java:run(618)) - Exiting DataBlockScanner thread.
    [junit] 2009-04-16 00:31:46,173 INFO  datanode.DataNode 
(DataNode.java:run(1234)) - DatanodeRegistration(127.0.0.1:50214, 
storageID=DS-1482098445-67.195.138.9-50214-1239841905941, infoPort=52520, 
ipcPort=39335):Finishing DataNode in: 
FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data4/current'}
 
    [junit] 2009-04-16 00:31:46,173 INFO  ipc.Server (Server.java:stop(1098)) - 
Stopping server on 39335
    [junit] 2009-04-16 00:31:46,173 INFO  datanode.DataNode 
(DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads 
is 0
    [junit] Shutting down DataNode 0
    [junit] 2009-04-16 00:31:46,275 INFO  ipc.Server (Server.java:stop(1098)) - 
Stopping server on 51107
    [junit] 2009-04-16 00:31:46,275 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 0 on 51107: exiting
    [junit] 2009-04-16 00:31:46,275 INFO  ipc.Server (Server.java:run(352)) - 
Stopping IPC Server listener on 51107
    [junit] 2009-04-16 00:31:46,275 WARN  datanode.DataNode 
(DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:58652, 
storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, 
ipcPort=51107):DataXceiveServer: java.nio.channels.AsynchronousCloseException
    [junit]     at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
    [junit]     at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
    [junit]     at 
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
    [junit]     at 
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
    [junit]     at java.lang.Thread.run(Thread.java:619)
    [junit] 
    [junit] 2009-04-16 00:31:46,275 INFO  ipc.Server (Server.java:run(536)) - 
Stopping IPC Server Responder
    [junit] 2009-04-16 00:31:46,276 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 1 on 51107: exiting
    [junit] 2009-04-16 00:31:46,276 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 2 on 51107: exiting
    [junit] 2009-04-16 00:31:46,277 INFO  datanode.DataNode 
(DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads 
is 0
    [junit] 2009-04-16 00:31:46,277 INFO  datanode.DataBlockScanner 
(DataBlockScanner.java:run(618)) - Exiting DataBlockScanner thread.
    [junit] 2009-04-16 00:31:46,277 INFO  datanode.DataNode 
(DataNode.java:run(1234)) - DatanodeRegistration(127.0.0.1:58652, 
storageID=DS-1049361957-67.195.138.9-58652-1239841905799, infoPort=41871, 
ipcPort=51107):Finishing DataNode in: 
FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/data/data1/current,/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/data/data2/current'}
 
    [junit] 2009-04-16 00:31:46,278 INFO  ipc.Server (Server.java:stop(1098)) - 
Stopping server on 51107
    [junit] 2009-04-16 00:31:46,278 INFO  datanode.DataNode 
(DataNode.java:shutdown(604)) - Waiting for threadgroup to exit, active threads 
is 0
    [junit] 2009-04-16 00:31:46,379 WARN  namenode.DecommissionManager 
(DecommissionManager.java:run(67)) - Monitor interrupted: 
java.lang.InterruptedException: sleep interrupted
    [junit] 2009-04-16 00:31:46,379 INFO  namenode.FSNamesystem 
(FSEditLog.java:printStatistics(1082)) - Number of transactions: 3 Total time 
for transactions(ms): 1Number of transactions batched in Syncs: 0 Number of 
syncs: 2 SyncTimes(ms): 22 11 
    [junit] 2009-04-16 00:31:46,380 WARN  namenode.FSNamesystem 
(FSNamesystem.java:run(2359)) - ReplicationMonitor thread received 
InterruptedException.java.lang.InterruptedException: sleep interrupted
    [junit] 2009-04-16 00:31:46,380 INFO  namenode.FSNamesystem 
(FSEditLog.java:processIOError(471)) - current list of storage 
dirs:http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/data/dfs/name1(IMAGE_AND_EDITS);/home/hudson/hudson-slave/workspace/Hadoop-trunk/trunk/build/test/data/dfs/name2(IMAGE_AND_EDITS);
 
    [junit] 2009-04-16 00:31:46,381 INFO  ipc.Server (Server.java:stop(1098)) - 
Stopping server on 60071
    [junit] 2009-04-16 00:31:46,381 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 0 on 60071: exiting
    [junit] 2009-04-16 00:31:46,381 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 1 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(536)) - 
Stopping IPC Server Responder
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 4 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 6 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 8 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 5 on 60071: exiting
    [junit] 2009-04-16 00:31:46,383 INFO  ipc.Server (Server.java:run(352)) - 
Stopping IPC Server listener on 60071
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 2 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 7 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 9 on 60071: exiting
    [junit] 2009-04-16 00:31:46,382 INFO  ipc.Server (Server.java:run(992)) - 
IPC Server handler 3 on 60071: exiting
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 4.047 sec
    [junit] Running org.apache.hadoop.util.TestCyclicIteration
    [junit] 
    [junit] 
    [junit] integers=[]
    [junit] map={}
    [junit] start=-1, iteration=[]
    [junit] 
    [junit] 
    [junit] integers=[0]
    [junit] map={0=0}
    [junit] start=-1, iteration=[0]
    [junit] start=0, iteration=[0]
    [junit] start=1, iteration=[0]
    [junit] 
    [junit] 
    [junit] integers=[0, 2]
    [junit] map={0=0, 2=2}
    [junit] start=-1, iteration=[0, 2]
    [junit] start=0, iteration=[2, 0]
    [junit] start=1, iteration=[2, 0]
    [junit] start=2, iteration=[0, 2]
    [junit] start=3, iteration=[0, 2]
    [junit] 
    [junit] 
    [junit] integers=[0, 2, 4]
    [junit] map={0=0, 2=2, 4=4}
    [junit] start=-1, iteration=[0, 2, 4]
    [junit] start=0, iteration=[2, 4, 0]
    [junit] start=1, iteration=[2, 4, 0]
    [junit] start=2, iteration=[4, 0, 2]
    [junit] start=3, iteration=[4, 0, 2]
    [junit] start=4, iteration=[0, 2, 4]
    [junit] start=5, iteration=[0, 2, 4]
    [junit] 
    [junit] 
    [junit] integers=[0, 2, 4, 6]
    [junit] map={0=0, 2=2, 4=4, 6=6}
    [junit] start=-1, iteration=[0, 2, 4, 6]
    [junit] start=0, iteration=[2, 4, 6, 0]
    [junit] start=1, iteration=[2, 4, 6, 0]
    [junit] start=2, iteration=[4, 6, 0, 2]
    [junit] start=3, iteration=[4, 6, 0, 2]
    [junit] start=4, iteration=[6, 0, 2, 4]
    [junit] start=5, iteration=[6, 0, 2, 4]
    [junit] start=6, iteration=[0, 2, 4, 6]
    [junit] start=7, iteration=[0, 2, 4, 6]
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.095 sec
    [junit] Running org.apache.hadoop.util.TestGenericsUtil
    [junit] 2009-04-16 00:31:47,228 WARN  conf.Configuration 
(Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in the 
classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, 
mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, 
mapred-default.xml and hdfs-default.xml respectively
    [junit] 2009-04-16 00:31:47,241 WARN  util.GenericOptionsParser 
(GenericOptionsParser.java:parseGeneralOptions(377)) - options parsing failed: 
Missing argument for option:jt
    [junit] usage: general options are:
    [junit]  -archives <paths>             comma separated archives to be 
unarchived
    [junit]                                on the compute machines.
    [junit]  -conf <configuration file>    specify an application configuration 
file
    [junit]  -D <property=value>           use value for given property
    [junit]  -files <paths>                comma separated files to be copied 
to the
    [junit]                                map reduce cluster
    [junit]  -fs <local|namenode:port>     specify a namenode
    [junit]  -jt <local|jobtracker:port>   specify a job tracker
    [junit]  -libjars <paths>              comma separated jar files to include 
in the
    [junit]                                classpath.
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.183 sec
    [junit] Running org.apache.hadoop.util.TestIndexedSort
    [junit] sortRandom seed: 
6220126095491457729(org.apache.hadoop.util.QuickSort)
    [junit] testSorted seed: 
6879880268530561606(org.apache.hadoop.util.QuickSort)
    [junit] testAllEqual setting min/max at 
127/110(org.apache.hadoop.util.QuickSort)
    [junit] sortWritable seed: 
-5012941041600628027(org.apache.hadoop.util.QuickSort)
    [junit] QuickSort degen cmp/swp: 
23252/3713(org.apache.hadoop.util.QuickSort)
    [junit] sortRandom seed: 
-3620411627411460254(org.apache.hadoop.util.HeapSort)
    [junit] testSorted seed: 
-6153794192447161273(org.apache.hadoop.util.HeapSort)
    [junit] testAllEqual setting min/max at 
102/161(org.apache.hadoop.util.HeapSort)
    [junit] sortWritable seed: 
-8717493133462479910(org.apache.hadoop.util.HeapSort)
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.004 sec
    [junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree
    [junit] 2009-04-16 00:31:49,054 INFO  util.ProcessTree 
(ProcessTree.java:isSetsidSupported(54)) - setsid exited with exit code 0
    [junit] 2009-04-16 00:31:49,559 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:testProcessTree(141)) - Root process pid: 10373
    [junit] 2009-04-16 00:31:49,606 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:testProcessTree(146)) - ProcessTree: [ 10376 
10375 10373 ]
    [junit] 2009-04-16 00:31:56,144 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:testProcessTree(159)) - ProcessTree: [ 10377 
10393 10382 10386 10384 10390 10375 10388 10373 ]
    [junit] 2009-04-16 00:31:56,158 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:run(64)) - Shell Command exit with a non-zero 
exit code. This is expected as we are killing the subprocesses of the task 
intentionally. org.apache.hadoop.util.Shell$ExitCodeException: 
    [junit] 2009-04-16 00:31:56,158 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:run(70)) - Exit code: 143
    [junit] 2009-04-16 00:31:56,160 INFO  util.ProcessTree 
(ProcessTree.java:destroyProcessGroup(160)) - Killing all processes in the 
process group 10373 with SIGTERM. Exit code 0
    [junit] 2009-04-16 00:31:56,211 INFO  util.TestProcfsBasedProcessTree 
(TestProcfsBasedProcessTree.java:testProcessTree(173)) - RogueTaskThread 
successfully joined.
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.247 sec
    [junit] Running org.apache.hadoop.util.TestReflectionUtils
    [junit] 2009-04-16 00:31:57,124 WARN  conf.Configuration 
(Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in the 
classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, 
mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, 
mapred-default.xml and hdfs-default.xml respectively
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.573 sec
    [junit] Running org.apache.hadoop.util.TestShell
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.188 sec
    [junit] Running org.apache.hadoop.util.TestStringUtils
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.09 sec

BUILD FAILED
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build.xml :770: 
Tests failed!

Total time: 186 minutes 22 seconds
Publishing Javadoc
Recording test results
Recording fingerprints
Publishing Clover coverage report...

Reply via email to