See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/841/changes
Changes:
[ddas] HADOOP-5210. Modifying CHANGES.txt in order to move the commit text for
5210 to 0.20.1.
[ddas] HADOOP-5572. Improves the progress reporting for the sort phase for both
maps and reduces. Contributed by Ravi Gummadi.
[ddas] HADOOP-5801. Fixes the problem: If the hosts file is changed across
restart then it should be refreshed upon recovery so that the excluded hosts
are lost and the maps are re-executed. Contributed by Amar Kamat.
[szetszwo] HADOOP-5873. Remove deprecated methods randomDataNode() and
getDatanodeByIndex(..) in FSNamesystem.
[szetszwo] HADOOP-5857. Move normal java methods from hdfs .jsp files to .java
files. (szetszwo)
[rangadi] HADOOP-5866. Move DeprecatedUTF8 from o.a.h.io to o.a.h.hdfs since it
may
not be used outside hdfs. (Raghu Angadi)
[szetszwo] HADOOP-5853. Undeprecate HttpServer.addInternalServlet method.
Contributed by Suresh Srinivas
[yhemanth] HADOOP-4981. Fix capacity scheduler to schedule speculative tasks
correctly in the presence of High RAM jobs. Contributed by Sreekanth
Ramakrishnan.
------------------------------------------
[...truncated 505956 lines...]
[junit] 2009-05-20 15:31:05,683 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 37949: starting
[junit] 2009-05-20 15:31:05,683 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 37949: starting
[junit] 2009-05-20 15:31:05,684 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 37949: starting
[junit] 2009-05-20 15:31:05,686 INFO net.NetworkTopology
(NetworkTopology.java:add(327)) - Adding a new node:
/default-rack/127.0.0.1:60819
[junit] Generating rack names for tasktrackers
[junit] Generating host names for tasktrackers
[junit] 2009-05-20 15:31:05,880 INFO mapred.JobTracker
(JobTracker.java:<init>(1546)) - Starting jobtracker with owner as hudson and
supergroup as supergroup
[junit] 2009-05-20 15:31:05,881 INFO util.HostsFileReader
(HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
[junit] 2009-05-20 15:31:05,931 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=JobTracker, port=48641
[junit] 2009-05-20 15:31:05,945 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-05-20 15:31:05,945 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 51525
webServer.getConnectors()[0].getLocalPort() returned 51525
[junit] 2009-05-20 15:31:05,946 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 51525
[junit] 2009-05-20 15:31:05,946 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-05-20 15:31:06,033 INFO mortbay.log (?:invoke0(?)) - Started
selectchannelconnec...@localhost:51525
[junit] 2009-05-20 15:31:06,037 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= - already initialized
[junit] 2009-05-20 15:31:06,039 INFO mapred.JobTracker
(JobTracker.java:<init>(1655)) - JobTracker up at: 48641
[junit] 2009-05-20 15:31:06,040 INFO mapred.JobTracker
(JobTracker.java:<init>(1659)) - JobTracker webserver: 51525
[junit] 2009-05-20 15:31:06,050 INFO mapred.JobTracker
(JobTracker.java:<init>(1697)) - Cleaning up the system directory
[junit] 2009-05-20 15:31:06,319 INFO mapred.JobTracker
(JobTracker.java:refreshHosts(3628)) - Refreshing hosts information
[junit] 2009-05-20 15:31:06,346 INFO util.HostsFileReader
(HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to
[junit] 2009-05-20 15:31:06,347 INFO util.HostsFileReader
(HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to
hosts.exclude
[junit] 2009-05-20 15:31:06,348 INFO util.HostsFileReader
(HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
[junit] 2009-05-20 15:31:06,350 INFO mapred.JobTracker
(JobTracker.java:decommissionNodes(3650)) - Decommissioning 0 nodes
[junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 48641: starting
[junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 48641: starting
[junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 48641: starting
[junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 48641: starting
[junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 48641: starting
[junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 4 on 48641: starting
[junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 5 on 48641: starting
[junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 6 on 48641: starting
[junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 7 on 48641: starting
[junit] 2009-05-20 15:31:06,355 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 8 on 48641: starting
[junit] 2009-05-20 15:31:06,355 INFO mapred.JobTracker
(JobTracker.java:offerService(1878)) - Starting RUNNING
[junit] 2009-05-20 15:31:06,355 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 9 on 48641: starting
[junit] 2009-05-20 15:31:06,828 INFO mapred.MiniMRCluster
(MiniMRCluster.java:<init>(176)) - mapred.local.dir is
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/0_0
[junit] 2009-05-20 15:31:11,850 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-05-20 15:31:11,851 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 47801
webServer.getConnectors()[0].getLocalPort() returned 47801
[junit] 2009-05-20 15:31:11,851 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 47801
[junit] 2009-05-20 15:31:11,851 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-05-20 15:31:11,916 INFO mortbay.log (?:invoke0(?)) - Started
[email protected]:47801
[junit] 2009-05-20 15:31:11,921 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=TaskTracker, sessionId= - already initialized
[junit] 2009-05-20 15:31:11,924 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=TaskTracker, port=36170
[junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 36170: starting
[junit] 2009-05-20 15:31:11,926 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 36170: starting
[junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 36170: starting
[junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 36170: starting
[junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 36170: starting
[junit] 2009-05-20 15:31:12,000 INFO util.ProcessTree
(ProcessTree.java:isSetsidSupported(51)) - setsid exited with exit code 0
[junit] 2009-05-20 15:31:12,003 INFO mapred.IndexCache
(IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
[junit] 2009-05-20 15:31:12,036 INFO net.NetworkTopology
(NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host0.foo.com
[junit] 2009-05-20 15:31:12,036 INFO mapred.JobTracker
(JobTracker.java:addNewTracker(2410)) - Adding tracker
tracker_host0.foo.com:localhost/127.0.0.1:36170 to host host0.foo.com
[junit] 2009-05-20 15:31:12,043 INFO mapred.MiniMRCluster
(MiniMRCluster.java:<init>(176)) - mapred.local.dir is
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0
[junit] 2009-05-20 15:31:17,060 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-05-20 15:31:17,062 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 46053
webServer.getConnectors()[0].getLocalPort() returned 46053
[junit] 2009-05-20 15:31:17,063 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 46053
[junit] 2009-05-20 15:31:17,063 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-05-20 15:31:17,157 INFO mortbay.log (?:invoke0(?)) - Started
[email protected]:46053
[junit] 2009-05-20 15:31:17,162 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=TaskTracker, sessionId= - already initialized
[junit] 2009-05-20 15:31:17,164 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=TaskTracker, port=45006
[junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 45006: starting
[junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 45006: starting
[junit] 2009-05-20 15:31:17,168 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 45006: starting
[junit] 2009-05-20 15:31:17,168 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 45006: starting
[junit] 2009-05-20 15:31:17,170 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 45006: starting
[junit] 2009-05-20 15:31:17,192 INFO mapred.IndexCache
(IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
[junit] 2009-05-20 15:31:17,218 INFO net.NetworkTopology
(NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host1.foo.com
[junit] 2009-05-20 15:31:17,218 INFO mapred.JobTracker
(JobTracker.java:addNewTracker(2410)) - Adding tracker
tracker_host1.foo.com:localhost/127.0.0.1:45006 to host host1.foo.com
[junit] rootdir = /test/testDistCh
[junit] root=/test/testDistCh, returnvalue=0
[junit] results:
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f1
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f2
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f3
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub0
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub0/f4
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub1
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub2
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub2/f5
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub3
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub3/f6
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub3/f7
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub4
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub4/f8
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub4/f9
[junit]
[junit] args=[/test/testDistCh/sub1::sub1:403]
[junit] newstatus=[hudson:supergroup:rwxr-xr-x,
[junit] hudson:sub1:r------wx,
[junit] hudson:supergroup:rwxr-xr-x,
[junit] hudson:supergroup:rwxr-xr-x,
[junit] hudson:supergroup:rwxr-xr-x]
[junit] 2009-05-20 15:31:17,869 INFO tools.DistTool (DistCh.java:run(376))
- ops=[/test/testDistCh/sub1:null:sub1:r------wx]
[junit] 2009-05-20 15:31:17,870 INFO tools.DistTool (DistCh.java:run(377))
- isIgnoreFailures=false
[junit] 2009-05-20 15:31:17,913 INFO tools.DistTool
(DistCh.java:setup(427)) -
distch.job.dir=hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj
[junit] 2009-05-20 15:31:17,917 INFO tools.DistTool
(DistCh.java:setup(433)) -
log=hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj/_logs
[junit] 2009-05-20 15:31:18,244 INFO tools.DistTool
(DistCh.java:setup(476)) - distch.op.count=1
[junit] 2009-05-20 15:31:18,251 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(551)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
[junit] 2009-05-20 15:31:18,288 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(673)) - No job jar file set. User
classes may not be found. See JobConf(Class) or JobConf#setJar(String).
[junit] 2009-05-20 15:31:18,301 INFO tools.DistTool
(DistCh.java:getSplits(261)) - numSplits=1, splits.size()=1
[junit] 2009-05-20 15:31:18,556 WARN conf.Configuration
(Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/jobTracker/job_200905201531_0001.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2009-05-20 15:31:18,565 INFO
mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(80)) - Initializing
job_200905201531_0001
[junit] 2009-05-20 15:31:18,569 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1290)) - Running job: job_200905201531_0001
[junit] 2009-05-20 15:31:18,749 INFO mapred.JobInProgress
(JobInProgress.java:initTasks(431)) - Input size for job job_200905201531_0001
= 159
[junit] 2009-05-20 15:31:18,749 INFO mapred.JobInProgress
(JobInProgress.java:initTasks(433)) - Split info for job:job_200905201531_0001
with 1 splits:
[junit] 2009-05-20 15:31:19,573 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1303)) - map 0% reduce 0%
[junit] 2009-05-20 15:31:20,244 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1946)) - Adding task
'attempt_200905201531_0001_m_000002_0' to tip task_200905201531_0001_m_000002,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:20,326 WARN conf.Configuration
(Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2009-05-20 15:31:20,391 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200905201531_0001_m_595000387
[junit] 2009-05-20 15:31:20,391 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200905201531_0001_m_595000387 spawned.
[junit] 2009-05-20 15:31:21,504 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-05-20 15:31:21,504 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 586 with SIGTERM. Exit code 1
[junit] 2009-05-20 15:31:23,254 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1997)) - Task
'attempt_200905201531_0001_m_000002_0' has completed
task_200905201531_0001_m_000002 successfully.
[junit] 2009-05-20 15:31:23,258 INFO mapred.JobInProgress
(JobInProgress.java:findNewMapTask(1835)) - Choosing a non-local task
task_200905201531_0001_m_000000
[junit] 2009-05-20 15:31:23,259 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1946)) - Adding task
'attempt_200905201531_0001_m_000000_0' to tip task_200905201531_0001_m_000000,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:23,263 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000002_0 done;
removing files.
[junit] 2009-05-20 15:31:23,265 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000002_0
not found in cache
[junit] 2009-05-20 15:31:23,315 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200905201531_0001_m_-1493016408
[junit] 2009-05-20 15:31:23,316 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200905201531_0001_m_-1493016408 spawned.
[junit] 2009-05-20 15:31:23,588 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1352)) - Task Id :
attempt_200905201531_0001_m_000002_0, Status : SUCCEEDED
[junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,108 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000002_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,125 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,220 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000002_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,281 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000002_0
is done. And is in the process of commiting
[junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,294 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200905201531_0001_m_000002_0' done.
[junit] 2009-05-20 15:31:26,519 WARN util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-05-20 15:31:26,520 INFO util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group586 with
SIGKILL. Exit code 1
[junit] 2009-05-20 15:31:26,520 INFO mapred.DefaultTaskController
(DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0
[junit] 2009-05-20 15:31:26,520 INFO mapred.JvmManager
(JvmManager.java:runChild(411)) - JVM : jvm_200905201531_0001_m_595000387
exited. Number of tasks it ran: 1
[junit] 2009-05-20 15:31:26,574 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-05-20 15:31:26,575 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 635 with SIGTERM. Exit code 1
[junit] 2009-05-20 15:31:29,269 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1997)) - Task
'attempt_200905201531_0001_m_000000_0' has completed
task_200905201531_0001_m_000000 successfully.
[junit] 2009-05-20 15:31:29,273 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1946)) - Adding task
'attempt_200905201531_0001_m_000001_0' to tip task_200905201531_0001_m_000001,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:29,303 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200905201531_0001_m_1051129828
[junit] 2009-05-20 15:31:29,304 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200905201531_0001_m_1051129828 spawned.
[junit] 2009-05-20 15:31:29,661 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1352)) - Task Id :
attempt_200905201531_0001_m_000000_0, Status : SUCCEEDED
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,024 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000000_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,041 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,137 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000000_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,225 INFO
mapred.MapTask (MapTask.java:runOldMapper(349)) - numReduceTasks: 0
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,353 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000000_0
is done. And is in the process of commiting
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,361 INFO
mapred.Task (Task.java:commit(720)) - Task attempt_200905201531_0001_m_000000_0
is allowed to commit now
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,412 INFO
mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(92)) - Saved
output of task 'attempt_200905201531_0001_m_000000_0' to
hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj/_logs
[junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,418 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200905201531_0001_m_000000_0' done.
[junit] 2009-05-20 15:31:30,374 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-05-20 15:31:30,374 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 690 with SIGTERM. Exit code 1
[junit] 2009-05-20 15:31:30,671 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1303)) - map 100% reduce 0%
[junit] 2009-05-20 15:31:31,590 WARN util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-05-20 15:31:31,591 INFO util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group635 with
SIGKILL. Exit code 1
[junit] 2009-05-20 15:31:31,591 INFO mapred.DefaultTaskController
(DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0
[junit] 2009-05-20 15:31:31,591 INFO mapred.JvmManager
(JvmManager.java:runChild(411)) - JVM : jvm_200905201531_0001_m_-1493016408
exited. Number of tasks it ran: 1
[junit] 2009-05-20 15:31:32,277 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1997)) - Task
'attempt_200905201531_0001_m_000001_0' has completed
task_200905201531_0001_m_000001 successfully.
[junit] 2009-05-20 15:31:32,279 INFO mapred.JobInProgress
(JobInProgress.java:jobComplete(2115)) - Job job_200905201531_0001 has
completed successfully.
[junit] 2009-05-20 15:31:32,341 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2061)) - Removed completed task
'attempt_200905201531_0001_m_000000_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:32,341 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2061)) - Removed completed task
'attempt_200905201531_0001_m_000001_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:32,342 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2061)) - Removed completed task
'attempt_200905201531_0001_m_000002_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:45006'
[junit] 2009-05-20 15:31:32,343 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000001_0 done;
removing files.
[junit] 2009-05-20 15:31:32,344 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000001_0
not found in cache
[junit] 2009-05-20 15:31:32,344 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000000_0 done;
removing files.
[junit] 2009-05-20 15:31:32,345 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000000_0
not found in cache
[junit] 2009-05-20 15:31:32,677 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1352)) - Task Id :
attempt_200905201531_0001_m_000001_0, Status : SUCCEEDED
[junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,005 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000001_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,022 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,126 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000001_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,197 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000001_0
is done. And is in the process of commiting
[junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,204 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200905201531_0001_m_000001_0' done.
[junit] 2009-05-20 15:31:32,680 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1358)) - Job complete: job_200905201531_0001
[junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient
(Counters.java:log(526)) - Counters: 7
[junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient
(Counters.java:log(528)) - Job Counters
[junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient
(Counters.java:log(530)) - Launched map tasks=1
[junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient
(Counters.java:log(528)) - org.apache.hadoop.tools.DistCh$Counter
[junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient
(Counters.java:log(530)) - SUCCEED=1
[junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient
(Counters.java:log(528)) - FileSystemCounters
[junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient
(Counters.java:log(530)) - HDFS_BYTES_READ=159
[junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient
(Counters.java:log(528)) - Map-Reduce Framework
[junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient
(Counters.java:log(530)) - Map input records=1
[junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient
(Counters.java:log(530)) - Spilled Records=0
[junit] 2009-05-20 15:31:32,686 INFO mapred.JobClient
(Counters.java:log(530)) - Map input bytes=62
[junit] 2009-05-20 15:31:32,686 INFO mapred.JobClient
(Counters.java:log(530)) - Map output records=0
[junit] root=/test/testDistCh, returnvalue=0
[junit] results:
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f1
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f2
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31
/test/testDistCh/f3
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub0
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub0/f4
[junit] dr------wx - hudson sub1 0 2009-05-20 15:31
/test/testDistCh/sub1
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub2
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub2/f5
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub3
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub3/f6
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub3/f7
[junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31
/test/testDistCh/sub4
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub4/f8
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31
/test/testDistCh/sub4/f9
[junit]
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 1
[junit] 2009-05-20 15:31:32,832 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 37949
[junit] 2009-05-20 15:31:32,833 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 37949: exiting
[junit] 2009-05-20 15:31:32,833 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 37949: exiting
[junit] 2009-05-20 15:31:32,834 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 37949: exiting
[junit] 2009-05-20 15:31:32,835 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] 2009-05-20 15:31:32,835 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 37949
[junit] 2009-05-20 15:31:33,775 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(620)) - Exiting DataBlockScanner thread.
[junit] 2009-05-20 15:31:33,836 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 37949
[junit] Shutting down DataNode 0
[junit] 2009-05-20 15:31:33,837 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 59232
[junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 59232: exiting
[junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 59232
[junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 59232: exiting
[junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 59232: exiting
[junit] 2009-05-20 15:31:34,218 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(620)) - Exiting DataBlockScanner thread.
[junit] 2009-05-20 15:31:34,838 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 59232
[junit] 2009-05-20 15:31:34,948 WARN namenode.DecommissionManager
(DecommissionManager.java:run(67)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2009-05-20 15:31:34,991 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 56489
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 5 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 3 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 56489
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 9 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 6 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 7 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 8 on 56489: exiting
[junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 4 on 56489: exiting
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.198 sec
checkfailure:
BUILD FAILED
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build.xml
:1042: Tests failed!
Total time: 226 minutes 37 seconds
Publishing Javadoc
Recording test results
Recording fingerprints
Publishing Clover coverage report...
