See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/841/changes
Changes: [ddas] HADOOP-5210. Modifying CHANGES.txt in order to move the commit text for 5210 to 0.20.1. [ddas] HADOOP-5572. Improves the progress reporting for the sort phase for both maps and reduces. Contributed by Ravi Gummadi. [ddas] HADOOP-5801. Fixes the problem: If the hosts file is changed across restart then it should be refreshed upon recovery so that the excluded hosts are lost and the maps are re-executed. Contributed by Amar Kamat. [szetszwo] HADOOP-5873. Remove deprecated methods randomDataNode() and getDatanodeByIndex(..) in FSNamesystem. [szetszwo] HADOOP-5857. Move normal java methods from hdfs .jsp files to .java files. (szetszwo) [rangadi] HADOOP-5866. Move DeprecatedUTF8 from o.a.h.io to o.a.h.hdfs since it may not be used outside hdfs. (Raghu Angadi) [szetszwo] HADOOP-5853. Undeprecate HttpServer.addInternalServlet method. Contributed by Suresh Srinivas [yhemanth] HADOOP-4981. Fix capacity scheduler to schedule speculative tasks correctly in the presence of High RAM jobs. Contributed by Sreekanth Ramakrishnan. ------------------------------------------ [...truncated 505956 lines...] [junit] 2009-05-20 15:31:05,683 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 1 on 37949: starting [junit] 2009-05-20 15:31:05,683 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 37949: starting [junit] 2009-05-20 15:31:05,684 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 37949: starting [junit] 2009-05-20 15:31:05,686 INFO net.NetworkTopology (NetworkTopology.java:add(327)) - Adding a new node: /default-rack/127.0.0.1:60819 [junit] Generating rack names for tasktrackers [junit] Generating host names for tasktrackers [junit] 2009-05-20 15:31:05,880 INFO mapred.JobTracker (JobTracker.java:<init>(1546)) - Starting jobtracker with owner as hudson and supergroup as supergroup [junit] 2009-05-20 15:31:05,881 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list [junit] 2009-05-20 15:31:05,931 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=JobTracker, port=48641 [junit] 2009-05-20 15:31:05,945 INFO http.HttpServer (HttpServer.java:start(425)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2009-05-20 15:31:05,945 INFO http.HttpServer (HttpServer.java:start(430)) - listener.getLocalPort() returned 51525 webServer.getConnectors()[0].getLocalPort() returned 51525 [junit] 2009-05-20 15:31:05,946 INFO http.HttpServer (HttpServer.java:start(463)) - Jetty bound to port 51525 [junit] 2009-05-20 15:31:05,946 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2009-05-20 15:31:06,033 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@localhost:51525 [junit] 2009-05-20 15:31:06,037 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized [junit] 2009-05-20 15:31:06,039 INFO mapred.JobTracker (JobTracker.java:<init>(1655)) - JobTracker up at: 48641 [junit] 2009-05-20 15:31:06,040 INFO mapred.JobTracker (JobTracker.java:<init>(1659)) - JobTracker webserver: 51525 [junit] 2009-05-20 15:31:06,050 INFO mapred.JobTracker (JobTracker.java:<init>(1697)) - Cleaning up the system directory [junit] 2009-05-20 15:31:06,319 INFO mapred.JobTracker (JobTracker.java:refreshHosts(3628)) - Refreshing hosts information [junit] 2009-05-20 15:31:06,346 INFO util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to [junit] 2009-05-20 15:31:06,347 INFO util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to hosts.exclude [junit] 2009-05-20 15:31:06,348 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list [junit] 2009-05-20 15:31:06,350 INFO mapred.JobTracker (JobTracker.java:decommissionNodes(3650)) - Decommissioning 0 nodes [junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(474)) - IPC Server Responder: starting [junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 48641: starting [junit] 2009-05-20 15:31:06,351 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 48641: starting [junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 1 on 48641: starting [junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 48641: starting [junit] 2009-05-20 15:31:06,353 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 3 on 48641: starting [junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 4 on 48641: starting [junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 5 on 48641: starting [junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 6 on 48641: starting [junit] 2009-05-20 15:31:06,354 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 7 on 48641: starting [junit] 2009-05-20 15:31:06,355 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 8 on 48641: starting [junit] 2009-05-20 15:31:06,355 INFO mapred.JobTracker (JobTracker.java:offerService(1878)) - Starting RUNNING [junit] 2009-05-20 15:31:06,355 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 9 on 48641: starting [junit] 2009-05-20 15:31:06,828 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(176)) - mapred.local.dir is http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/0_0 [junit] 2009-05-20 15:31:11,850 INFO http.HttpServer (HttpServer.java:start(425)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2009-05-20 15:31:11,851 INFO http.HttpServer (HttpServer.java:start(430)) - listener.getLocalPort() returned 47801 webServer.getConnectors()[0].getLocalPort() returned 47801 [junit] 2009-05-20 15:31:11,851 INFO http.HttpServer (HttpServer.java:start(463)) - Jetty bound to port 47801 [junit] 2009-05-20 15:31:11,851 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2009-05-20 15:31:11,916 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@0.0.0.0:47801 [junit] 2009-05-20 15:31:11,921 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=TaskTracker, sessionId= - already initialized [junit] 2009-05-20 15:31:11,924 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=TaskTracker, port=36170 [junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(474)) - IPC Server Responder: starting [junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 1 on 36170: starting [junit] 2009-05-20 15:31:11,926 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 3 on 36170: starting [junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 36170: starting [junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 36170: starting [junit] 2009-05-20 15:31:11,925 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 36170: starting [junit] 2009-05-20 15:31:12,000 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(51)) - setsid exited with exit code 0 [junit] 2009-05-20 15:31:12,003 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760 [junit] 2009-05-20 15:31:12,036 INFO net.NetworkTopology (NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host0.foo.com [junit] 2009-05-20 15:31:12,036 INFO mapred.JobTracker (JobTracker.java:addNewTracker(2410)) - Adding tracker tracker_host0.foo.com:localhost/127.0.0.1:36170 to host host0.foo.com [junit] 2009-05-20 15:31:12,043 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(176)) - mapred.local.dir is http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0 [junit] 2009-05-20 15:31:17,060 INFO http.HttpServer (HttpServer.java:start(425)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0 [junit] 2009-05-20 15:31:17,062 INFO http.HttpServer (HttpServer.java:start(430)) - listener.getLocalPort() returned 46053 webServer.getConnectors()[0].getLocalPort() returned 46053 [junit] 2009-05-20 15:31:17,063 INFO http.HttpServer (HttpServer.java:start(463)) - Jetty bound to port 46053 [junit] 2009-05-20 15:31:17,063 INFO mortbay.log (?:invoke0(?)) - jetty-6.1.14 [junit] 2009-05-20 15:31:17,157 INFO mortbay.log (?:invoke0(?)) - Started selectchannelconnec...@0.0.0.0:46053 [junit] 2009-05-20 15:31:17,162 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=TaskTracker, sessionId= - already initialized [junit] 2009-05-20 15:31:17,164 INFO metrics.RpcMetrics (RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with hostName=TaskTracker, port=45006 [junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(474)) - IPC Server Responder: starting [junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 45006: starting [junit] 2009-05-20 15:31:17,165 INFO ipc.Server (Server.java:run(313)) - IPC Server listener on 45006: starting [junit] 2009-05-20 15:31:17,168 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 1 on 45006: starting [junit] 2009-05-20 15:31:17,168 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 45006: starting [junit] 2009-05-20 15:31:17,170 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 3 on 45006: starting [junit] 2009-05-20 15:31:17,192 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760 [junit] 2009-05-20 15:31:17,218 INFO net.NetworkTopology (NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host1.foo.com [junit] 2009-05-20 15:31:17,218 INFO mapred.JobTracker (JobTracker.java:addNewTracker(2410)) - Adding tracker tracker_host1.foo.com:localhost/127.0.0.1:45006 to host host1.foo.com [junit] rootdir = /test/testDistCh [junit] root=/test/testDistCh, returnvalue=0 [junit] results: [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f1 [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f2 [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f3 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub0 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub0/f4 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub1 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub2 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub2/f5 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub3 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub3/f6 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub3/f7 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub4 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub4/f8 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub4/f9 [junit] [junit] args=[/test/testDistCh/sub1::sub1:403] [junit] newstatus=[hudson:supergroup:rwxr-xr-x, [junit] hudson:sub1:r------wx, [junit] hudson:supergroup:rwxr-xr-x, [junit] hudson:supergroup:rwxr-xr-x, [junit] hudson:supergroup:rwxr-xr-x] [junit] 2009-05-20 15:31:17,869 INFO tools.DistTool (DistCh.java:run(376)) - ops=[/test/testDistCh/sub1:null:sub1:r------wx] [junit] 2009-05-20 15:31:17,870 INFO tools.DistTool (DistCh.java:run(377)) - isIgnoreFailures=false [junit] 2009-05-20 15:31:17,913 INFO tools.DistTool (DistCh.java:setup(427)) - distch.job.dir=hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj [junit] 2009-05-20 15:31:17,917 INFO tools.DistTool (DistCh.java:setup(433)) - log=hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj/_logs [junit] 2009-05-20 15:31:18,244 INFO tools.DistTool (DistCh.java:setup(476)) - distch.op.count=1 [junit] 2009-05-20 15:31:18,251 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(551)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. [junit] 2009-05-20 15:31:18,288 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(673)) - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). [junit] 2009-05-20 15:31:18,301 INFO tools.DistTool (DistCh.java:getSplits(261)) - numSplits=1, splits.size()=1 [junit] 2009-05-20 15:31:18,556 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/jobTracker/job_200905201531_0001.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] 2009-05-20 15:31:18,565 INFO mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(80)) - Initializing job_200905201531_0001 [junit] 2009-05-20 15:31:18,569 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1290)) - Running job: job_200905201531_0001 [junit] 2009-05-20 15:31:18,749 INFO mapred.JobInProgress (JobInProgress.java:initTasks(431)) - Input size for job job_200905201531_0001 = 159 [junit] 2009-05-20 15:31:18,749 INFO mapred.JobInProgress (JobInProgress.java:initTasks(433)) - Split info for job:job_200905201531_0001 with 1 splits: [junit] 2009-05-20 15:31:19,573 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1303)) - map 0% reduce 0% [junit] 2009-05-20 15:31:20,244 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(1946)) - Adding task 'attempt_200905201531_0001_m_000002_0' to tip task_200905201531_0001_m_000002, for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:20,326 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] 2009-05-20 15:31:20,391 INFO mapred.JvmManager (JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID: jvm_200905201531_0001_m_595000387 [junit] 2009-05-20 15:31:20,391 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(351)) - JVM Runner jvm_200905201531_0001_m_595000387 spawned. [junit] 2009-05-20 15:31:21,504 WARN util.ProcessTree (ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-05-20 15:31:21,504 INFO util.ProcessTree (ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the process group 586 with SIGTERM. Exit code 1 [junit] 2009-05-20 15:31:23,254 INFO mapred.JobInProgress (JobInProgress.java:completedTask(1997)) - Task 'attempt_200905201531_0001_m_000002_0' has completed task_200905201531_0001_m_000002 successfully. [junit] 2009-05-20 15:31:23,258 INFO mapred.JobInProgress (JobInProgress.java:findNewMapTask(1835)) - Choosing a non-local task task_200905201531_0001_m_000000 [junit] 2009-05-20 15:31:23,259 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(1946)) - Adding task 'attempt_200905201531_0001_m_000000_0' to tip task_200905201531_0001_m_000000, for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:23,263 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000002_0 done; removing files. [junit] 2009-05-20 15:31:23,265 INFO mapred.IndexCache (IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000002_0 not found in cache [junit] 2009-05-20 15:31:23,315 INFO mapred.JvmManager (JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID: jvm_200905201531_0001_m_-1493016408 [junit] 2009-05-20 15:31:23,316 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(351)) - JVM Runner jvm_200905201531_0001_m_-1493016408 spawned. [junit] 2009-05-20 15:31:23,588 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1352)) - Task Id : attempt_200905201531_0001_m_000002_0, Status : SUCCEEDED [junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,108 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000002_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,125 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=MAP, sessionId= [junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,220 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000002_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,281 INFO mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000002_0 is done. And is in the process of commiting [junit] attempt_200905201531_0001_m_000002_0: 2009-05-20 15:31:21,294 INFO mapred.Task (Task.java:sendDone(691)) - Task 'attempt_200905201531_0001_m_000002_0' done. [junit] 2009-05-20 15:31:26,519 WARN util.ProcessTree (ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-05-20 15:31:26,520 INFO util.ProcessTree (ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group586 with SIGKILL. Exit code 1 [junit] 2009-05-20 15:31:26,520 INFO mapred.DefaultTaskController (DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0 [junit] 2009-05-20 15:31:26,520 INFO mapred.JvmManager (JvmManager.java:runChild(411)) - JVM : jvm_200905201531_0001_m_595000387 exited. Number of tasks it ran: 1 [junit] 2009-05-20 15:31:26,574 WARN util.ProcessTree (ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-05-20 15:31:26,575 INFO util.ProcessTree (ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the process group 635 with SIGTERM. Exit code 1 [junit] 2009-05-20 15:31:29,269 INFO mapred.JobInProgress (JobInProgress.java:completedTask(1997)) - Task 'attempt_200905201531_0001_m_000000_0' has completed task_200905201531_0001_m_000000 successfully. [junit] 2009-05-20 15:31:29,273 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(1946)) - Adding task 'attempt_200905201531_0001_m_000001_0' to tip task_200905201531_0001_m_000001, for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:29,303 INFO mapred.JvmManager (JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID: jvm_200905201531_0001_m_1051129828 [junit] 2009-05-20 15:31:29,304 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(351)) - JVM Runner jvm_200905201531_0001_m_1051129828 spawned. [junit] 2009-05-20 15:31:29,661 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1352)) - Task Id : attempt_200905201531_0001_m_000000_0, Status : SUCCEEDED [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,024 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000000_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,041 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=MAP, sessionId= [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,137 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000000_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,225 INFO mapred.MapTask (MapTask.java:runOldMapper(349)) - numReduceTasks: 0 [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:24,353 INFO mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000000_0 is done. And is in the process of commiting [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,361 INFO mapred.Task (Task.java:commit(720)) - Task attempt_200905201531_0001_m_000000_0 is allowed to commit now [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,412 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(92)) - Saved output of task 'attempt_200905201531_0001_m_000000_0' to hdfs://localhost:56489/user/hudson/build/test/mapred/system/distch_4subyj/_logs [junit] attempt_200905201531_0001_m_000000_0: 2009-05-20 15:31:26,418 INFO mapred.Task (Task.java:sendDone(691)) - Task 'attempt_200905201531_0001_m_000000_0' done. [junit] 2009-05-20 15:31:30,374 WARN util.ProcessTree (ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-05-20 15:31:30,374 INFO util.ProcessTree (ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the process group 690 with SIGTERM. Exit code 1 [junit] 2009-05-20 15:31:30,671 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1303)) - map 100% reduce 0% [junit] 2009-05-20 15:31:31,590 WARN util.ProcessTree (ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-05-20 15:31:31,591 INFO util.ProcessTree (ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group635 with SIGKILL. Exit code 1 [junit] 2009-05-20 15:31:31,591 INFO mapred.DefaultTaskController (DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0 [junit] 2009-05-20 15:31:31,591 INFO mapred.JvmManager (JvmManager.java:runChild(411)) - JVM : jvm_200905201531_0001_m_-1493016408 exited. Number of tasks it ran: 1 [junit] 2009-05-20 15:31:32,277 INFO mapred.JobInProgress (JobInProgress.java:completedTask(1997)) - Task 'attempt_200905201531_0001_m_000001_0' has completed task_200905201531_0001_m_000001 successfully. [junit] 2009-05-20 15:31:32,279 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(2115)) - Job job_200905201531_0001 has completed successfully. [junit] 2009-05-20 15:31:32,341 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2061)) - Removed completed task 'attempt_200905201531_0001_m_000000_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:32,341 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2061)) - Removed completed task 'attempt_200905201531_0001_m_000001_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:32,342 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2061)) - Removed completed task 'attempt_200905201531_0001_m_000002_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:45006' [junit] 2009-05-20 15:31:32,343 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000001_0 done; removing files. [junit] 2009-05-20 15:31:32,344 INFO mapred.IndexCache (IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000001_0 not found in cache [junit] 2009-05-20 15:31:32,344 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200905201531_0001_m_000000_0 done; removing files. [junit] 2009-05-20 15:31:32,345 INFO mapred.IndexCache (IndexCache.java:removeMap(140)) - Map ID attempt_200905201531_0001_m_000000_0 not found in cache [junit] 2009-05-20 15:31:32,677 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1352)) - Task Id : attempt_200905201531_0001_m_000001_0, Status : SUCCEEDED [junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,005 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000001_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,022 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=MAP, sessionId= [junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,126 WARN conf.Configuration (Configuration.java:loadResource(1179)) - http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200905201531_0001/attempt_200905201531_0001_m_000001_0/job.xml :a attempt to override final parameter: hadoop.tmp.dir; Ignoring. [junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,197 INFO mapred.Task (Task.java:done(620)) - Task:attempt_200905201531_0001_m_000001_0 is done. And is in the process of commiting [junit] attempt_200905201531_0001_m_000001_0: 2009-05-20 15:31:30,204 INFO mapred.Task (Task.java:sendDone(691)) - Task 'attempt_200905201531_0001_m_000001_0' done. [junit] 2009-05-20 15:31:32,680 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1358)) - Job complete: job_200905201531_0001 [junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient (Counters.java:log(526)) - Counters: 7 [junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient (Counters.java:log(528)) - Job Counters [junit] 2009-05-20 15:31:32,683 INFO mapred.JobClient (Counters.java:log(530)) - Launched map tasks=1 [junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient (Counters.java:log(528)) - org.apache.hadoop.tools.DistCh$Counter [junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient (Counters.java:log(530)) - SUCCEED=1 [junit] 2009-05-20 15:31:32,684 INFO mapred.JobClient (Counters.java:log(528)) - FileSystemCounters [junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient (Counters.java:log(530)) - HDFS_BYTES_READ=159 [junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient (Counters.java:log(528)) - Map-Reduce Framework [junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient (Counters.java:log(530)) - Map input records=1 [junit] 2009-05-20 15:31:32,685 INFO mapred.JobClient (Counters.java:log(530)) - Spilled Records=0 [junit] 2009-05-20 15:31:32,686 INFO mapred.JobClient (Counters.java:log(530)) - Map input bytes=62 [junit] 2009-05-20 15:31:32,686 INFO mapred.JobClient (Counters.java:log(530)) - Map output records=0 [junit] root=/test/testDistCh, returnvalue=0 [junit] results: [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f1 [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f2 [junit] -rw-r--r-- 2 hudson supergroup 38 2009-05-20 15:31 /test/testDistCh/f3 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub0 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub0/f4 [junit] dr------wx - hudson sub1 0 2009-05-20 15:31 /test/testDistCh/sub1 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub2 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub2/f5 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub3 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub3/f6 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub3/f7 [junit] drwxr-xr-x - hudson supergroup 0 2009-05-20 15:31 /test/testDistCh/sub4 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub4/f8 [junit] -rw-r--r-- 2 hudson supergroup 43 2009-05-20 15:31 /test/testDistCh/sub4/f9 [junit] [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 1 [junit] 2009-05-20 15:31:32,832 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 37949 [junit] 2009-05-20 15:31:32,833 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 37949: exiting [junit] 2009-05-20 15:31:32,833 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 37949: exiting [junit] 2009-05-20 15:31:32,834 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 37949: exiting [junit] 2009-05-20 15:31:32,835 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-05-20 15:31:32,835 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 37949 [junit] 2009-05-20 15:31:33,775 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(620)) - Exiting DataBlockScanner thread. [junit] 2009-05-20 15:31:33,836 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 37949 [junit] Shutting down DataNode 0 [junit] 2009-05-20 15:31:33,837 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 59232 [junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 59232: exiting [junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 59232 [junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 59232: exiting [junit] 2009-05-20 15:31:33,838 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 59232: exiting [junit] 2009-05-20 15:31:34,218 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(620)) - Exiting DataBlockScanner thread. [junit] 2009-05-20 15:31:34,838 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 59232 [junit] 2009-05-20 15:31:34,948 WARN namenode.DecommissionManager (DecommissionManager.java:run(67)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted [junit] 2009-05-20 15:31:34,991 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 56489 [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 5 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 3 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 56489 [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 9 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 6 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 7 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 8 on 56489: exiting [junit] 2009-05-20 15:31:34,992 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 4 on 56489: exiting [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 32.198 sec checkfailure: BUILD FAILED http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build.xml :1042: Tests failed! Total time: 226 minutes 37 seconds Publishing Javadoc Recording test results Recording fingerprints Publishing Clover coverage report...