See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/855/changes
Changes:
[tomwhite] HADOOP-5861. s3n files are not getting split by default.
[tomwhite] HADOOP-5836. Bug in S3N handling of directory markers using an
object with a trailing "/" causes jobs to fail. Contributed by Ian Nowland.
[tomwhite] HADOOP-5844. Use mysqldump when connecting to local mysql instance
in Sqoop. Contributed by Aaron Kimball.
[sharad] HADOOP-5882. Fixes a reducer progress update problem for new mapreduce
api. Contributed by Amareshwari Sriramadasu.
[ddas] HADOOP-5948. Changes TestJavaSerialization to use LocalJobRunner instead
of MiniMR/DFS cluster. Contributed by Jothi Padmanabhan.
[ddas] HADOOP-5955. Changes TestFileOuputFormat so that is uses LOCAL_MR
instead of CLUSTER_MR. Contributed by Jothi Padmanabhan.
[gkesavan] Fixes broken Releaseaudit link
[ddas] HADOOP-5924. Fixes a corner case problem to do with job recovery with
empty history files. Also, after a JT restart, sends KillTaskAction to tasks
that report back but the corresponding job hasn't been initialized yet.
Contributed by Amar Kamat.
[szetszwo] HADOOP-5956. Fix ivy dependency in hdfsproxy and capacity-scheduler.
Contributed by Giridharan Kesavan
[szetszwo] HADOOP-5954. Fix javac warnings in TestFileCreation, TestSmallBlock,
TestFileStatus, TestDFSShellGenericOptions, TestSeekBug and
TestDFSStartupVersions.
[szetszwo] HADOOP-5953. The isDirectory(..) and isFile(..) methods in
KosmosFileSystem should not be deprecated.
------------------------------------------
[...truncated 446069 lines...]
[junit] 2009-06-03 17:46:06,131 INFO mapred.JobTracker
(JobTracker.java:<init>(1558)) - Starting jobtracker with owner as hudson and
supergroup as supergroup
[junit] 2009-06-03 17:46:06,132 INFO mapred.JobTracker
(JobTracker.java:initializeTaskMemoryRelatedConfig(3855)) - Scheduler
configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
[junit] 2009-06-03 17:46:06,132 INFO util.HostsFileReader
(HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
[junit] 2009-06-03 17:46:06,182 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=JobTracker, port=50685
[junit] 2009-06-03 17:46:06,196 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-06-03 17:46:06,196 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 42214
webServer.getConnectors()[0].getLocalPort() returned 42214
[junit] 2009-06-03 17:46:06,196 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 42214
[junit] 2009-06-03 17:46:06,196 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-06-03 17:46:06,283 INFO mortbay.log (?:invoke0(?)) - Started
selectchannelconnec...@localhost:42214
[junit] 2009-06-03 17:46:06,285 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= - already initialized
[junit] 2009-06-03 17:46:06,286 INFO mapred.JobTracker
(JobTracker.java:<init>(1671)) - JobTracker up at: 50685
[junit] 2009-06-03 17:46:06,286 INFO mapred.JobTracker
(JobTracker.java:<init>(1675)) - JobTracker webserver: 42214
[junit] 2009-06-03 17:46:06,295 INFO mapred.JobTracker
(JobTracker.java:<init>(1713)) - Cleaning up the system directory
[junit] 2009-06-03 17:46:06,546 INFO mapred.JobTracker
(JobTracker.java:refreshHosts(3688)) - Refreshing hosts information
[junit] 2009-06-03 17:46:06,571 INFO util.HostsFileReader
(HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to
[junit] 2009-06-03 17:46:06,571 INFO util.HostsFileReader
(HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to
hosts.exclude
[junit] 2009-06-03 17:46:06,571 INFO util.HostsFileReader
(HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
[junit] 2009-06-03 17:46:06,572 INFO mapred.JobTracker
(JobTracker.java:decommissionNodes(3710)) - Decommissioning 0 nodes
[junit] 2009-06-03 17:46:06,572 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-06-03 17:46:06,573 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 50685: starting
[junit] 2009-06-03 17:46:06,572 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 50685: starting
[junit] 2009-06-03 17:46:06,572 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 50685: starting
[junit] 2009-06-03 17:46:06,574 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 6 on 50685: starting
[junit] 2009-06-03 17:46:06,574 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 5 on 50685: starting
[junit] 2009-06-03 17:46:06,573 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 4 on 50685: starting
[junit] 2009-06-03 17:46:06,573 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 50685: starting
[junit] 2009-06-03 17:46:06,573 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 50685: starting
[junit] 2009-06-03 17:46:06,574 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 7 on 50685: starting
[junit] 2009-06-03 17:46:06,574 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 9 on 50685: starting
[junit] 2009-06-03 17:46:06,574 INFO mapred.JobTracker
(JobTracker.java:offerService(1894)) - Starting RUNNING
[junit] 2009-06-03 17:46:06,574 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 8 on 50685: starting
[junit] 2009-06-03 17:46:07,096 INFO mapred.MiniMRCluster
(MiniMRCluster.java:<init>(176)) - mapred.local.dir is
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/0_0
[junit] 2009-06-03 17:46:12,118 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-06-03 17:46:12,119 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 44725
webServer.getConnectors()[0].getLocalPort() returned 44725
[junit] 2009-06-03 17:46:12,119 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 44725
[junit] 2009-06-03 17:46:12,120 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-06-03 17:46:12,181 INFO mortbay.log (?:invoke0(?)) - Started
[email protected]:44725
[junit] 2009-06-03 17:46:12,186 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=TaskTracker, sessionId= - already initialized
[junit] 2009-06-03 17:46:12,189 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=TaskTracker, port=50412
[junit] 2009-06-03 17:46:12,190 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-06-03 17:46:12,190 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 50412: starting
[junit] 2009-06-03 17:46:12,190 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 50412: starting
[junit] 2009-06-03 17:46:12,190 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 50412: starting
[junit] 2009-06-03 17:46:12,191 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 50412: starting
[junit] 2009-06-03 17:46:12,191 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 50412: starting
[junit] 2009-06-03 17:46:12,224 INFO util.ProcessTree
(ProcessTree.java:isSetsidSupported(51)) - setsid exited with exit code 0
[junit] 2009-06-03 17:46:12,227 INFO mapred.IndexCache
(IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
[junit] 2009-06-03 17:46:12,264 INFO net.NetworkTopology
(NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host0.foo.com
[junit] 2009-06-03 17:46:12,265 INFO mapred.JobTracker
(JobTracker.java:addNewTracker(2426)) - Adding tracker
tracker_host0.foo.com:localhost/127.0.0.1:50412 to host host0.foo.com
[junit] 2009-06-03 17:46:12,268 INFO mapred.MiniMRCluster
(MiniMRCluster.java:<init>(176)) - mapred.local.dir is
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0
[junit] 2009-06-03 17:46:17,287 INFO http.HttpServer
(HttpServer.java:start(425)) - Port returned by
webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 0
[junit] 2009-06-03 17:46:17,288 INFO http.HttpServer
(HttpServer.java:start(430)) - listener.getLocalPort() returned 55102
webServer.getConnectors()[0].getLocalPort() returned 55102
[junit] 2009-06-03 17:46:17,289 INFO http.HttpServer
(HttpServer.java:start(463)) - Jetty bound to port 55102
[junit] 2009-06-03 17:46:17,290 INFO mortbay.log (?:invoke0(?)) -
jetty-6.1.14
[junit] 2009-06-03 17:46:17,352 INFO mortbay.log (?:invoke0(?)) - Started
[email protected]:55102
[junit] 2009-06-03 17:46:17,357 INFO jvm.JvmMetrics
(JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with
processName=TaskTracker, sessionId= - already initialized
[junit] 2009-06-03 17:46:17,358 INFO metrics.RpcMetrics
(RpcMetrics.java:<init>(58)) - Initializing RPC Metrics with
hostName=TaskTracker, port=58516
[junit] 2009-06-03 17:46:17,359 INFO ipc.Server (Server.java:run(474)) -
IPC Server Responder: starting
[junit] 2009-06-03 17:46:17,360 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 0 on 58516: starting
[junit] 2009-06-03 17:46:17,360 INFO ipc.Server (Server.java:run(313)) -
IPC Server listener on 58516: starting
[junit] 2009-06-03 17:46:17,363 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 1 on 58516: starting
[junit] 2009-06-03 17:46:17,364 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 3 on 58516: starting
[junit] 2009-06-03 17:46:17,364 INFO ipc.Server (Server.java:run(939)) -
IPC Server handler 2 on 58516: starting
[junit] 2009-06-03 17:46:17,424 INFO mapred.IndexCache
(IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
[junit] 2009-06-03 17:46:17,451 INFO net.NetworkTopology
(NetworkTopology.java:add(327)) - Adding a new node: /default-rack/host1.foo.com
[junit] 2009-06-03 17:46:17,451 INFO mapred.JobTracker
(JobTracker.java:addNewTracker(2426)) - Adding tracker
tracker_host1.foo.com:localhost/127.0.0.1:58516 to host host1.foo.com
[junit] rootdir = /test/testDistCh
[junit] root=/test/testDistCh, returnvalue=0
[junit] results:
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f1
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f2
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f3
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub0
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub0/f4
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub1
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub1/f5
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub1/f6
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub2
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub2/f7
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub2/f8
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub3
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub4
[junit] -rw-r--r-- 2 hudson supergroup 44 2009-06-03 17:46
/test/testDistCh/sub4/f10
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub4/f9
[junit]
[junit] args=[/test/testDistCh/sub3:::067,
[junit] /test/testDistCh/sub0::sub0:352]
[junit] newstatus=[hudson:sub0:-wxr-x-w-,
[junit] hudson:supergroup:rwxr-xr-x,
[junit] hudson:supergroup:rwxr-xr-x,
[junit] hudson:supergroup:---rw-rwx,
[junit] hudson:supergroup:rwxr-xr-x]
[junit] 2009-06-03 17:46:18,035 INFO tools.DistTool (DistCh.java:run(376))
- ops=[/test/testDistCh/sub3:null:null:---rw-rwx,
/test/testDistCh/sub0:null:sub0:-wxr-x-w-]
[junit] 2009-06-03 17:46:18,035 INFO tools.DistTool (DistCh.java:run(377))
- isIgnoreFailures=false
[junit] 2009-06-03 17:46:18,054 INFO tools.DistTool
(DistCh.java:setup(427)) -
distch.job.dir=hdfs://localhost:51288/user/hudson/build/test/mapred/system/distch_mfux3k
[junit] 2009-06-03 17:46:18,057 INFO tools.DistTool
(DistCh.java:setup(433)) -
log=hdfs://localhost:51288/user/hudson/build/test/mapred/system/distch_mfux3k/_logs
[junit] 2009-06-03 17:46:18,337 INFO tools.DistTool
(DistCh.java:setup(476)) - distch.op.count=3
[junit] 2009-06-03 17:46:18,343 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(551)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
[junit] 2009-06-03 17:46:18,368 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(673)) - No job jar file set. User
classes may not be found. See JobConf(Class) or JobConf#setJar(String).
[junit] 2009-06-03 17:46:18,381 INFO tools.DistTool
(DistCh.java:getSplits(261)) - numSplits=1, splits.size()=1
[junit] 2009-06-03 17:46:18,557 WARN conf.Configuration
(Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/jobTracker/job_200906031746_0001.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2009-06-03 17:46:18,566 INFO
mapred.EagerTaskInitializationListener
(EagerTaskInitializationListener.java:run(80)) - Initializing
job_200906031746_0001
[junit] 2009-06-03 17:46:18,567 INFO mapred.JobInProgress
(JobInProgress.java:initTasks(384)) - Initializing job_200906031746_0001
[junit] 2009-06-03 17:46:18,567 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1287)) - Running job: job_200906031746_0001
[junit] 2009-06-03 17:46:18,714 INFO mapred.JobInProgress
(JobInProgress.java:initTasks(428)) - Input size for job job_200906031746_0001
= 328. Number of splits = 1
[junit] 2009-06-03 17:46:19,572 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1300)) - map 0% reduce 0%
[junit] 2009-06-03 17:46:20,476 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1962)) - Adding task
'attempt_200906031746_0001_m_000002_0' to tip task_200906031746_0001_m_000002,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:20,555 WARN conf.Configuration
(Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2009-06-03 17:46:20,626 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200906031746_0001_m_-1363778075
[junit] 2009-06-03 17:46:20,626 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200906031746_0001_m_-1363778075 spawned.
[junit] 2009-06-03 17:46:21,688 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-06-03 17:46:21,688 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 31284 with SIGTERM. Exit code 1
[junit] 2009-06-03 17:46:23,485 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1967)) - Task
'attempt_200906031746_0001_m_000002_0' has completed
task_200906031746_0001_m_000002 successfully.
[junit] 2009-06-03 17:46:23,490 INFO mapred.JobInProgress
(JobInProgress.java:findNewMapTask(1800)) - Choosing a non-local task
task_200906031746_0001_m_000000
[junit] 2009-06-03 17:46:23,491 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1962)) - Adding task
'attempt_200906031746_0001_m_000000_0' to tip task_200906031746_0001_m_000000,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:23,496 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200906031746_0001_m_000002_0 done;
removing files.
[junit] 2009-06-03 17:46:23,497 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200906031746_0001_m_000002_0
not found in cache
[junit] 2009-06-03 17:46:23,542 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200906031746_0001_m_-2029633451
[junit] 2009-06-03 17:46:23,543 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200906031746_0001_m_-2029633451 spawned.
[junit] 2009-06-03 17:46:23,588 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1349)) - Task Id :
attempt_200906031746_0001_m_000002_0, Status : SUCCEEDED
[junit] attempt_200906031746_0001_m_000002_0: 2009-06-03 17:46:21,312 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000002_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000002_0: 2009-06-03 17:46:21,329 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200906031746_0001_m_000002_0: 2009-06-03 17:46:21,427 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000002_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000002_0: 2009-06-03 17:46:21,486 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200906031746_0001_m_000002_0
is done. And is in the process of commiting
[junit] attempt_200906031746_0001_m_000002_0: 2009-06-03 17:46:21,492 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200906031746_0001_m_000002_0' done.
[junit] 2009-06-03 17:46:26,706 WARN util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-06-03 17:46:26,706 INFO util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group31284 with
SIGKILL. Exit code 1
[junit] 2009-06-03 17:46:26,706 INFO mapred.DefaultTaskController
(DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0
[junit] 2009-06-03 17:46:26,706 INFO mapred.JvmManager
(JvmManager.java:runChild(411)) - JVM : jvm_200906031746_0001_m_-1363778075
exited. Number of tasks it ran: 1
[junit] 2009-06-03 17:46:26,956 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-06-03 17:46:26,956 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 31333 with SIGTERM. Exit code 1
[junit] 2009-06-03 17:46:29,399 INFO datanode.DataBlockScanner
(DataBlockScanner.java:verifyBlock(441)) - Verification succeeded for
blk_-5662738277730779474_1002
[junit] 2009-06-03 17:46:29,501 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1967)) - Task
'attempt_200906031746_0001_m_000000_0' has completed
task_200906031746_0001_m_000000 successfully.
[junit] 2009-06-03 17:46:29,506 INFO mapred.JobTracker
(JobTracker.java:createTaskEntry(1962)) - Adding task
'attempt_200906031746_0001_m_000001_0' to tip task_200906031746_0001_m_000001,
for tracker 'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:29,539 INFO mapred.JvmManager
(JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID:
jvm_200906031746_0001_m_1400987832
[junit] 2009-06-03 17:46:29,539 INFO mapred.JvmManager
(JvmManager.java:spawnNewJvm(351)) - JVM Runner
jvm_200906031746_0001_m_1400987832 spawned.
[junit] 2009-06-03 17:46:29,661 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1349)) - Task Id :
attempt_200906031746_0001_m_000000_0, Status : SUCCEEDED
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:24,319 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000000_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:24,336 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:24,430 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000000_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:24,523 INFO
mapred.MapTask (MapTask.java:runOldMapper(352)) - numReduceTasks: 0
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:24,675 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200906031746_0001_m_000000_0
is done. And is in the process of commiting
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:26,683 INFO
mapred.Task (Task.java:commit(720)) - Task attempt_200906031746_0001_m_000000_0
is allowed to commit now
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:26,769 INFO
mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(92)) - Saved
output of task 'attempt_200906031746_0001_m_000000_0' to
hdfs://localhost:51288/user/hudson/build/test/mapred/system/distch_mfux3k/_logs
[junit] attempt_200906031746_0001_m_000000_0: 2009-06-03 17:46:26,777 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200906031746_0001_m_000000_0' done.
[junit] 2009-06-03 17:46:30,610 WARN util.ProcessTree
(ProcessTree.java:destroyProcessGroup(166)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-06-03 17:46:30,610 INFO util.ProcessTree
(ProcessTree.java:destroyProcessGroup(168)) - Killing all processes in the
process group 31392 with SIGTERM. Exit code 1
[junit] 2009-06-03 17:46:30,672 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1300)) - map 100% reduce 0%
[junit] 2009-06-03 17:46:31,971 WARN util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(91)) - Error executing shell command
org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process
[junit]
[junit] 2009-06-03 17:46:31,971 INFO util.ProcessTree
(ProcessTree.java:sigKillInCurrentThread(94)) - Killing process group31333 with
SIGKILL. Exit code 1
[junit] 2009-06-03 17:46:31,971 INFO mapred.DefaultTaskController
(DefaultTaskController.java:killTaskJVM(87)) - Process exited with exit code:0
[junit] 2009-06-03 17:46:31,972 INFO mapred.JvmManager
(JvmManager.java:runChild(411)) - JVM : jvm_200906031746_0001_m_-2029633451
exited. Number of tasks it ran: 1
[junit] 2009-06-03 17:46:32,510 INFO mapred.JobInProgress
(JobInProgress.java:completedTask(1967)) - Task
'attempt_200906031746_0001_m_000001_0' has completed
task_200906031746_0001_m_000001 successfully.
[junit] 2009-06-03 17:46:32,511 INFO mapred.JobInProgress
(JobInProgress.java:jobComplete(2091)) - Job job_200906031746_0001 has
completed successfully.
[junit] 2009-06-03 17:46:32,562 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2077)) - Removed completed task
'attempt_200906031746_0001_m_000000_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:32,562 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2077)) - Removed completed task
'attempt_200906031746_0001_m_000001_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:32,563 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(2077)) - Removed completed task
'attempt_200906031746_0001_m_000002_0' from
'tracker_host1.foo.com:localhost/127.0.0.1:58516'
[junit] 2009-06-03 17:46:32,564 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200906031746_0001_m_000001_0 done;
removing files.
[junit] 2009-06-03 17:46:32,564 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200906031746_0001_m_000001_0
not found in cache
[junit] 2009-06-03 17:46:32,565 INFO mapred.TaskRunner
(MapTaskRunner.java:close(43)) - attempt_200906031746_0001_m_000000_0 done;
removing files.
[junit] 2009-06-03 17:46:32,565 INFO mapred.IndexCache
(IndexCache.java:removeMap(140)) - Map ID attempt_200906031746_0001_m_000000_0
not found in cache
[junit] 2009-06-03 17:46:32,677 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1349)) - Task Id :
attempt_200906031746_0001_m_000001_0, Status : SUCCEEDED
[junit] attempt_200906031746_0001_m_000001_0: 2009-06-03 17:46:30,267 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000001_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000001_0: 2009-06-03 17:46:30,284 INFO
jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with
processName=MAP, sessionId=
[junit] attempt_200906031746_0001_m_000001_0: 2009-06-03 17:46:30,382 WARN
conf.Configuration (Configuration.java:loadResource(1179)) -
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build/test/mapred/local/1_0/taskTracker/jobcache/job_200906031746_0001/attempt_200906031746_0001_m_000001_0/job.xml
:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] attempt_200906031746_0001_m_000001_0: 2009-06-03 17:46:30,475 INFO
mapred.Task (Task.java:done(620)) - Task:attempt_200906031746_0001_m_000001_0
is done. And is in the process of commiting
[junit] attempt_200906031746_0001_m_000001_0: 2009-06-03 17:46:30,480 INFO
mapred.Task (Task.java:sendDone(691)) - Task
'attempt_200906031746_0001_m_000001_0' done.
[junit] 2009-06-03 17:46:32,681 INFO mapred.JobClient
(JobClient.java:monitorAndPrintJob(1355)) - Job complete: job_200906031746_0001
[junit] 2009-06-03 17:46:32,684 INFO mapred.JobClient
(Counters.java:log(534)) - Counters: 7
[junit] 2009-06-03 17:46:32,684 INFO mapred.JobClient
(Counters.java:log(536)) - Job Counters
[junit] 2009-06-03 17:46:32,684 INFO mapred.JobClient
(Counters.java:log(538)) - Launched map tasks=1
[junit] 2009-06-03 17:46:32,685 INFO mapred.JobClient
(Counters.java:log(536)) - FileInputFormatCounters
[junit] 2009-06-03 17:46:32,685 INFO mapred.JobClient
(Counters.java:log(538)) - BYTES_READ=231
[junit] 2009-06-03 17:46:32,685 INFO mapred.JobClient
(Counters.java:log(536)) - org.apache.hadoop.tools.DistCh$Counter
[junit] 2009-06-03 17:46:32,686 INFO mapred.JobClient
(Counters.java:log(538)) - SUCCEED=3
[junit] 2009-06-03 17:46:32,686 INFO mapred.JobClient
(Counters.java:log(536)) - FileSystemCounters
[junit] 2009-06-03 17:46:32,686 INFO mapred.JobClient
(Counters.java:log(538)) - HDFS_BYTES_READ=328
[junit] 2009-06-03 17:46:32,686 INFO mapred.JobClient
(Counters.java:log(536)) - Map-Reduce Framework
[junit] 2009-06-03 17:46:32,687 INFO mapred.JobClient
(Counters.java:log(538)) - Map input records=3
[junit] 2009-06-03 17:46:32,687 INFO mapred.JobClient
(Counters.java:log(538)) - Spilled Records=0
[junit] 2009-06-03 17:46:32,688 INFO mapred.JobClient
(Counters.java:log(538)) - Map output records=0
[junit] root=/test/testDistCh, returnvalue=0
[junit] results:
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f1
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f2
[junit] -rw-r--r-- 2 hudson supergroup 38 2009-06-03 17:46
/test/testDistCh/f3
[junit] d-wxr-x-w- - hudson sub0 0 2009-06-03 17:46
/test/testDistCh/sub0
[junit] --w-r---w- 2 hudson sub0 43 2009-06-03 17:46
/test/testDistCh/sub0/f4
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub1
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub1/f5
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub1/f6
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub2
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub2/f7
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub2/f8
[junit] d---rw-rwx - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub3
[junit] drwxr-xr-x - hudson supergroup 0 2009-06-03 17:46
/test/testDistCh/sub4
[junit] -rw-r--r-- 2 hudson supergroup 44 2009-06-03 17:46
/test/testDistCh/sub4/f10
[junit] -rw-r--r-- 2 hudson supergroup 43 2009-06-03 17:46
/test/testDistCh/sub4/f9
[junit]
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 1
[junit] 2009-06-03 17:46:32,827 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 43605
[junit] 2009-06-03 17:46:32,828 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 43605: exiting
[junit] 2009-06-03 17:46:32,828 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 43605: exiting
[junit] 2009-06-03 17:46:32,828 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] 2009-06-03 17:46:32,828 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 43605
[junit] 2009-06-03 17:46:32,828 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 43605: exiting
[junit] 2009-06-03 17:46:32,831 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread.
[junit] 2009-06-03 17:46:32,831 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 43605
[junit] Shutting down DataNode 0
[junit] 2009-06-03 17:46:32,933 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 59001
[junit] 2009-06-03 17:46:32,933 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 59001: exiting
[junit] 2009-06-03 17:46:32,934 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] 2009-06-03 17:46:32,933 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 59001: exiting
[junit] 2009-06-03 17:46:32,933 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 59001
[junit] 2009-06-03 17:46:32,934 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 59001: exiting
[junit] 2009-06-03 17:46:32,934 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread.
[junit] 2009-06-03 17:46:32,935 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 59001
[junit] 2009-06-03 17:46:32,937 WARN namenode.DecommissionManager
(DecommissionManager.java:run(67)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:stop(1103)) -
Stopping server on 51288
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 0 on 51288: exiting
[junit] 2009-06-03 17:46:32,956 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 5 on 51288: exiting
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 3 on 51288: exiting
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:run(352)) -
Stopping IPC Server listener on 51288
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 9 on 51288: exiting
[junit] 2009-06-03 17:46:32,948 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 1 on 51288: exiting
[junit] 2009-06-03 17:46:32,957 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 7 on 51288: exiting
[junit] 2009-06-03 17:46:32,957 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 2 on 51288: exiting
[junit] 2009-06-03 17:46:32,957 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 8 on 51288: exiting
[junit] 2009-06-03 17:46:32,957 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 4 on 51288: exiting
[junit] 2009-06-03 17:46:32,956 INFO ipc.Server (Server.java:run(997)) -
IPC Server handler 6 on 51288: exiting
[junit] 2009-06-03 17:46:32,956 INFO ipc.Server (Server.java:run(539)) -
Stopping IPC Server Responder
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 29.76 sec
checkfailure:
BUILD FAILED
http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/ws/trunk/build.xml
:1043: Tests failed!
Total time: 238 minutes 46 seconds
Publishing Javadoc
Recording test results
Recording fingerprints
Publishing Clover coverage report...
