mapreduce patch tests hung with "java.lang.OutOfMemoryError: Java heap space"
-----------------------------------------------------------------------------
Key: MAPREDUCE-1561
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1561
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Giridharan Kesavan
http://hudson.zones.apache.org/hudson/view/Mapreduce/job/Mapreduce-Patch-h9.grid.sp2.yahoo.net/4/console
Error form the console:
[exec] [junit] 10/03/05 04:08:29 INFO datanode.DataNode: PacketResponder 2
for block blk_-3280111748864197295_19758 terminating
[exec] [junit] 10/03/05 04:08:29 INFO hdfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:46067 is added to
blk_-3280111748864197295_19758{blockUCState=UNDER_CONSTRUCTION,
primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:46067|RBW],
ReplicaUnderConstruction[127.0.0.1:37626|RBW],
ReplicaUnderConstruction[127.0.0.1:48886|RBW]]} size 0
[exec] [junit] 10/03/05 04:08:29 INFO hdfs.StateChange: DIR*
NameSystem.completeFile: file
/tmp/hadoop-hudson/mapred/system/job_20100304162726530_3751/job-info is closed
by DFSClient_79157028
[exec] [junit] 10/03/05 04:08:29 INFO mapred.JobTracker: Job
job_20100304162726530_3751 added successfully for user 'hudson' to queue
'default'
[exec] [junit] 10/03/05 04:08:29 INFO mapred.JobTracker: Initializing
job_20100304162726530_3751
[exec] [junit] 10/03/05 04:08:29 INFO mapred.JobInProgress:
Initializing job_20100304162726530_3751
[exec] [junit] 10/03/05 04:08:29 INFO mapreduce.Job: Running job:
job_20100304162726530_3751
[exec] [junit] 10/03/05 04:08:29 INFO jobhistory.JobHistory:
SetupWriter, creating file
file:/grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h9.grid.sp2.yahoo.net/trunk/build/contrib/raid/test/logs/history/job_20100304162726530_3751_hudson
[exec] [junit] 10/03/05 04:08:29 ERROR mapred.JobTracker: Job
initialization failed:
[exec] [junit] org.apache.avro.AvroRuntimeException:
java.lang.NoSuchFieldException: _SCHEMA
[exec] [junit] at
org.apache.avro.specific.SpecificData.createSchema(SpecificData.java:50)
[exec] [junit] at
org.apache.avro.reflect.ReflectData.getSchema(ReflectData.java:210)
[exec] [junit] at
org.apache.avro.specific.SpecificDatumWriter.<init>(SpecificDatumWriter.java:28)
[exec] [junit] at
org.apache.hadoop.mapreduce.jobhistory.EventWriter.<init>(EventWriter.java:47)
[exec] [junit] at
org.apache.hadoop.mapreduce.jobhistory.JobHistory.setupEventWriter(JobHistory.java:252)
[exec] [junit] at
org.apache.hadoop.mapred.JobInProgress.logSubmissionToJobHistory(JobInProgress.java:710)
[exec] [junit] at
org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:619)
[exec] [junit] at
org.apache.hadoop.mapred.JobTracker.initJob(JobTracker.java:3256)
[exec] [junit] at
org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:79)
[exec] [junit] at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
[exec] [junit] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
[exec] [junit] at java.lang.Thread.run(Thread.java:619)
[exec] [junit] Caused by: java.lang.NoSuchFieldException: _SCHEMA
[exec] [junit] at
java.lang.Class.getDeclaredField(Class.java:1882)
[exec] [junit] at
org.apache.avro.specific.SpecificData.createSchema(SpecificData.java:48)
[exec] [junit] ... 11 more
[exec] [junit]
[exec] [junit] Exception in thread "pool-1-thread-3"
java.lang.OutOfMemoryError: Java heap space
[exec] [junit] at java.util.Arrays.copyOf(Arrays.java:2786)
[exec] [junit] at
java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
[exec] [junit] at
java.io.PrintStream.write(PrintStream.java:430)
[exec] [junit] at
org.apache.tools.ant.util.TeeOutputStream.write(TeeOutputStream.java:81)
[exec] [junit] at
java.io.PrintStream.write(PrintStream.java:430)
[exec] [junit] at
sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
[exec] [junit] at
sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:272)
[exec] [junit] at
sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:276)
[exec] [junit] at
sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:122)
[exec] [junit] at
java.io.OutputStreamWriter.flush(OutputStreamWriter.java:212)
[exec] [junit] at
org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:58)
[exec] [junit] at
org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:316)
[exec] [junit] at
org.apache.log4j.WriterAppender.append(WriterAppender.java:160)
[exec] [junit] at
org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
[exec] [junit] at
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)10/03/05
04:08:36 INFO raid.RaidNode: Triggering Policy Filter RaidTest1
hdfs://localhost:44624/user/test/raidtest
[exec] [junit] 10/03/05 04:08:39 INFO raid.RaidNode: Trigger thread
continuing to run...
[exec] [junit] Exception in thread
"org.apache.hadoop.raid.raidnode$triggermoni...@5ebac9" 10/03/05 04:08:44 INFO
security.Groups: Returning cached groups for 'hudso10/03/05 04:08:47 INFO
ipc.Server: IPC Server handler 8 on 44624, call getException in thread "IPC
Server handler 8 on 44624" java.lang.OutOfMemoryError: Java heap space10/03/05
04:08:53 INFO mapreduce.Job: map 0% reduce 0%
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
