A reduce task/30 had 5 attempts, all of them failed with above error and hence M/R job failed.
On Fri, Jan 24, 2014 at 10:55 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <[email protected]> wrote: > I got the below error after running a M/R job with Avro input and output. > Version: 1.7.6 > > Any suggestions as to when can this error occur ? > > Trace: > > 2014-01-24 10:23:46,473 INFO org.apache.hadoop.io.nativeio.NativeIO: Got > UserName hadoop for UID 680 from the native implementation > > 2014-01-24 10:23:46,475 WARN org.apache.hadoop.mapred.Child: Error running > child > > java.lang.ArrayIndexOutOfBoundsException: 40 > > at org.apache.avro.io.parsing.Symbol$Alternative.getSymbol(Symbol.java:364) > > at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:229) > > at org.apache.avro.io.parsing.Parser.advance(Parser.java:88) > > at org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:206) > > at > org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155) > > at > org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193) > > at > org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230) > > at > org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183) > > at > org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151) > > at > org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193) > > at > org.apache.avro.reflect.ReflectDatumReader.readField(ReflectDatumReader.java:230) > > at > org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183) > > at > org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151) > > at > org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:142) > > at > org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:122) > > at > org.apache.avro.hadoop.io.AvroDeserializer.deserialize(AvroDeserializer.java:48) > > at > org.apache.hadoop.mapreduce.ReduceContext.nextKeyValue(ReduceContext.java:117) > > at org.apache.hadoop.mapreduce.ReduceContext.nextKey(ReduceContext.java:92) > > at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176) > > at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:649) > > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:418) > > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:396) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232) > > at org.apache.hadoop.mapred.Child.main(Child.java:249) > > 2014-01-24 10:23:46,477 INFO org.apache.hadoop.mapred.Task: Runnning > cleanup for the task > > -- > Deepak > > -- Deepak
