Chao Shi created CRUNCH-203:
-------------------------------
Summary: test fails with hadoop-2
Key: CRUNCH-203
URL: https://issues.apache.org/jira/browse/CRUNCH-203
Project: Crunch
Issue Type: Bug
Components: IO
Environment: mvn clean verify -Phadoop-2 -Dit.test=TrevniKeyPipelineIT
Reporter: Chao Shi
It seems like trevni is still using hadoop-1. Do they have releases for
hadoop-2?
java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface
org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:400)
Caused by: java.lang.IncompatibleClassChangeError: Found interface
org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
at
org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter.initSchema(AvroTrevniKeyRecordWriter.java:57)
at
org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase.<init>(AvroTrevniRecordWriterBase.java:82)
at
org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter.<init>(AvroTrevniKeyRecordWriter.java:42)
at
org.apache.trevni.avro.mapreduce.AvroTrevniKeyOutputFormat.getRecordWriter(AvroTrevniKeyOutputFormat.java:54)
at
org.apache.crunch.io.CrunchOutputs.getRecordWriter(CrunchOutputs.java:175)
at org.apache.crunch.io.CrunchOutputs.write(CrunchOutputs.java:129)
at
org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:43)
at org.apache.crunch.MapFn.process(MapFn.java:34)
at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:93)
at
org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:57)
at org.apache.crunch.MapFn.process(MapFn.java:34)
at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:93)
at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:104)
at org.apache.crunch.impl.mr.run.CrunchMapper.map(CrunchMapper.java:64)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:232)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira