[
https://issues.apache.org/jira/browse/TEZ-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hitesh Shah resolved TEZ-281.
-----------------------------
Resolution: Invalid
WordCountMrr removed from codebase.
> WordcountMrr job fails with "Negative key-length: -17" IOException
> ------------------------------------------------------------------
>
> Key: TEZ-281
> URL: https://issues.apache.org/jira/browse/TEZ-281
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Yesha Vora
> Labels: TEZ-0.2.0
>
> Sometimes, The wordcountmrr job with tez framwork enabled and using
> tez-mapreduce-examples.jar fails with "Negative key-length: -17" error.
> Snapshot of application master log.
> 2013-06-20 20:56:07,638 INFO [AsyncDispatcher event handler]
> org.apache.tez.dag.app.dag.impl.TaskAttemptImpl:
> attempt_1371757993531_10_1_000001_000000_3 TaskAttempt Transitioned from
> RUNNING to FAIL_IN_PROGRESS
> 2013-06-20 20:56:07,639 INFO [AsyncDispatcher event handler]
> org.apache.tez.dag.history.HistoryEventHandler:
> [HISTORY][DAG:dag_1371757993531_10_000001][Event:TASK_ATTEMPT_FINISHED]:
> vertexName=ivertex1,
> taskAttemptId=attempt_1371757993531_10_1_000001_000000_3,
> finishTime=1371761767638, status=FAILED, diagnostics=Error:
> java.io.IOException: Rec# 7494138: Negative key-length: -17
> at
> org.apache.tez.engine.common.sort.impl.IFile$Reader.positionToNextRecord(IFile.java:476)
> at
> org.apache.tez.engine.common.sort.impl.IFile$Reader.readRawKey(IFile.java:492)
> at
> org.apache.tez.engine.common.sort.impl.IFile$Reader.nextRawKey(IFile.java:488)
> at
> org.apache.tez.engine.common.sort.impl.TezMerger$Segment.nextRawKey(TezMerger.java:308)
> at
> org.apache.tez.engine.common.sort.impl.TezMerger$MergeQueue.adjustPriorityQueue(TezMerger.java:462)
> at
> org.apache.tez.engine.common.sort.impl.TezMerger$MergeQueue.next(TezMerger.java:482)
> at
> org.apache.tez.mapreduce.processor.reduce.ReduceProcessor$2.next(ReduceProcessor.java:291)
> at org.apache.tez.mapreduce.processor.MRTask$1.next(MRTask.java:637)
> at
> org.apache.hadoop.mapreduce.task.ReduceContextImpl.nextKeyValue(ReduceContextImpl.java:154)
> at
> org.apache.hadoop.mapreduce.task.ReduceContextImpl.nextKey(ReduceContextImpl.java:121)
> at
> org.apache.hadoop.mapreduce.lib.reduce.WrappedReducer$Context.nextKey(WrappedReducer.java:297)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:170)
> at
> org.apache.tez.mapreduce.processor.reduce.ReduceProcessor.runNewReducer(ReduceProcessor.java:331)
> at
> org.apache.tez.mapreduce.processor.reduce.ReduceProcessor.process(ReduceProcessor.java:150)
> at org.apache.tez.engine.task.RuntimeTask.run(RuntimeTask.java:79)
> at
> org.apache.tez.mapreduce.task.MRRuntimeTask.run(MRRuntimeTask.java:144)
> at
> org.apache.hadoop.mapred.YarnTezDagChild.runTezTask(YarnTezDagChild.java:334)
> at
> org.apache.hadoop.mapred.YarnTezDagChild.access$000(YarnTezDagChild.java:76)
> at
> org.apache.hadoop.mapred.YarnTezDagChild$2.run(YarnTezDagChild.java:178)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
> at
> org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:175)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
