Streaming job fails with with identity mapper class
---------------------------------------------------
Key: HADOOP-4790
URL: https://issues.apache.org/jira/browse/HADOOP-4790
Project: Hadoop Core
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.18.0
Reporter: Suhas Gogate
Priority: Minor
Fix For: 0.20.0
Streaming job command:
$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar \
-input myInputDirs \
-output myOutputDir \
-mapper org.apache.hadoop.mapred.lib.IdentityMapper \
-reducer org.apache.hadoop.mapred.lib.IndentityReducer
Error in job tracker hadoop.log:
2008-11-24 22:18:12,637 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from attempt_200811242217_0001_m_000001_3: java.io.IOException: Type mismatch
in key from map: expected org.apache.hadoop.io.Text, recieved
org.apache.hadoop.io.LongWritable^D
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:415)^D
at
org.apache.hadoop.mapred.lib.IdentityMapper.map(IdentityMapper.java:37)^D
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)^D
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)^D
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)^D
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
