Hi, I am playing around with version 0.20.2 of Hadoop. I have written
and packaged a Job using a custom Mapper and Reducer. The input format
in my Job is set to StreamInputFormat. Also setting property
stream.recordreader.class to
org.apache.hadoop.streaming.StreamXmlRecordReader.
This is how I want to start my job:
hadoop jar custom-1.0-SNAPSHOT.jar EmailCountingJob /input /output
The problem is that in this case all classes from
hadoop-0.20.2-streaming.jar are missing (ClassNotFoundException). I
tried using -libjars without luck.
hadoop jar -libjars PATH/hadoop-0.20.2-streaming.jar
custom-1.0-SNAPSHOT.jar EmailCountingJob /input /output
Any chance to use streaming classes with your own Jobs without copying
these classes to your projects and packaging them into your own jar?
/Reik
