HADOOP-1622 fixes this to allow multiple resources, including jars, to
be submitted for a single mapreduce job. There is currently a patch
that "works" but still needs a little fixing. I should be able to get
it finished in the next couple of days.
Dennis Kubes
Eyal Oren wrote:
On 08/13/07/08/07 16:49 -0700, Phantom wrote:
Hi
I have a map/reduce job that uses external jar files. How do I specify
those
jars in the classpath when submitting the mapred job using ./hadoop
jar ....
? Suppose my map job relies on API in some external jar how do I pass
this
jar file as part of my job submission.
As far as I understand (that's what we do anyway), you have to submit
one jar that contains all your dependencies (except for dependencies on
hadoop libs), including external jars. The easiest is probably to build
maven/ant to build such "big" jar externally with all its dependency
jars unpacked and added into the jar, and then submit them to hadoop.
-eyal
