On Sun, 19 Jun 2011 19:04:18 -0400, you wrote:
>Ian,
>
>Thanks for the exact syntax to get the jars from the hadoop
>installation on disk referenced in the script. Adding the jars to the
>classpath makes sense, and sort of confirms that it may be a class
>compatibility problem. One thing I noticed is that the diff you
>provided will add the jars from the hadoop install at the end of the
>classpath. Perhaps they should go at the beginning of the path instead
>of the end so that the hadoop jars from the installation are always
>used first?
>
>So, instead of:
>
>for f in "$HADOOP_HOME"/hadoop-*.jar; do
> CLASSPATH=${CLASSPATH}:$f
>done
>
>The following might work better:
>
>for f in "$HADOOP_HOME"/hadoop-*.jar; do
> CLASSPATH=$f:${CLASSPATH}
>done
>
>(Same goes for the second classpath loop/etc)
>
>Drew
Hi Drew,
That order just specifies how it gets appended.. For example which gets
added first, hadoop-core-0.20.203.0.jar, or hadoop-tools-0.20.203.0.jar? In
practice, I don't think it matters. The main thing is that at the beginning
stage the hadoop jars are added first, which takes precedence over the
subsequent jars.
I found out later, I also had some issues, that the issues I was having, may
have also been solved by swapping out the jar
/integration/target/dependency/hadoop-core-*.jar, with the one from my
hadoop dir.
I think this may be the correct way instead of the patch I'm doing above.
Ian
