Hello all,
I am running an MR job and HBase is the data sink. If a task attempt
is assigned to node3 in the cluster, it fails. Since it failed, it would get
reassigned to some other node in the cluster and then it succeeds. It gives
out the following exception on node3. If no task is assigned to node3, then
no exception gets generated. So it seems to run fine on all the other nodes
except node3.
10/06/09 05:34:28 INFO mapred.JobClient: Task Id :
attempt_201005270922_0260_m_000000_0, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.mapreduce.TableOutputFormat
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:808)
at
org.apache.hadoop.mapreduce.JobContext.getOutputFormatClass(JobContext.java:193)
at org.apache.hadoop.mapred.Task.initialize(Task.java:413)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:288)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.mapreduce.TableOutputFormat
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:806)
... 4 more
On node3, in hadoop-env.sh, $HADOOP_CLASSPATH has been set to include hbase
jars and $HBASE_HOME/conf. I suspected this might be the issue, may be it
wasn't set. But that is not the issue. What could be the reason behind this?
Thank you.
Regards,
Raghava.
