I figured someone smart out there must have done it, hence asking.
I have a M/R job accessing Hbase and it is launched by oozie. The job is
successful if I put all dependencies in a big jar, however, everyone
understands it is not a good idea to deploy hadoop/hbase files along with
application jars. Hence I am trying to configure it to use the jars in some
shared fashion but with no luck.
First I put hbase.jar and zookeeper.jar in /user/oozie/share/lib, but from the
log, it is clear that hbase.jar is just not visible in the classpath.
Then I tried a second option to take advantage of libpath by creating a
directory "/user/oozie/hbase-shared" in hdfs and putting the two jars there.
And I pointed oozie.libpath to the dir as
"oozie.libpath=${nameNode}/user/oozie/hbase-shared" in job.properties file. It
is doing better because the call to "HBaseConfiguration.create()" from my
driver was successful and HBaseConfiguration is a class in hbase.jar, so I know
hbase.jar is indeed visible to the driver class. However, somewhere down the
line I still received exception of "NoClassDefFoundError:
org/apache/hadoop/hbase/client/HTableInterface" and I only use HTableInterface
in the reducer.
So any idea please? Also, please let me know if there is a better way to do it.
And here is system properties I found in the log, which clearly shows hbase.jar
is in the classpath.
#Tue Feb 12 00:22:20 EST 2013
java.runtime.name=Java(TM) SE Runtime Environment
oozie.action.externalChildIDs.properties=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/externalChildIds.properties
sun.boot.library.path=/usr/java/jdk1.6.0_31/jre/lib/amd64
java.vm.version=20.6-b01
hadoop.root.logger=INFO,CLA
java.vm.vendor=Sun Microsystems Inc.
java.vendor.url=http\://java.sun.com/
path.separator=\:
java.vm.name=Java HotSpot(TM) 64-Bit Server VM
file.encoding.pkg=sun.io
sun.java.launcher=SUN_STANDARD
user.country=US
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002
java.runtime.version=1.6.0_31-b04
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/java/jdk1.6.0_31/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0000015-130210101321239-oozie-oozi-W
oozie.action.id=0000015-130210101321239-oozie-oozi-W@java-aggregator
java.io.tmpdir=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/tmp
line.separator=\n
oozie.action.output.properties=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/output.properties
java.vm.specification.vendor=Sun Microsystems Inc.
os.name=Linux
log4j.configuration=container-log4j.properties
sun.jnu.encoding=ANSI_X3.4-1968
java.library.path=/usr/java/jdk1.6.0_31/jre/lib/amd64/server\:/usr/java/jdk1.6.0_31/jre/lib/amd64\:/usr/java/jdk1.6.0_31/jre/../lib/amd64\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002\:/usr/lib/hadoop/lib/native\:/usr/java/packages/lib/amd64\:/usr/lib64\:/lib64\:/lib\:/usr/lib
yarn.app.mapreduce.container.log.filesize=0
oozie.action.conf.xml=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/action.xml
hadoop.metrics.log.level=WARN
java.specification.name=Java Platform API Specification
java.class.version=50.0
java.net.preferIPv4Stack=true
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=2.6.32-220.23.1.el6.x86_64
yarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1360641830618_0011/container_1360641830618_0011_01_000002
user.home=/var/lib/hadoop-yarn
user.timezone=America/New_York
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=ANSI_X3.4-1968
java.specification.version=1.6
java.class.path=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002\:/etc/hadoop/conf\:/usr/lib/hadoop/hadoop-annotations-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop/hadoop-auth.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.1.1-tests.jar\:/usr/lib/hadoop/hadoop-auth-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop/hadoop-common-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop/hadoop-annotations.jar\:/usr/lib/hadoop/hadoop-common.jar\:/usr/lib/hadoop/lib/log4j-1.2.17.jar\:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop/lib/servlet-api-2.5.jar\:/usr/lib/hadoop/lib/jline-0.9.94.jar\:/usr/lib/hadoop/lib/commons-configuration-1.6.jar\:/usr/lib/hadoop/lib/jersey-json-1.8.jar\:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar\:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/zookeeper-3.4.3-cdh4.1.1.jar\:/usr/lib/hadoop/lib/commons-cli-1.2.jar\:/usr/lib/hadoop/lib/jersey-server-1.8.jar\:/usr/lib/hadoop/lib/hue-plugins-2.1.0-cdh4.1.1.jar\:/usr/lib/hadoop/lib/commons-el-1.0.jar\:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop/lib/jsp-api-2.1.jar\:/usr/lib/hadoop/lib/commons-net-3.1.jar\:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/usr/lib/hadoop/lib/jettison-1.1.jar\:/usr/lib/hadoop/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop/lib/paranamer-2.3.jar\:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar\:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/usr/lib/hadoop/lib/stax-api-1.0.1.jar\:/usr/lib/hadoop/lib/jets3t-0.6.1.jar\:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/usr/lib/hadoop/lib/commons-digester-1.8.jar\:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop/lib/activation-1.1.jar\:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/usr/lib/hadoop/lib/avro-1.7.1.cloudera.2.jar\:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop/lib/jsch-0.1.42.jar\:/usr/lib/hadoop/lib/kfs-0.3.jar\:/usr/lib/hadoop/lib/commons-math-2.1.jar\:/usr/lib/hadoop/lib/xmlenc-0.52.jar\:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar\:/usr/lib/hadoop/lib/guava-11.0.2.jar\:/usr/lib/hadoop/lib/commons-io-2.1.jar\:/usr/lib/hadoop/lib/junit-4.8.2.jar\:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/usr/lib/hadoop/lib/asm-3.2.jar\:/usr/lib/hadoop/lib/commons-codec-1.4.jar\:/usr/lib/hadoop/lib/commons-lang-2.5.jar\:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/usr/lib/hadoop/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.1.1-tests.jar\:/usr/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.3-cdh4.1.1.jar\:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar\:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-mapreduce/hadoop-extras-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-distcp-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.1.1-tests.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar\:/usr/lib/hadoop-mapreduce/hadoop-streaming-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar\:/usr/lib/hadoop-mapreduce/hadoop-datajoin-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar\:/usr/lib/hadoop-mapreduce/hadoop-extras.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-distcp.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-rumen.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-archives.jar\:/usr/lib/hadoop-mapreduce/hadoop-rumen-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar\:/usr/lib/hadoop-mapreduce/hadoop-gridmix.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar\:/usr/lib/hadoop-mapreduce/hadoop-archives-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-datajoin.jar\:/usr/lib/hadoop-mapreduce/hadoop-streaming.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-gridmix-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar\:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar\:/usr/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-mapreduce/lib/javax.inject-1.jar\:/usr/lib/hadoop-mapreduce/lib/netty-3.2.4.Final.jar\:/usr/lib/hadoop-mapreduce/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-mapreduce/lib/paranamer-2.3.jar\:/usr/lib/hadoop-mapreduce/lib/jersey-guice-1.8.jar\:/usr/lib/hadoop-mapreduce/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar\:/usr/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar\:/usr/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-mapreduce/lib/avro-1.7.1.cloudera.2.jar\:/usr/lib/hadoop-mapreduce/lib/guice-3.0.jar\:/usr/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-mapreduce/lib/commons-io-2.1.jar\:/usr/lib/hadoop-mapreduce/lib/asm-3.2.jar\:/usr/lib/hadoop-mapreduce/lib/jersey-core-1.8.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-api.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-api-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests-2.0.0-cdh4.1.1-tests.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-site-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-common-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.0.0-cdh4.1.1.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-site.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-server-common.jar\:/usr/lib/hadoop-yarn/hadoop-yarn-common.jar\:/usr/lib/hadoop-yarn/lib/log4j-1.2.17.jar\:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar\:/usr/lib/hadoop-yarn/lib/netty-3.2.4.Final.jar\:/usr/lib/hadoop-yarn/lib/jersey-server-1.8.jar\:/usr/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar\:/usr/lib/hadoop-yarn/lib/paranamer-2.3.jar\:/usr/lib/hadoop-yarn/lib/jersey-guice-1.8.jar\:/usr/lib/hadoop-yarn/lib/protobuf-java-2.4.0a.jar\:/usr/lib/hadoop-yarn/lib/guice-servlet-3.0.jar\:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar\:/usr/lib/hadoop-yarn/lib/snappy-java-1.0.4.1.jar\:/usr/lib/hadoop-yarn/lib/avro-1.7.1.cloudera.2.jar\:/usr/lib/hadoop-yarn/lib/guice-3.0.jar\:/usr/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar\:/usr/lib/hadoop-yarn/lib/commons-io-2.1.jar\:/usr/lib/hadoop-yarn/lib/asm-3.2.jar\:/usr/lib/hadoop-yarn/lib/jersey-core-1.8.jar\:job.jar/\:job.jar/classes/\:job.jar/lib/*\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/zookeeper.jar\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/json-simple-1.1.jar\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/java-launcher.jar\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/cr-1.0-SNAPSHOT.jar\:/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/hbase.jar
user.name=yarn
oozie.action.newId.properties=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/newId.properties
java.vm.specification.version=1.0
sun.java.command=org.apache.hadoop.mapred.YarnChild 192.168.77.82 37020
attempt_1360641830618_0011_m_000000_0 2
java.home=/usr/java/jdk1.6.0_31/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Sun Microsystems Inc.
java.vm.info=mixed mode
java.version=1.6.0_31
java.ext.dirs=/usr/java/jdk1.6.0_31/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/java/jdk1.6.0_31/jre/lib/resources.jar\:/usr/java/jdk1.6.0_31/jre/lib/rt.jar\:/usr/java/jdk1.6.0_31/jre/lib/sunrsasign.jar\:/usr/java/jdk1.6.0_31/jre/lib/jsse.jar\:/usr/java/jdk1.6.0_31/jre/lib/jce.jar\:/usr/java/jdk1.6.0_31/jre/lib/charsets.jar\:/usr/java/jdk1.6.0_31/jre/lib/modules/jdk.boot.jar\:/usr/java/jdk1.6.0_31/jre/classes
java.vendor=Sun Microsystems Inc.
file.separator=/
oozie.launcher.job.id=job_1360641830618_0011
oozie.action.stats.properties=/var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/appcache/application_1360641830618_0011/container_1360641830618_0011_01_000002/stats.properties
java.vendor.url.bug=http\://java.sun.com/cgi-bin/bugreport.cgi
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
And here is the stacktrace:
2013-02-12 00:59:15,743 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at
10 second(s).
2013-02-12 00:59:15,743 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system
started
2013-02-12 00:59:15,762 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for
job_1360641830618_0015 to jobTokenSecretManager
2013-02-12 00:59:15,967 FATAL [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.isChainJob(JobImpl.java:918)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.makeUberDecision(JobImpl.java:849)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.access$2600(JobImpl.java:114)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:995)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:938)
at
org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:380)
at
org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298)
at
org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
at
org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:666)
at
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:113)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:890)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.start(MRAppMaster.java:840)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1050)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1046)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1010)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.client.HTableInterface
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 21 more
2013-02-12 00:59:15,972 INFO [Thread-1]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a signal.
Signaling RMCommunicator and JobHistoryEventHandler.
