It seems to me that the Tez AM classpath somehow has a hadoop-common jar that does not have the Configuration.addDeprecations() api that YARN needs.
For the Tez AM, the classpath is fully constructed based on the tez tarball ( from HDFS using distributed cache ) and additional jars that Hive adds ( hive-exec.jar, etc ). It does not use HADOOP_CLASSPATH or anything else from the cluster nodes. HADOOP_CLASSPATH is only used on the client node where the hive shell runs. Can you confirm that hive was also compiled against hadoop-2.6.0 as that might be pulling in a different version of hadoop-common? thanks — Hitesh On Feb 12, 2016, at 12:16 AM, no jihun <[email protected]> wrote: > Thanks Hitesh Shah. > > It claims > > 2016-02-12 14:59:07,388 [ERROR] [main] |app.DAGAppMaster|: Error starting > DAGAppMaster > > java.lang.NoSuchMethodError: > org.apache.hadoop.conf.Configuration.addDeprecations([Lorg/apache/hadoop/conf/Configuration$DeprecationDelta;)V > at > org.apache.hadoop.yarn.conf.YarnConfiguration.addDeprecatedKeys(YarnConfiguration.java:79) > at > org.apache.hadoop.yarn.conf.YarnConfiguration.<clinit>(YarnConfiguration.java:73) > at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2271) > > I am not sure but according to this > thread(http://grokbase.com/t/cloudera/cdh-user/12765svj61/libjars-and-hadoop-jar-command) > this perhaps caused by $HADOOP_CLASSPATH problem. > > But I wander should I copy "tez-dist/target/tez-0.8.2" to all cluster then > export below? > export TEZ_JARS=/home1/apps/tez-0.8.2 > export TEZ_CONF_DIR=$TEZ_JARS/conf > export > HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH > > I did this only on name nodes. > > > 2016-02-12 16:47 GMT+09:00 Hitesh Shah <[email protected]>: > Run the following command: “bin/yarn logs -applicationId > application_1452243782005_0292” . This should give you the logs for > container_1452243782005_0292_02_000001 which may shed more light on why the > Tez ApplicationMaster is failing to launch when triggered via Hive. > > thanks > — Hitesh > > > > On Feb 11, 2016, at 10:48 PM, no jihun <[email protected]> wrote: > > > Hi all. > > > > When I execute a query on hive I got an error below.(so do in hive cli) > > no more detailed log found. > > > > what should I check? > > any advice will be appreciated. > > > > versions > > - tez-0.8.2 > > - hadoop 2.6.0 > > > > ----------------------------------- > > > > hive > set hive.execution.engine=tez; > > hive > select count(*) from contents; > > > > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please > > use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties > > files. > > > > Logging initialized using configuration in > > file:/home1/eco/hive/conf/hive-log4j.properties > > hive> set hive.execution.engine=tez; > > hive> select count(*) from agg_band_contents; > > Query ID = irteam_20160212145903_9300f3b2-3942-4423-8586-73d2eaff9e58 > > Total jobs = 1 > > Launching Job 1 out of 1 > > Exception in thread "Thread-10" java.lang.RuntimeException: > > org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. > > Application application_1452243782005_0292 failed 2 times due to AM > > Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1 > > For more detailed output, check application tracking > > page:http://xstathn003:8088/proxy/application_1452243782005_0292/Then, > > click on links to logs of each attempt. > > Diagnostics: Exception from container-launch. > > Container id: container_1452243782005_0292_02_000001 > > Exit code: 1 > > Stack trace: ExitCodeException exitCode=1: > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > > at org.apache.hadoop.util.Shell.run(Shell.java:455) > > at > > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > > at > > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > > at > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > > at > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > > > > > Container exited with a non-zero exit code 1 > > Failing this attempt. Failing the application. > > at > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) > > at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:74) > > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already > > shutdown. Application application_1452243782005_0292 failed 2 times due to > > AM Container for appattempt_1452243782005_0292_000002 exited with > > exitCode: 1 > > For more detailed output, check application tracking > > page:http://xstathn003:8088/proxy/application_1452243782005_0292/Then, > > click on links to logs of each attempt. > > Diagnostics: Exception from container-launch. > > Container id: container_1452243782005_0292_02_000001 > > Exit code: 1 > > Stack trace: ExitCodeException exitCode=1: > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > > at org.apache.hadoop.util.Shell.run(Shell.java:455) > > at > > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > > at > > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > > at > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > > at > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > > > > > Container exited with a non-zero exit code 1 > > Failing this attempt. Failing the application. > > at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:784) > > at > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205) > > at > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) > > at > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532) > > ... 1 more > > Interrupting... Be patient, this might take some time. > > > > > > > > > > ------------------- > > tez example.jar works well. > > $ hadoop jar ~/apps/tez-0.8.2/tez-examples-0.8.2.jar orderedwordcount > > /tmp/set_webapps.sh /tmp/set_webapps.result > > $ ok. > > > > ------------------- > > my setup. > > > > upload tez to hdfs. > > > > $ hadoop fs -mkdir /apps > > $ hadoop fs -mkdir /apps/tez-0.8.2 > > $ hadoop fs -put tez-dist/target/tez-0.8.2.tar.gz /apps/tez-0.8.2/ > > > > env export > > export TEZ_JARS=/home1/irteam/apps/tez-0.8.2 > > export TEZ_CONF_DIR=$TEZ_JARS/conf > > export > > HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH > > export HADOOP_USER_CLASSPATH_FIRST=true > > $ source ~/.bashrc > > > > $ mkdir tez-dist/target/tez-0.8.2/conf > > $ vi tez-dist/target/tez-0.8.2/conf/tez-site.xml > > <?xml version="1.0" encoding="UTF-8"?> > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <configuration> > > <property> > > <name>tez.lib.uris</name> > > <value>${fs.defaultFS}/apps/tez-0.8.2/tez-0.8.2.tar.gz</value> > > </property> > > </configuration> > > > > > > > > > -- > ---------------------------------------------- > Jihun No ( 노지훈 ) > ---------------------------------------------- > Twitter : @nozisim > Facebook : nozisim > Website : http://jeesim2.godohosting.com > --------------------------------------------------------------------------------- > Market Apps : android market products.
