Thanks Hitesh Shah.
It claims
2016-02-12 14:59:07,388 [ERROR] [main] |app.DAGAppMaster|: Error starting
DAGAppMaster
java.lang.NoSuchMethodError:
org.apache.hadoop.conf.Configuration.addDeprecations([Lorg/apache/hadoop/conf/Configuration$DeprecationDelta;)V
at
org.apache.hadoop.yarn.conf.YarnConfiguration.addDeprecatedKeys(YarnConfiguration.java:
79)
at
org.apache.hadoop.yarn.conf.YarnConfiguration.<clinit>(YarnConfiguration.java:
73)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2271)
I am not sure but according to this thread(
http://grokbase.com/t/cloudera/cdh-user/12765svj61/libjars-and-hadoop-jar-command
)
this perhaps caused by $HADOOP_CLASSPATH problem.
But I wander should I copy "tez-dist/target/tez-0.8.2" to all cluster then
export below?
export TEZ_JARS=/home1/apps/tez-0.8.2
export TEZ_CONF_DIR=$TEZ_JARS/conf
export
HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH
I did this only on name nodes.
2016-02-12 16:47 GMT+09:00 Hitesh Shah <[email protected]>:
> Run the following command: “bin/yarn logs -applicationId
> application_1452243782005_0292” . This should give you the logs for
> container_1452243782005_0292_02_000001 which may shed more light on why the
> Tez ApplicationMaster is failing to launch when triggered via Hive.
>
> thanks
> — Hitesh
>
>
>
> On Feb 11, 2016, at 10:48 PM, no jihun <[email protected]> wrote:
>
> > Hi all.
> >
> > When I execute a query on hive I got an error below.(so do in hive cli)
> > no more detailed log found.
> >
> > what should I check?
> > any advice will be appreciated.
> >
> > versions
> > - tez-0.8.2
> > - hadoop 2.6.0
> >
> > -----------------------------------
> >
> > hive > set hive.execution.engine=tez;
> > hive > select count(*) from contents;
> >
> > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated.
> Please use org.apache.hadoop.log.metrics.EventCounter in all the
> log4j.properties files.
> >
> > Logging initialized using configuration in
> file:/home1/eco/hive/conf/hive-log4j.properties
> > hive> set hive.execution.engine=tez;
> > hive> select count(*) from agg_band_contents;
> > Query ID = irteam_20160212145903_9300f3b2-3942-4423-8586-73d2eaff9e58
> > Total jobs = 1
> > Launching Job 1 out of 1
> > Exception in thread "Thread-10" java.lang.RuntimeException:
> org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown.
> Application application_1452243782005_0292 failed 2 times due to AM
> Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1
> > For more detailed output, check application tracking page:
> http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click
> on links to logs of each attempt.
> > Diagnostics: Exception from container-launch.
> > Container id: container_1452243782005_0292_02_000001
> > Exit code: 1
> > Stack trace: ExitCodeException exitCode=1:
> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> > at org.apache.hadoop.util.Shell.run(Shell.java:455)
> > at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> > at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > Container exited with a non-zero exit code 1
> > Failing this attempt. Failing the application.
> > at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
> > at
> org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:74)
> > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
> already shutdown. Application application_1452243782005_0292 failed 2 times
> due to AM Container for appattempt_1452243782005_0292_000002 exited with
> exitCode: 1
> > For more detailed output, check application tracking page:
> http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click
> on links to logs of each attempt.
> > Diagnostics: Exception from container-launch.
> > Container id: container_1452243782005_0292_02_000001
> > Exit code: 1
> > Stack trace: ExitCodeException exitCode=1:
> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> > at org.apache.hadoop.util.Shell.run(Shell.java:455)
> > at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> > at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > Container exited with a non-zero exit code 1
> > Failing this attempt. Failing the application.
> > at
> org.apache.tez.client.TezClient.waitTillReady(TezClient.java:784)
> > at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
> > at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
> > at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
> > ... 1 more
> > Interrupting... Be patient, this might take some time.
> >
> >
> >
> >
> > -------------------
> > tez example.jar works well.
> > $ hadoop jar ~/apps/tez-0.8.2/tez-examples-0.8.2.jar orderedwordcount
> /tmp/set_webapps.sh /tmp/set_webapps.result
> > $ ok.
> >
> > -------------------
> > my setup.
> >
> > upload tez to hdfs.
> >
> > $ hadoop fs -mkdir /apps
> > $ hadoop fs -mkdir /apps/tez-0.8.2
> > $ hadoop fs -put tez-dist/target/tez-0.8.2.tar.gz /apps/tez-0.8.2/
> >
> > env export
> > export TEZ_JARS=/home1/irteam/apps/tez-0.8.2
> > export TEZ_CONF_DIR=$TEZ_JARS/conf
> > export
> HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH
> > export HADOOP_USER_CLASSPATH_FIRST=true
> > $ source ~/.bashrc
> >
> > $ mkdir tez-dist/target/tez-0.8.2/conf
> > $ vi tez-dist/target/tez-0.8.2/conf/tez-site.xml
> > <?xml version="1.0" encoding="UTF-8"?>
> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > <configuration>
> > <property>
> > <name>tez.lib.uris</name>
> > <value>${fs.defaultFS}/apps/tez-0.8.2/tez-0.8.2.tar.gz</value>
> > </property>
> > </configuration>
> >
> >
>
>
--
----------------------------------------------
Jihun No ( 노지훈 )
----------------------------------------------
Twitter : @nozisim
Facebook : nozisim
Website : http://jeesim2.godohosting.com
---------------------------------------------------------------------------------
Market Apps : android market products.
<https://market.android.com/developer?pub=%EB%85%B8%EC%A7%80%ED%9B%88>
