Run the following command: “bin/yarn logs -applicationId application_1452243782005_0292” . This should give you the logs for container_1452243782005_0292_02_000001 which may shed more light on why the Tez ApplicationMaster is failing to launch when triggered via Hive.
thanks — Hitesh On Feb 11, 2016, at 10:48 PM, no jihun <jees...@gmail.com> wrote: > Hi all. > > When I execute a query on hive I got an error below.(so do in hive cli) > no more detailed log found. > > what should I check? > any advice will be appreciated. > > versions > - tez-0.8.2 > - hadoop 2.6.0 > > ----------------------------------- > > hive > set hive.execution.engine=tez; > hive > select count(*) from contents; > > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use > org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. > > Logging initialized using configuration in > file:/home1/eco/hive/conf/hive-log4j.properties > hive> set hive.execution.engine=tez; > hive> select count(*) from agg_band_contents; > Query ID = irteam_20160212145903_9300f3b2-3942-4423-8586-73d2eaff9e58 > Total jobs = 1 > Launching Job 1 out of 1 > Exception in thread "Thread-10" java.lang.RuntimeException: > org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. > Application application_1452243782005_0292 failed 2 times due to AM Container > for appattempt_1452243782005_0292_000002 exited with exitCode: 1 > For more detailed output, check application tracking > page:http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click > on links to logs of each attempt. > Diagnostics: Exception from container-launch. > Container id: container_1452243782005_0292_02_000001 > Exit code: 1 > Stack trace: ExitCodeException exitCode=1: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > at org.apache.hadoop.util.Shell.run(Shell.java:455) > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > Container exited with a non-zero exit code 1 > Failing this attempt. Failing the application. > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) > at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:74) > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already > shutdown. Application application_1452243782005_0292 failed 2 times due to AM > Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1 > For more detailed output, check application tracking > page:http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click > on links to logs of each attempt. > Diagnostics: Exception from container-launch. > Container id: container_1452243782005_0292_02_000001 > Exit code: 1 > Stack trace: ExitCodeException exitCode=1: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > at org.apache.hadoop.util.Shell.run(Shell.java:455) > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > Container exited with a non-zero exit code 1 > Failing this attempt. Failing the application. > at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:784) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532) > ... 1 more > Interrupting... Be patient, this might take some time. > > > > > ------------------- > tez example.jar works well. > $ hadoop jar ~/apps/tez-0.8.2/tez-examples-0.8.2.jar orderedwordcount > /tmp/set_webapps.sh /tmp/set_webapps.result > $ ok. > > ------------------- > my setup. > > upload tez to hdfs. > > $ hadoop fs -mkdir /apps > $ hadoop fs -mkdir /apps/tez-0.8.2 > $ hadoop fs -put tez-dist/target/tez-0.8.2.tar.gz /apps/tez-0.8.2/ > > env export > export TEZ_JARS=/home1/irteam/apps/tez-0.8.2 > export TEZ_CONF_DIR=$TEZ_JARS/conf > export > HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH > export HADOOP_USER_CLASSPATH_FIRST=true > $ source ~/.bashrc > > $ mkdir tez-dist/target/tez-0.8.2/conf > $ vi tez-dist/target/tez-0.8.2/conf/tez-site.xml > <?xml version="1.0" encoding="UTF-8"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <configuration> > <property> > <name>tez.lib.uris</name> > <value>${fs.defaultFS}/apps/tez-0.8.2/tez-0.8.2.tar.gz</value> > </property> > </configuration> > >
