* I did nothing with hive-exec.jar, hive.jar.directory..
* hive-default.xml
$ cat eco/hive/conf/hive-default.xml
<property>
<name>hive.jar.directory</name>
<value/>
<description>
This is the location hive in tez mode will look for to find a site
wide
installed hive instance.
</description>
</property>
* tez/lib have hadoop-common-2.6.0.jar
* tez tarball on hdfs also exactly same jar list
$ pwd
/home1/apps/tez-0.8.2/lib
$ ll
-rw-rw-r-- 1 124846 2016-02-11 13:37 RoaringBitmap-0.4.9.jar
-rw-rw-r-- 1 62983 2016-02-11 13:37 activation-1.1.jar
-rw-rw-r-- 1 4467 2016-02-11 13:37 aopalliance-1.0.jar
-rw-rw-r-- 1 44925 2016-02-11 13:37 apacheds-i18n-2.0.0-M15.jar
-rw-rw-r-- 1 691479 2016-02-11 13:37
apacheds-kerberos-codec-2.0.0-M15.jar
-rw-rw-r-- 1 16560 2016-02-11 13:37 api-asn1-api-1.0.0-M20.jar
-rw-rw-r-- 1 79912 2016-02-11 13:37 api-util-1.0.0-M20.jar
-rw-rw-r-- 1 535731 2016-02-11 13:37 async-http-client-1.8.16.jar
-rw-rw-r-- 1 303139 2016-02-11 13:37 avro-1.7.4.jar
-rw-rw-r-- 1 188671 2016-02-11 13:37 commons-beanutils-1.7.0.jar
-rw-rw-r-- 1 206035 2016-02-11 13:37 commons-beanutils-core-1.8.0.jar
-rw-rw-r-- 1 41123 2016-02-11 13:37 commons-cli-1.2.jar
-rw-rw-r-- 1 58160 2016-02-11 13:37 commons-codec-1.4.jar
-rw-rw-r-- 1 588337 2016-02-11 13:37 commons-collections-3.2.2.jar
-rw-rw-r-- 1 751238 2016-02-11 13:37 commons-collections4-4.1.jar
-rw-rw-r-- 1 241367 2016-02-11 13:37 commons-compress-1.4.1.jar
-rw-rw-r-- 1 298829 2016-02-11 13:37 commons-configuration-1.6.jar
-rw-rw-r-- 1 143602 2016-02-11 13:37 commons-digester-1.8.jar
-rw-rw-r-- 1 305001 2016-02-11 13:37 commons-httpclient-3.1.jar
-rw-rw-r-- 1 185140 2016-02-11 13:37 commons-io-2.4.jar
-rw-rw-r-- 1 284220 2016-02-11 13:37 commons-lang-2.6.jar
-rw-rw-r-- 1 62050 2016-02-11 13:37 commons-logging-1.1.3.jar
-rw-rw-r-- 1 1599627 2016-02-11 13:37 commons-math3-3.1.1.jar
-rw-rw-r-- 1 273370 2016-02-11 13:37 commons-net-3.1.jar
-rw-rw-r-- 1 68866 2016-02-11 13:37 curator-client-2.6.0.jar
-rw-rw-r-- 1 185245 2016-02-11 13:37 curator-framework-2.6.0.jar
-rw-rw-r-- 1 248171 2016-02-11 13:37 curator-recipes-2.6.0.jar
-rw-rw-r-- 1 190432 2016-02-11 13:37 gson-2.2.4.jar
-rw-rw-r-- 1 1648200 2016-02-11 13:37 guava-11.0.2.jar
-rw-rw-r-- 1 710492 2016-02-11 13:37 guice-3.0.jar
-rw-rw-r-- 1 65012 2016-02-11 13:37 guice-servlet-3.0.jar
-rw-rw-r-- 1 17035 2016-02-11 13:37 hadoop-annotations-2.6.0.jar
-rw-rw-r-- 1 67167 2016-02-11 13:37 hadoop-auth-2.6.0.jar
-rw-rw-r-- 1 3360985 2016-02-11 13:37 hadoop-common-2.6.0.jar
-rw-rw-r-- 1 7822670 2016-02-11 13:37 hadoop-hdfs-2.6.0.jar
-rw-rw-r-- 1 664918 2016-02-11 13:37
hadoop-mapreduce-client-common-2.6.0.jar
-rw-rw-r-- 1 1509399 2016-02-11 13:37
hadoop-mapreduce-client-core-2.6.0.jar
-rw-rw-r-- 1 1870176 2016-02-11 13:37 hadoop-yarn-api-2.6.0.jar
-rw-rw-r-- 1 127986 2016-02-11 13:37 hadoop-yarn-client-2.6.0.jar
-rw-rw-r-- 1 1602059 2016-02-11 13:37 hadoop-yarn-common-2.6.0.jar
-rw-rw-r-- 1 289619 2016-02-11 13:37 hadoop-yarn-server-common-2.6.0.jar
-rw-rw-r-- 1 28501 2016-02-11 13:37
hadoop-yarn-server-web-proxy-2.6.0.jar
-rw-rw-r-- 1 31212 2016-02-11 13:37 htrace-core-3.0.4.jar
-rw-rw-r-- 1 433368 2016-02-11 13:37 httpclient-4.2.5.jar
-rw-rw-r-- 1 227275 2016-02-11 13:37 httpcore-4.2.4.jar
-rw-rw-r-- 1 232248 2016-02-11 13:37 jackson-core-asl-1.9.13.jar
-rw-rw-r-- 1 18336 2016-02-11 13:37 jackson-jaxrs-1.9.13.jar
-rw-rw-r-- 1 780664 2016-02-11 13:37 jackson-mapper-asl-1.9.13.jar
-rw-rw-r-- 1 27084 2016-02-11 13:37 jackson-xc-1.9.13.jar
-rw-rw-r-- 1 2497 2016-02-11 13:37 javax.inject-1.jar
-rw-rw-r-- 1 105134 2016-02-11 13:37 jaxb-api-2.2.2.jar
-rw-rw-r-- 1 890168 2016-02-11 13:37 jaxb-impl-2.2.3-1.jar
-rw-rw-r-- 1 130458 2016-02-11 13:37 jersey-client-1.9.jar
-rw-rw-r-- 1 458739 2016-02-11 13:37 jersey-core-1.9.jar
-rw-rw-r-- 1 14786 2016-02-11 13:37 jersey-guice-1.9.jar
-rw-rw-r-- 1 147952 2016-02-11 13:37 jersey-json-1.9.jar
-rw-rw-r-- 1 81743 2016-02-11 13:37 jettison-1.3.4.jar
-rw-rw-r-- 1 539912 2016-02-11 13:37 jetty-6.1.26.jar
-rw-rw-r-- 1 177131 2016-02-11 13:37 jetty-util-6.1.26.jar
-rw-rw-r-- 1 33031 2016-02-11 13:37 jsr305-3.0.0.jar
-rw-rw-r-- 1 1045744 2016-02-11 13:37 leveldbjni-all-1.8.jar
-rw-rw-r-- 1 489884 2016-02-11 13:37 log4j-1.2.17.jar
-rw-rw-r-- 1 111908 2016-02-11 13:37 metrics-core-3.1.0.jar
-rw-rw-r-- 1 1303237 2016-02-11 13:37 netty-3.9.2.Final.jar
-rw-rw-r-- 1 29555 2016-02-11 13:37 paranamer-2.3.jar
-rw-rw-r-- 1 533455 2016-02-11 13:37 protobuf-java-2.5.0.jar
-rw-rw-r-- 1 134133 2016-02-11 13:37 servlet-api-2.5-20081211.jar
-rw-rw-r-- 1 105112 2016-02-11 13:37 servlet-api-2.5.jar
-rw-rw-r-- 1 32119 2016-02-11 13:37 slf4j-api-1.7.10.jar
-rw-rw-r-- 1 8866 2016-02-11 13:37 slf4j-log4j12-1.7.10.jar
-rw-rw-r-- 1 995968 2016-02-11 13:37 snappy-java-1.0.4.1.jar
-rw-rw-r-- 1 23346 2016-02-11 13:37 stax-api-1.0-2.jar
-rw-rw-r-- 1 26514 2016-02-11 13:37 stax-api-1.0.1.jar
-rw-rw-r-- 1 1229125 2016-02-11 13:37 xercesImpl-2.9.1.jar
-rw-rw-r-- 1 194354 2016-02-11 13:37 xml-apis-1.3.04.jar
-rw-rw-r-- 1 15010 2016-02-11 13:37 xmlenc-0.52.jar
-rw-rw-r-- 1 94672 2016-02-11 13:37 xz-1.0.jar
-rw-rw-r-- 1 792964 2016-02-11 13:37 zookeeper-3.4.6.jar
* I am not sure hive compiled against hadoop-2.6.0 (someone else set up
hive and hadoop)
but where was no problem with hive on m/r.
this is hive/lib
-rw-rw-r-- 1 236660 2014-01-30 07:09 ST4-4.0.4.jar
-rw-rw-r-- 1 4368200 2015-04-30 03:26 accumulo-core-1.6.0.jar
-rw-rw-r-- 1 102069 2015-04-30 03:26 accumulo-fate-1.6.0.jar
-rw-rw-r-- 1 57420 2015-04-30 03:26 accumulo-start-1.6.0.jar
-rw-rw-r-- 1 117409 2015-04-30 03:26 accumulo-trace-1.6.0.jar
-rw-rw-r-- 1 62983 2014-01-30 07:08 activation-1.1.jar
-rw-rw-r-- 1 1997485 2014-01-30 07:07 ant-1.9.1.jar
-rw-rw-r-- 1 18336 2014-01-30 07:07 ant-launcher-1.9.1.jar
-rw-rw-r-- 1 445288 2014-01-30 07:09 antlr-2.7.7.jar
-rw-rw-r-- 1 164368 2014-01-30 07:09 antlr-runtime-3.4.jar
-rw-rw-r-- 1 30359 2015-04-30 03:08 apache-curator-2.6.0.pom
-rw-rw-r-- 1 448794 2015-04-30 03:08 apache-log4j-extras-1.2.17.jar
-rw-rw-r-- 1 32693 2014-01-30 11:30 asm-commons-3.1.jar
-rw-rw-r-- 1 21879 2014-01-30 11:30 asm-tree-3.1.jar
-rw-rw-r-- 1 400680 2014-01-30 07:08 avro-1.7.5.jar
-rw-rw-r-- 1 110600 2014-01-30 07:09 bonecp-0.8.0.RELEASE.jar
-rw-rw-r-- 1 258370 2015-04-30 03:25
calcite-avatica-1.2.0-incubating.jar
-rw-rw-r-- 1 3519262 2015-04-30 03:25 calcite-core-1.2.0-incubating.jar
-rw-rw-r-- 1 442406 2015-04-30 03:25
calcite-linq4j-1.2.0-incubating.jar
-rw-rw-r-- 1 188671 2014-01-30 07:08 commons-beanutils-1.7.0.jar
-rw-rw-r-- 1 206035 2014-01-30 07:08 commons-beanutils-core-1.8.0.jar
-rw-rw-r-- 1 41123 2014-01-30 07:07 commons-cli-1.2.jar
-rw-rw-r-- 1 58160 2014-01-30 07:07 commons-codec-1.4.jar
-rw-rw-r-- 1 575389 2014-01-30 07:08 commons-collections-3.2.1.jar
-rw-rw-r-- 1 30595 2015-04-30 03:25 commons-compiler-2.7.6.jar
-rw-rw-r-- 1 241367 2014-01-30 07:08 commons-compress-1.4.1.jar
-rw-rw-r-- 1 298829 2014-01-30 07:08 commons-configuration-1.6.jar
-rw-rw-r-- 1 160519 2014-05-16 06:37 commons-dbcp-1.4.jar
-rw-rw-r-- 1 143602 2014-01-30 07:08 commons-digester-1.8.jar
-rw-rw-r-- 1 279781 2014-01-30 07:07 commons-httpclient-3.0.1.jar
-rw-rw-r-- 1 185140 2014-01-30 07:08 commons-io-2.4.jar
-rw-rw-r-- 1 284220 2014-01-30 11:31 commons-lang-2.6.jar
-rw-rw-r-- 1 62050 2014-01-30 07:07 commons-logging-1.1.3.jar
-rw-rw-r-- 1 832410 2014-01-30 07:08 commons-math-2.1.jar
-rw-rw-r-- 1 96221 2014-05-01 09:38 commons-pool-1.5.4.jar
-rw-rw-r-- 1 415578 2015-04-30 03:26 commons-vfs2-2.0.jar
-rw-rw-r-- 1 68866 2015-04-30 03:08 curator-client-2.6.0.jar
-rw-rw-r-- 1 185245 2015-04-30 03:08 curator-framework-2.6.0.jar
-rw-rw-r-- 1 248171 2015-04-30 03:23 curator-recipes-2.6.0.jar
-rw-rw-r-- 1 339666 2014-05-13 09:24 datanucleus-api-jdo-3.2.6.jar
-rw-rw-r-- 1 1890075 2014-05-13 09:24 datanucleus-core-3.2.10.jar
-rw-rw-r-- 1 1809447 2014-05-13 09:24 datanucleus-rdbms-3.2.9.jar
-rw-rw-r-- 1 2838580 2015-06-19 18:04 derby-10.10.2.0.jar
-rw-rw-r-- 1 18482 2015-04-30 03:25 eigenbase-properties-1.1.5.jar
-rw-rw-r-- 1 12452 2014-01-30 11:30
geronimo-annotation_1.0_spec-1.1.1.jar
-rw-rw-r-- 1 30548 2014-01-30 11:30 geronimo-jaspic_1.0_spec-1.0.jar
-rw-rw-r-- 1 16030 2014-01-30 11:30 geronimo-jta_1.1_spec-1.1.1.jar
-rw-rw-r-- 1 6377448 2014-01-30 07:10 groovy-all-2.1.6.jar
-rw-rw-r-- 1 2189117 2015-04-30 03:08 guava-14.0.1.jar
-rw-rw-r-- 1 76643 2014-01-30 07:07 hamcrest-core-1.1.jar
-rw-rw-r-- 1 121403 2015-06-19 18:05 hive-accumulo-handler-1.2.1.jar
-rw-rw-r-- 1 47713 2015-06-19 18:04 hive-ant-1.2.1.jar
-rw-rw-r-- 1 138361 2015-06-19 18:05 hive-beeline-1.2.1.jar
-rw-rw-r-- 1 39019 2015-06-19 18:05 hive-cli-1.2.1.jar
-rw-rw-r-- 1 292290 2015-06-19 18:03 hive-common-1.2.1.jar
-rw-rw-r-- 1 121668 2015-06-19 18:05 hive-contrib-1.2.1.jar
-rw-rw-r-- 1 20599030 2015-06-19 18:04 hive-exec-1.2.1.jar
-rw-rw-r-- 1 115935 2015-06-19 18:05 hive-hbase-handler-1.2.1.jar
-rw-rw-r-- 1 28091 2015-06-19 18:06 hive-hwi-1.2.1.jar
-rw-rw-r-- 1 17360142 2015-06-19 18:05 hive-jdbc-1.2.1-standalone.jar
-rw-rw-r-- 1 100580 2015-06-19 18:05 hive-jdbc-1.2.1.jar
-rw-rw-r-- 1 5505100 2015-06-19 18:04 hive-metastore-1.2.1.jar
-rw-rw-r-- 1 916706 2015-06-19 18:03 hive-serde-1.2.1.jar
-rw-rw-r-- 1 1878543 2015-06-19 18:04 hive-service-1.2.1.jar
-rw-rw-r-- 1 32390 2015-06-19 18:03 hive-shims-0.20S-1.2.1.jar
-rw-rw-r-- 1 60070 2015-06-19 18:03 hive-shims-0.23-1.2.1.jar
-rw-rw-r-- 1 8949 2015-06-19 18:03 hive-shims-1.2.1.jar
-rw-rw-r-- 1 108914 2015-06-19 18:03 hive-shims-common-1.2.1.jar
-rw-rw-r-- 1 13065 2015-06-19 18:03 hive-shims-scheduler-1.2.1.jar
-rw-rw-r-- 1 14530 2015-06-19 18:06 hive-testutils-1.2.1.jar
-rw-rw-r-- 1 719304 2015-04-30 03:08 httpclient-4.4.jar
-rw-rw-r-- 1 321639 2015-04-30 03:08 httpcore-4.4.jar
-rw-rw-r-- 1 1282424 2015-04-30 03:25 ivy-2.4.0.jar
-rw-rw-r-- 1 611863 2015-04-30 03:25 janino-2.7.6.jar
-rw-rw-r-- 1 60527 2015-04-30 03:26 jcommander-1.32.jar
-rw-rw-r-- 1 201124 2014-01-30 07:09 jdo-api-3.0.1.jar
-rw-rw-r-- 1 1681148 2014-05-13 09:25 jetty-all-7.6.0.v20120127.jar
-rw-rw-r-- 1 1683027 2014-01-30 11:30
jetty-all-server-7.6.0.v20120127.jar
-rw-rw-r-- 1 213854 2015-04-30 03:08 jline-2.12.jar
-rw-rw-r-- 1 588001 2015-04-30 03:23 joda-time-2.5.jar
-rw-rw-r-- 1 12131 2014-05-13 09:25 jpam-1.1.jar
-rw-rw-r-- 1 45944 2014-01-30 07:10 json-20090211.jar
-rw-rw-r-- 1 33031 2015-04-30 03:23 jsr305-3.0.0.jar
-rw-rw-r-- 1 15071 2014-01-30 07:09 jta-1.1.jar
-rw-rw-r-- 1 245039 2015-04-30 03:08 junit-4.11.jar
-rw-rw-r-- 1 313686 2015-04-30 03:23 libfb303-0.9.2.jar
-rw-rw-r-- 1 227712 2015-04-30 03:08 libthrift-0.9.2.jar
-rw-rw-r-- 1 481535 2014-01-30 07:06 log4j-1.2.16.jar
-rw-rw-r-- 1 447676 2014-01-30 11:30 mail-1.4.1.jar
-rw-rw-r-- 1 94421 2015-04-30 03:26 maven-scm-api-1.4.jar
-rw-rw-r-- 1 40066 2015-04-30 03:26
maven-scm-provider-svn-commons-1.4.jar
-rw-rw-r-- 1 69858 2015-04-30 03:26 maven-scm-provider-svnexe-1.4.jar
-rw-rw-r-- 1 1208356 2015-04-30 03:08 netty-3.7.0.Final.jar
-rw-rw-r-- 1 19827 2015-04-30 03:23 opencsv-2.3.jar
-rw-rw-r-- 1 65261 2014-01-30 07:07 oro-2.0.8.jar
-rw-rw-r-- 1 29555 2014-01-30 07:08 paranamer-2.3.jar
-rw-rw-r-- 1 2796935 2015-04-30 03:23 parquet-hadoop-bundle-1.6.0.jar
-rw-rw-r-- 1 48557 2015-04-30 03:25
pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar
drwxrwxr-x 6 4096 2015-09-10 20:14 php
-rw-rw-r-- 1 250546 2014-01-30 11:29 plexus-utils-1.5.6.jar
drwxrwxr-x 10 4096 2015-09-10 20:14 py
-rw-rw-r-- 1 25429 2015-04-30 03:26 regexp-1.3.jar
-rw-rw-r-- 1 105112 2014-01-30 07:08 servlet-api-2.5.jar
-rw-rw-r-- 1 1251514 2014-01-30 07:08 snappy-java-1.0.5.jar
-rw-r--r-- 1 162976273 2015-09-10 20:16
spark-assembly-1.4.1-hadoop2.6.0.jar
-rw-rw-r-- 1 26514 2014-01-30 07:08 stax-api-1.0.1.jar
-rw-rw-r-- 1 148627 2014-01-30 07:09 stringtemplate-3.2.1.jar
-rw-rw-r-- 1 93210 2015-04-30 03:26 super-csv-2.2.0.jar
-rw-rw-r-- 1 55953 2014-01-30 11:30 tempus-fugit-1.1.jar
-rw-rw-r-- 1 392124 2014-01-30 07:07 velocity-1.5.jar
-rw-rw-r-- 1 94672 2014-01-30 07:08 xz-1.0.jar
-rw-rw-r-- 1 792964 2015-04-30 03:08 zookeeper-3.4.6.jar
* and hadoop-common-2.6.0.jar have addDeprecations(DeprecationDelta[])
method.
2016-02-12 17:29 GMT+09:00 Hitesh Shah <[email protected]>:
> It seems to me that the Tez AM classpath somehow has a hadoop-common jar
> that does not have the Configuration.addDeprecations() api that YARN needs.
>
> For the Tez AM, the classpath is fully constructed based on the tez
> tarball ( from HDFS using distributed cache ) and additional jars that Hive
> adds ( hive-exec.jar, etc ). It does not use HADOOP_CLASSPATH or anything
> else from the cluster nodes. HADOOP_CLASSPATH is only used on the client
> node where the hive shell runs. Can you confirm that hive was also compiled
> against hadoop-2.6.0 as that might be pulling in a different version of
> hadoop-common?
>
> thanks
> — Hitesh
>
> On Feb 12, 2016, at 12:16 AM, no jihun <[email protected]> wrote:
>
> > Thanks Hitesh Shah.
> >
> > It claims
> >
> > 2016-02-12 14:59:07,388 [ERROR] [main] |app.DAGAppMaster|: Error
> starting DAGAppMaster
> >
> > java.lang.NoSuchMethodError:
> org.apache.hadoop.conf.Configuration.addDeprecations([Lorg/apache/hadoop/conf/Configuration$DeprecationDelta;)V
> > at
> org.apache.hadoop.yarn.conf.YarnConfiguration.addDeprecatedKeys(YarnConfiguration.java:79)
> > at
> org.apache.hadoop.yarn.conf.YarnConfiguration.<clinit>(YarnConfiguration.java:73)
> > at
> org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2271)
> >
> > I am not sure but according to this thread(
> http://grokbase.com/t/cloudera/cdh-user/12765svj61/libjars-and-hadoop-jar-command
> )
> > this perhaps caused by $HADOOP_CLASSPATH problem.
> >
> > But I wander should I copy "tez-dist/target/tez-0.8.2" to all cluster
> then export below?
> > export TEZ_JARS=/home1/apps/tez-0.8.2
> > export TEZ_CONF_DIR=$TEZ_JARS/conf
> > export
> HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH
> >
> > I did this only on name nodes.
> >
> >
> > 2016-02-12 16:47 GMT+09:00 Hitesh Shah <[email protected]>:
> > Run the following command: “bin/yarn logs -applicationId
> application_1452243782005_0292” . This should give you the logs for
> container_1452243782005_0292_02_000001 which may shed more light on why the
> Tez ApplicationMaster is failing to launch when triggered via Hive.
> >
> > thanks
> > — Hitesh
> >
> >
> >
> > On Feb 11, 2016, at 10:48 PM, no jihun <[email protected]> wrote:
> >
> > > Hi all.
> > >
> > > When I execute a query on hive I got an error below.(so do in hive cli)
> > > no more detailed log found.
> > >
> > > what should I check?
> > > any advice will be appreciated.
> > >
> > > versions
> > > - tez-0.8.2
> > > - hadoop 2.6.0
> > >
> > > -----------------------------------
> > >
> > > hive > set hive.execution.engine=tez;
> > > hive > select count(*) from contents;
> > >
> > > WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated.
> Please use org.apache.hadoop.log.metrics.EventCounter in all the
> log4j.properties files.
> > >
> > > Logging initialized using configuration in
> file:/home1/eco/hive/conf/hive-log4j.properties
> > > hive> set hive.execution.engine=tez;
> > > hive> select count(*) from agg_band_contents;
> > > Query ID = irteam_20160212145903_9300f3b2-3942-4423-8586-73d2eaff9e58
> > > Total jobs = 1
> > > Launching Job 1 out of 1
> > > Exception in thread "Thread-10" java.lang.RuntimeException:
> org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown.
> Application application_1452243782005_0292 failed 2 times due to AM
> Container for appattempt_1452243782005_0292_000002 exited with exitCode: 1
> > > For more detailed output, check application tracking page:
> http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click
> on links to logs of each attempt.
> > > Diagnostics: Exception from container-launch.
> > > Container id: container_1452243782005_0292_02_000001
> > > Exit code: 1
> > > Stack trace: ExitCodeException exitCode=1:
> > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> > > at org.apache.hadoop.util.Shell.run(Shell.java:455)
> > > at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > >
> > > Container exited with a non-zero exit code 1
> > > Failing this attempt. Failing the application.
> > > at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
> > > at
> org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:74)
> > > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has
> already shutdown. Application application_1452243782005_0292 failed 2 times
> due to AM Container for appattempt_1452243782005_0292_000002 exited with
> exitCode: 1
> > > For more detailed output, check application tracking page:
> http://xstathn003:8088/proxy/application_1452243782005_0292/Then, click
> on links to logs of each attempt.
> > > Diagnostics: Exception from container-launch.
> > > Container id: container_1452243782005_0292_02_000001
> > > Exit code: 1
> > > Stack trace: ExitCodeException exitCode=1:
> > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> > > at org.apache.hadoop.util.Shell.run(Shell.java:455)
> > > at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> > > at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > > at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > >
> > > Container exited with a non-zero exit code 1
> > > Failing this attempt. Failing the application.
> > > at
> org.apache.tez.client.TezClient.waitTillReady(TezClient.java:784)
> > > at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205)
> > > at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
> > > at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
> > > ... 1 more
> > > Interrupting... Be patient, this might take some time.
> > >
> > >
> > >
> > >
> > > -------------------
> > > tez example.jar works well.
> > > $ hadoop jar ~/apps/tez-0.8.2/tez-examples-0.8.2.jar orderedwordcount
> /tmp/set_webapps.sh /tmp/set_webapps.result
> > > $ ok.
> > >
> > > -------------------
> > > my setup.
> > >
> > > upload tez to hdfs.
> > >
> > > $ hadoop fs -mkdir /apps
> > > $ hadoop fs -mkdir /apps/tez-0.8.2
> > > $ hadoop fs -put tez-dist/target/tez-0.8.2.tar.gz /apps/tez-0.8.2/
> > >
> > > env export
> > > export TEZ_JARS=/home1/irteam/apps/tez-0.8.2
> > > export TEZ_CONF_DIR=$TEZ_JARS/conf
> > > export
> HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH
> > > export HADOOP_USER_CLASSPATH_FIRST=true
> > > $ source ~/.bashrc
> > >
> > > $ mkdir tez-dist/target/tez-0.8.2/conf
> > > $ vi tez-dist/target/tez-0.8.2/conf/tez-site.xml
> > > <?xml version="1.0" encoding="UTF-8"?>
> > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> > > <configuration>
> > > <property>
> > > <name>tez.lib.uris</name>
> > > <value>${fs.defaultFS}/apps/tez-0.8.2/tez-0.8.2.tar.gz</value>
> > > </property>
> > > </configuration>
> > >
> > >
> >
> >
> >
> >
> > --
> > ----------------------------------------------
> > Jihun No ( 노지훈 )
> > ----------------------------------------------
> > Twitter : @nozisim
> > Facebook : nozisim
> > Website : http://jeesim2.godohosting.com
> >
> ---------------------------------------------------------------------------------
> > Market Apps : android market products.
>
>
--
----------------------------------------------
Jihun No ( 노지훈 )
----------------------------------------------
Twitter : @nozisim
Facebook : nozisim
Website : http://jeesim2.godohosting.com
---------------------------------------------------------------------------------
Market Apps : android market products.
<https://market.android.com/developer?pub=%EB%85%B8%EC%A7%80%ED%9B%88>
