[ https://issues.apache.org/jira/browse/TEZ-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484010#comment-16484010 ]
Jonathan Eagles commented on TEZ-3885: -------------------------------------- [~jerryjung], is this still an issue? Seems like we missed the alert when you created this ticket > Tez timeline server integration error > ------------------------------------- > > Key: TEZ-3885 > URL: https://issues.apache.org/jira/browse/TEZ-3885 > Project: Apache Tez > Issue Type: Bug > Components: UI > Affects Versions: 0.9.0 > Environment: apache hive version - 3.0.0-SNAPSHOT > apache hadoop version - 3.0.0 > tez version - 0.9.0 > Reporter: Jerryjung > Priority: Critical > Labels: beginner > > If I configure below, I've got an error about launch hive error. I think it's > a library problem, but I'm not sure how to fix it. > <configuration> > <property> > <name>tez.lib.uris</name> > <value>hdfs:///apps/tez-0.9.0/tez-0.9.0-minimal.tar.gz</value> > </property> > <property> > <name>tez.use.cluster.hadoop-libs</name> > <value>true</value> > </property> > <property> > <description>Enable Tez to use the Timeline Server for History > Logging</description> > <name>tez.history.logging.service.class</name> > > <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value> > </property> > <property> > <description>URL for where the Tez UI is hosted</description> > <name>tez.tez-ui.history-url.base</name> > <value>http://HOST:8081/tez-ui-0.9.0/</value> > </property> > </configuration> > 2018-01-09 17:47:55,484 [INFO] [main] |app.DAGAppMaster|: Creating > DAGAppMaster for applicationId=application_1515483495537_0016, attemptNum=1, > AMContainerId=container_e40_1515483495537_0016_01_000001, jvmPid=127852, > userFromEnv=hadoop, cliSessionOption=true, > pwd=/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001, > > localDirs=/data1/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data2/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data3/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data4/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data6/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016, > > logDirs=/data1/yarn/logs/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001 > 2018-01-09 17:47:55,588 [INFO] [main] |Configuration.deprecation|: > yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, > use yarn.system-metrics-publisher.enabled > 2018-01-09 17:47:55,727 [INFO] [main] |security.SecurityUtil|: Updating > Configuration > 2018-01-09 17:47:55,867 [INFO] [main] |app.DAGAppMaster|: Created > DAGAppMaster for application appattempt_1515483495537_0016_000001, > versionInfo=[ component=tez-dag, version=0.9.0, revision=${buildNumber}, > SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, > buildTime=2018-01-09T00:23:13Z ] > 2018-01-09 17:47:55,897 [INFO] [main] |app.DAGAppMaster|: > /************************************************************ > [system properties] > os.name: Linux > os.version: 2.6.32-573.7.1.el6.x86_64 > java.home: /usr/java/jdk1.8.0_121/jre > java.runtime.version: 1.8.0_121-b13 > java.vendor: Oracle Corporation > java.version: 1.8.0_121 > java.vm.name: Java HotSpot(TM) 64-Bit Server VM > java.class.path: > /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/hive-exec-3.0.0-SNAPSHOT-09b95fc8eaad07546c7d390259f6a8727a4be9b13ea05b2742a0dd4dbe78b7e7.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-ext-service-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-api-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-job-analyzer-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-common-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-acls-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-dag-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-2.8-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-internals-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-history-parser-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-fs-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-examples-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-library-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-mapreduce-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-javadoc-tools-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-cache-plugin-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-core-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-common-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-util-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/async-http-client-1.8.16.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jsr305-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/RoaringBitmap-0.4.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-client-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-hdfs-client-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-api-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-io-2.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/guava-11.0.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jettison-1.3.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-json-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/metrics-core-3.1.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections4-4.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections-3.2.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-math3-3.1.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/protobuf-java-2.5.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-codec-1.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-lang-2.6.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-cli-1.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/netty-3.6.2.Final.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-log4j12-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/servlet-api-2.5.jar:/home/hadoop/servers/hadoop-3.0.0/etc/hadoop:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-kms-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-router-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-api-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-registry-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-server-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-protocol-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop2-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-2.2.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jcodings-1.0.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-procedure-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-prefix-tree-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-compiler-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/joni-2.1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jamon-runtime-2.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/fst-2.50.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-csv-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-common-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-runtime-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-annotations-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-client-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-el-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/disruptor-3.3.0.jar: > java.io.tmpdir: > /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tmp > user.dir: > /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001 > user.name: hadoop > ************************************************************/ > 2018-01-09 17:47:55,909 [INFO] [main] |shim.HadoopShimsLoader|: Trying to > locate HadoopShimProvider for hadoopVersion=3.0.0, majorVersion=3, > minorVersion=0 > 2018-01-09 17:47:55,911 [INFO] [main] |shim.HadoopShimsLoader|: Picked > HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, > overrideProviderViaConfig=null, hadoopVersion=3.0.0, majorVersion=3, > minorVersion=0 > 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured > TaskSchedulers: [0:TezYarn:null],[1:TezUber:null] > 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured > ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null] > 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured > TaskCommunicators: [0:TezYarn:null],[1:TezUber:null] > 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: Comparing client > version with AM version, clientVersion=0.9.0, AMVersion=0.9.0 > 2018-01-09 17:47:56,544 [INFO] [main] |app.TaskCommunicatorManager|: Creating > Default Task Communicator > 2018-01-09 17:47:56,552 [INFO] [main] |Configuration.deprecation|: > mapred.input.dir.recursive is deprecated. Instead, use > mapreduce.input.fileinputformat.input.dir.recursive > 2018-01-09 17:47:56,554 [INFO] [main] |Configuration.deprecation|: > io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum > 2018-01-09 17:47:56,555 [INFO] [main] |Configuration.deprecation|: > yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, > use yarn.system-metrics-publisher.enabled > 2018-01-09 17:47:56,555 [INFO] [main] |app.TaskCommunicatorManager|: Creating > Default Local Task Communicator > 2018-01-09 17:47:56,561 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.rm.container.AMContainerEventType for class > org.apache.tez.dag.app.rm.container.AMContainerMap > 2018-01-09 17:47:56,562 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.rm.node.AMNodeEventType for class > org.apache.tez.dag.app.rm.node.AMNodeTracker > 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class > org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler > 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.DAGEventType for class > org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher > 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.VertexEventType for class > org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher > 2018-01-09 17:47:56,563 [INFO] [main] |app.DAGAppMaster|: Using concurrent > dispatcher: false > 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.TaskEventType for class > org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher > 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class > org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher > 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent > dispatch using: class > org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler > 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class > org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler > 2018-01-09 17:47:56,583 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.rm.AMSchedulerEventType for class > org.apache.tez.dag.app.rm.TaskSchedulerManager > 2018-01-09 17:47:56,585 [INFO] [main] |launcher.TezContainerLauncherImpl|: > Creating DefaultContainerLauncher > 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|: > Upper limit on the thread pool size is 500 > 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|: > Creating LocalContainerLauncher > 2018-01-09 17:47:56,599 [INFO] [main] |common.AsyncDispatcher|: Registering > class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class > org.apache.tez.dag.app.launcher.ContainerLauncherManager > 2018-01-09 17:47:56,636 [INFO] [main] |node.AMNodeTracker|: > blacklistDisablePercent is 33, blacklistingEnabled: true, > maxTaskFailuresPerNode: 3, nodeUpdatesRescheduleEnabled: false > 2018-01-09 17:47:56,637 [INFO] [main] |web.WebUIService|: Tez UI History URL: > http://HOST:8081/tez-ui-0.9.0/#/tez-app/application_1515483495537_0016 > 2018-01-09 17:47:56,637 [INFO] [main] |history.HistoryEventHandler|: > Initializing HistoryEventHandler withrecoveryEnabled=true, > historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService > 2018-01-09 17:47:56,645 [INFO] [main] |impl.TimelineClientImpl|: Timeline > service address: null > 2018-01-09 17:47:56,753 [ERROR] [main] |app.DAGAppMaster|: Error starting > DAGAppMaster > java.lang.IncompatibleClassChangeError: > com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider and > com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider$Wadl > disagree on InnerClasses attribute > at java.lang.Class.getDeclaringClass0(Native Method) > at java.lang.Class.getDeclaringClass(Class.java:1235) > at java.lang.Class.getEnclosingClass(Class.java:1277) > at > com.sun.jersey.core.spi.component.ComponentConstructor.getInstance(ComponentConstructor.java:170) > at > com.sun.jersey.core.spi.component.ProviderFactory.__getComponentProvider(ProviderFactory.java:166) > at > com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:137) > at > com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:283) > at > com.sun.jersey.core.spi.component.ProviderServices.getServices(ProviderServices.java:163) > at > com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:176) > at > com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162) > at com.sun.jersey.api.client.Client.init(Client.java:342) > at com.sun.jersey.api.client.Client.access$000(Client.java:118) > at com.sun.jersey.api.client.Client$1.f(Client.java:191) > at com.sun.jersey.api.client.Client$1.f(Client.java:187) > at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193) > at com.sun.jersey.api.client.Client.<init>(Client.java:187) > at com.sun.jersey.api.client.Client.<init>(Client.java:170) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:122) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at > org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at > org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960) > at > org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) > at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962) > at > org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659) > at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464) > 2018-01-09 17:47:56,757 [INFO] [pool-1-thread-1] |app.DAGAppMaster|: > DAGAppMasterShutdownHook invoked > 2018-01-09 17:47:56,757 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: > Failed to do a clean initiateStop for Scheduler: [0:TezYarn] > java.lang.NullPointerException > at > org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688) > at > org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179) > at > org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195) > at > org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222) > at > org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > 2018-01-09 17:47:56,758 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: > Failed to do a clean initiateStop for Scheduler: [1:TezUber] > java.lang.NullPointerException > at > org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688) > at > org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179) > at > org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195) > at > org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222) > at > org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] > |history.HistoryEventHandler|: Stopping HistoryEventHandler > 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] > |ats.ATSHistoryLoggingService|: Stopping ATSService, eventQueueBacklog=0 > 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] |rm.TaskSchedulerManager|: > Shutting down AppCallbackExecutor > 2018-01-09 17:47:56,759 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: > Error in TaskScheduler when checking if a scheduler has unregistered, > scheduler=[0:TezYarn] > java.lang.NullPointerException > at > org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986) > at > org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208) > at > org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222) > at > org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > 2018-01-09 17:47:56,760 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|: > Error in TaskScheduler when checking if a scheduler has unregistered, > scheduler=[1:TezUber] > java.lang.NullPointerException > at > org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986) > at > org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208) > at > org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222) > at > org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v7.6.3#76005)