[
https://issues.apache.org/jira/browse/TEZ-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512710#comment-16512710
]
Jonathan Eagles commented on TEZ-3885:
--------------------------------------
[~karthikp8888], we upgraded our jersey dependency to 1.19 as part of the Tez
0.10.0 line which will be the tez version that is fully compatible with hadoop
3+. Tez actually has only a very small dependency on jersey so there may be a
way to keep 0.9.x runtime working with hadoop 3+ release let me investigate.
TEZ-3929
> Tez timeline server integration error
> -------------------------------------
>
> Key: TEZ-3885
> URL: https://issues.apache.org/jira/browse/TEZ-3885
> Project: Apache Tez
> Issue Type: Bug
> Components: UI
> Affects Versions: 0.9.0
> Environment: apache hive version - 3.0.0-SNAPSHOT
> apache hadoop version - 3.0.0
> tez version - 0.9.0
> Reporter: Jerryjung
> Priority: Critical
> Labels: beginner
>
> If I configure below, I've got an error about launch hive error. I think it's
> a library problem, but I'm not sure how to fix it.
> <configuration>
> <property>
> <name>tez.lib.uris</name>
> <value>hdfs:///apps/tez-0.9.0/tez-0.9.0-minimal.tar.gz</value>
> </property>
> <property>
> <name>tez.use.cluster.hadoop-libs</name>
> <value>true</value>
> </property>
> <property>
> <description>Enable Tez to use the Timeline Server for History
> Logging</description>
> <name>tez.history.logging.service.class</name>
>
> <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value>
> </property>
> <property>
> <description>URL for where the Tez UI is hosted</description>
> <name>tez.tez-ui.history-url.base</name>
> <value>http://HOST:8081/tez-ui-0.9.0/</value>
> </property>
> </configuration>
> 2018-01-09 17:47:55,484 [INFO] [main] |app.DAGAppMaster|: Creating
> DAGAppMaster for applicationId=application_1515483495537_0016, attemptNum=1,
> AMContainerId=container_e40_1515483495537_0016_01_000001, jvmPid=127852,
> userFromEnv=hadoop, cliSessionOption=true,
> pwd=/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001,
>
> localDirs=/data1/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data2/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data3/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data4/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,/data6/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016,
>
> logDirs=/data1/yarn/logs/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001
> 2018-01-09 17:47:55,588 [INFO] [main] |Configuration.deprecation|:
> yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead,
> use yarn.system-metrics-publisher.enabled
> 2018-01-09 17:47:55,727 [INFO] [main] |security.SecurityUtil|: Updating
> Configuration
> 2018-01-09 17:47:55,867 [INFO] [main] |app.DAGAppMaster|: Created
> DAGAppMaster for application appattempt_1515483495537_0016_000001,
> versionInfo=[ component=tez-dag, version=0.9.0, revision=${buildNumber},
> SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git,
> buildTime=2018-01-09T00:23:13Z ]
> 2018-01-09 17:47:55,897 [INFO] [main] |app.DAGAppMaster|:
> /************************************************************
> [system properties]
> os.name: Linux
> os.version: 2.6.32-573.7.1.el6.x86_64
> java.home: /usr/java/jdk1.8.0_121/jre
> java.runtime.version: 1.8.0_121-b13
> java.vendor: Oracle Corporation
> java.version: 1.8.0_121
> java.vm.name: Java HotSpot(TM) 64-Bit Server VM
> java.class.path:
> /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/hive-exec-3.0.0-SNAPSHOT-09b95fc8eaad07546c7d390259f6a8727a4be9b13ea05b2742a0dd4dbe78b7e7.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-ext-service-tests-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-api-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-job-analyzer-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-common-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-acls-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-dag-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/hadoop-shim-2.8-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-internals-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-history-parser-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-history-with-fs-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-examples-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-runtime-library-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-mapreduce-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-javadoc-tools-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/tez-yarn-timeline-cache-plugin-0.9.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-core-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-mapreduce-client-common-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-util-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/async-http-client-1.8.16.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jsr305-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jetty-6.1.26.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/RoaringBitmap-0.4.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-client-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-hdfs-client-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-api-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-io-2.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/guava-11.0.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jettison-1.3.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/jersey-json-1.9.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/metrics-core-3.1.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections4-4.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-collections-3.2.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-math3-3.1.1.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/protobuf-java-2.5.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-codec-1.4.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-lang-2.6.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/commons-cli-1.2.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/netty-3.6.2.Final.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/slf4j-log4j12-1.7.10.jar:/data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tezlib/lib/servlet-api-2.5.jar:/home/hadoop/servers/hadoop-3.0.0/etc/hadoop:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/hadoop-kms-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.0.0-tests.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-auth-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-server-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/zookeeper-3.4.9.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-security-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/xz-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-http-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jetty-io-9.3.19.v20170502.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/hadoop-annotations-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/commons-net-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-common-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-router-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-hbase-tests-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-client-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-api-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-server-timelineservice-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/hadoop-yarn-registry-3.0.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-server-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-protocol-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop2-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/findbugs-annotations-1.3.9-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-2.2.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jcodings-1.0.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-procedure-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-httpclient-3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/htrace-core-3.1.0-incubating.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-prefix-tree-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-compiler-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/joni-2.1.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jamon-runtime-2.4.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/fst-2.50.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-csv-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-common-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jasper-runtime-5.5.23.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-annotations-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-hadoop-compat-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/hbase-client-1.2.6.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/commons-el-1.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/guice-4.0.jar:/home/hadoop/servers/hadoop-3.0.0/share/hadoop/yarn/lib/disruptor-3.3.0.jar:
> java.io.tmpdir:
> /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001/tmp
> user.dir:
> /data5/yarn/local/usercache/hadoop/appcache/application_1515483495537_0016/container_e40_1515483495537_0016_01_000001
> user.name: hadoop
> ************************************************************/
> 2018-01-09 17:47:55,909 [INFO] [main] |shim.HadoopShimsLoader|: Trying to
> locate HadoopShimProvider for hadoopVersion=3.0.0, majorVersion=3,
> minorVersion=0
> 2018-01-09 17:47:55,911 [INFO] [main] |shim.HadoopShimsLoader|: Picked
> HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null,
> overrideProviderViaConfig=null, hadoopVersion=3.0.0, majorVersion=3,
> minorVersion=0
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> TaskSchedulers: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> TaskCommunicators: [0:TezYarn:null],[1:TezUber:null]
> 2018-01-09 17:47:55,932 [INFO] [main] |app.DAGAppMaster|: Comparing client
> version with AM version, clientVersion=0.9.0, AMVersion=0.9.0
> 2018-01-09 17:47:56,544 [INFO] [main] |app.TaskCommunicatorManager|: Creating
> Default Task Communicator
> 2018-01-09 17:47:56,552 [INFO] [main] |Configuration.deprecation|:
> mapred.input.dir.recursive is deprecated. Instead, use
> mapreduce.input.fileinputformat.input.dir.recursive
> 2018-01-09 17:47:56,554 [INFO] [main] |Configuration.deprecation|:
> io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
> 2018-01-09 17:47:56,555 [INFO] [main] |Configuration.deprecation|:
> yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead,
> use yarn.system-metrics-publisher.enabled
> 2018-01-09 17:47:56,555 [INFO] [main] |app.TaskCommunicatorManager|: Creating
> Default Local Task Communicator
> 2018-01-09 17:47:56,561 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.container.AMContainerEventType for class
> org.apache.tez.dag.app.rm.container.AMContainerMap
> 2018-01-09 17:47:56,562 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.node.AMNodeEventType for class
> org.apache.tez.dag.app.rm.node.AMNodeTracker
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.DAGEventType for class
> org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
> 2018-01-09 17:47:56,563 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.VertexEventType for class
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
> 2018-01-09 17:47:56,563 [INFO] [main] |app.DAGAppMaster|: Using concurrent
> dispatcher: false
> 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.TaskEventType for class
> org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
> 2018-01-09 17:47:56,564 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class
> org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
> 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent
> dispatch using: class
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2018-01-09 17:47:56,565 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2018-01-09 17:47:56,583 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.AMSchedulerEventType for class
> org.apache.tez.dag.app.rm.TaskSchedulerManager
> 2018-01-09 17:47:56,585 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Creating DefaultContainerLauncher
> 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Upper limit on the thread pool size is 500
> 2018-01-09 17:47:56,591 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Creating LocalContainerLauncher
> 2018-01-09 17:47:56,599 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class
> org.apache.tez.dag.app.launcher.ContainerLauncherManager
> 2018-01-09 17:47:56,636 [INFO] [main] |node.AMNodeTracker|:
> blacklistDisablePercent is 33, blacklistingEnabled: true,
> maxTaskFailuresPerNode: 3, nodeUpdatesRescheduleEnabled: false
> 2018-01-09 17:47:56,637 [INFO] [main] |web.WebUIService|: Tez UI History URL:
> http://HOST:8081/tez-ui-0.9.0/#/tez-app/application_1515483495537_0016
> 2018-01-09 17:47:56,637 [INFO] [main] |history.HistoryEventHandler|:
> Initializing HistoryEventHandler withrecoveryEnabled=true,
> historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
> 2018-01-09 17:47:56,645 [INFO] [main] |impl.TimelineClientImpl|: Timeline
> service address: null
> 2018-01-09 17:47:56,753 [ERROR] [main] |app.DAGAppMaster|: Error starting
> DAGAppMaster
> java.lang.IncompatibleClassChangeError:
> com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider and
> com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider$Wadl
> disagree on InnerClasses attribute
> at java.lang.Class.getDeclaringClass0(Native Method)
> at java.lang.Class.getDeclaringClass(Class.java:1235)
> at java.lang.Class.getEnclosingClass(Class.java:1277)
> at
> com.sun.jersey.core.spi.component.ComponentConstructor.getInstance(ComponentConstructor.java:170)
> at
> com.sun.jersey.core.spi.component.ProviderFactory.__getComponentProvider(ProviderFactory.java:166)
> at
> com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:137)
> at
> com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:283)
> at
> com.sun.jersey.core.spi.component.ProviderServices.getServices(ProviderServices.java:163)
> at
> com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:176)
> at
> com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162)
> at com.sun.jersey.api.client.Client.init(Client.java:342)
> at com.sun.jersey.api.client.Client.access$000(Client.java:118)
> at com.sun.jersey.api.client.Client$1.f(Client.java:191)
> at com.sun.jersey.api.client.Client$1.f(Client.java:187)
> at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
> at com.sun.jersey.api.client.Client.<init>(Client.java:187)
> at com.sun.jersey.api.client.Client.<init>(Client.java:170)
> at
> org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:122)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at
> org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at
> org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630)
> at
> org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
> at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
> 2018-01-09 17:47:56,757 [INFO] [pool-1-thread-1] |app.DAGAppMaster|:
> DAGAppMasterShutdownHook invoked
> 2018-01-09 17:47:56,757 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|:
> Failed to do a clean initiateStop for Scheduler: [0:TezYarn]
> java.lang.NullPointerException
> at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688)
> at
> org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,758 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|:
> Failed to do a clean initiateStop for Scheduler: [1:TezUber]
> java.lang.NullPointerException
> at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:688)
> at
> org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2179)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2195)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1]
> |history.HistoryEventHandler|: Stopping HistoryEventHandler
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1]
> |ats.ATSHistoryLoggingService|: Stopping ATSService, eventQueueBacklog=0
> 2018-01-09 17:47:56,759 [INFO] [pool-1-thread-1] |rm.TaskSchedulerManager|:
> Shutting down AppCallbackExecutor
> 2018-01-09 17:47:56,759 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|:
> Error in TaskScheduler when checking if a scheduler has unregistered,
> scheduler=[0:TezYarn]
> java.lang.NullPointerException
> at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-09 17:47:56,760 [ERROR] [pool-1-thread-1] |rm.TaskSchedulerManager|:
> Error in TaskScheduler when checking if a scheduler has unregistered,
> scheduler=[1:TezUber]
> java.lang.NullPointerException
> at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:986)
> at
> org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2208)
> at
> org.apache.hadoop.service.AbstractService.stop(AbstractService.java:222)
> at
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterShutdownHook.run(DAGAppMaster.java:2514)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
