[
https://issues.apache.org/jira/browse/TEZ-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417065#comment-17417065
]
László Bodor commented on TEZ-4335:
-----------------------------------
[~Rob.xu]: could you please share some details about this scenario? afaik I
know, 3.0.0-cdh6.3.2 suggests that the environment is cdh6.x, which doesn't
officially support Tez (only MR), so, unfortunately this kind of problem easily
shows due to environment/deployment
as a rule of thumb, I recommend the tez install instructions:
https://tez.apache.org/install.html
> hive on tez, com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider
> -----------------------------------------------------------------------------
>
> Key: TEZ-4335
> URL: https://issues.apache.org/jira/browse/TEZ-4335
> Project: Apache Tez
> Issue Type: Bug
> Components: UI
> Affects Versions: 0.9.2
> Environment: CDH 6.3.2
> Hive 2.1.1
>
> Reporter: Rob
> Priority: Major
>
> 021-09-08 13:38:15,012 [INFO] [main] |shim.HadoopShimsLoader|: Trying to
> locate HadoopShimProvider for hadoopVersion=3.0.0-cdh6.3.2, majorVersion=3,
> minorVersion=0
> 2021-09-08 13:38:15,014 [INFO] [main] |shim.HadoopShimsLoader|: Picked
> HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null,
> overrideProviderViaConfig=null, hadoopVersion=3.0.0-cdh6.3.2, majorVersion=3,
> minorVersion=0
> 2021-09-08 13:38:15,038 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> TaskSchedulers: [0:TezYarn:null],[1:TezUber:null]
> 2021-09-08 13:38:15,038 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null]
> 2021-09-08 13:38:15,038 [INFO] [main] |app.DAGAppMaster|: AM Level configured
> TaskCommunicators: [0:TezYarn:null],[1:TezUber:null]
> 2021-09-08 13:38:15,038 [INFO] [main] |app.DAGAppMaster|: Comparing client
> version with AM version, clientVersion=0.9.2, AMVersion=0.9.2
> 2021-09-08 13:38:15,755 [INFO] [main] |app.TaskCommunicatorManager|: Creating
> Default Task Communicator
> 2021-09-08 13:38:15,762 [INFO] [main] |Configuration.deprecation|:
> mapred.input.dir.recursive is deprecated. Instead, use
> mapreduce.input.fileinputformat.input.dir.recursive
> 2021-09-08 13:38:15,764 [INFO] [main] |Configuration.deprecation|:
> io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
> 2021-09-08 13:38:15,765 [INFO] [main] |Configuration.deprecation|:
> yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead,
> use yarn.system-metrics-publisher.enabled
> 2021-09-08 13:38:15,765 [INFO] [main] |app.TaskCommunicatorManager|: Creating
> Default Local Task Communicator
> 2021-09-08 13:38:15,779 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.container.AMContainerEventType for class
> org.apache.tez.dag.app.rm.container.AMContainerMap
> 2021-09-08 13:38:15,779 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.node.AMNodeEventType for class
> org.apache.tez.dag.app.rm.node.AMNodeTracker
> 2021-09-08 13:38:15,780 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class
> org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler
> 2021-09-08 13:38:15,780 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.DAGEventType for class
> org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher
> 2021-09-08 13:38:15,781 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.VertexEventType for class
> org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher
> 2021-09-08 13:38:15,781 [INFO] [main] |app.DAGAppMaster|: Using concurrent
> dispatcher: false
> 2021-09-08 13:38:15,781 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.TaskEventType for class
> org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher
> 2021-09-08 13:38:15,782 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class
> org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher
> 2021-09-08 13:38:15,782 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent
> dispatch using: class
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2021-09-08 13:38:15,782 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler
> 2021-09-08 13:38:15,803 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.AMSchedulerEventType for class
> org.apache.tez.dag.app.rm.TaskSchedulerManager
> 2021-09-08 13:38:15,806 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Creating DefaultContainerLauncher
> 2021-09-08 13:38:15,812 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Upper limit on the thread pool size is 500
> 2021-09-08 13:38:15,812 [INFO] [main] |launcher.TezContainerLauncherImpl|:
> Creating LocalContainerLauncher
> 2021-09-08 13:38:15,819 [INFO] [main] |common.AsyncDispatcher|: Registering
> class org.apache.tez.dag.app.rm.ContainerLauncherEventType for class
> org.apache.tez.dag.app.launcher.ContainerLauncherManager
> 2021-09-08 13:38:15,864 [INFO] [main] |node.AMNodeTracker|:
> blacklistDisablePercent is 33, blacklistingEnabled: true,
> maxTaskFailuresPerNode: 10, nodeUpdatesRescheduleEnabled: false
> 2021-09-08 13:38:15,866 [INFO] [main] |web.WebUIService|: Tez UI History URL:
> http://hadoop03:8080/tez-ui/#/tez-app/application_1631078963795_0003
> 2021-09-08 13:38:15,866 [INFO] [main] |history.HistoryEventHandler|:
> Initializing HistoryEventHandler withrecoveryEnabled=true,
> historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
> 2021-09-08 13:38:16,014 [INFO] [main] |impl.TimelineClientImpl|: Timeline
> service address: null
> 2021-09-08 13:38:16,190 [ERROR] [main] |app.DAGAppMaster|: Error starting
> DAGAppMaster
> java.lang.IncompatibleClassChangeError:
> com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider and
> com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider$Wadl
> disagree on InnerClasses attribute
> at java.lang.Class.getDeclaringClass0(Native Method)
> at java.lang.Class.getDeclaringClass(Class.java:1235)
> at java.lang.Class.getEnclosingClass(Class.java:1277)
> at
> com.sun.jersey.core.spi.component.ComponentConstructor.getInstance(ComponentConstructor.java:170)
> at
> com.sun.jersey.core.spi.component.ProviderFactory.__getComponentProvider(ProviderFactory.java:166)
> at
> com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:137)
> at
> com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:283)
> at
> com.sun.jersey.core.spi.component.ProviderServices.getServices(ProviderServices.java:163)
> at
> com.sun.jersey.core.spi.factory.MessageBodyFactory.initReaders(MessageBodyFactory.java:176)
> at
> com.sun.jersey.core.spi.factory.MessageBodyFactory.init(MessageBodyFactory.java:162)
> at com.sun.jersey.api.client.Client.init(Client.java:342)
> at com.sun.jersey.api.client.Client.access$000(Client.java:118)
> at com.sun.jersey.api.client.Client$1.f(Client.java:191)
> at com.sun.jersey.api.client.Client$1.f(Client.java:187)
> at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
> at com.sun.jersey.api.client.Client.<init>(Client.java:187)
> at com.sun.jersey.api.client.Client.<init>(Client.java:170)
> at
> org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:122)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at
> org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService.serviceInit(ATSHistoryLoggingService.java:110)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at
> org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
> at
> org.apache.tez.dag.history.HistoryEventHandler.serviceInit(HistoryEventHandler.java:105)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.app.DAGAppMaster.initServices(DAGAppMaster.java:1960)
> at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:630)
> at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
> at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2662)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
> at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2659)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2464)
> 2021-09-08 13:38:16,200 [INFO] [shutdown-hook-0] |app.DAGAppMaster|:
> DAGAppMasterShutdownHook invoked
> 2021-09-08 13:38:16,201 [INFO] [shutdown-hook-0]
> |history.HistoryEventHandler|: Stopping HistoryEventHandler
> 2021-09-08 13:38:16,201 [INFO] [shutdown-hook-0]
> |ats.ATSHistoryLoggingService|: Stopping ATSService, eventQueueBacklog=0
> 2021-09-08 13:38:16,201 [INFO] [shutdown-hook-0] |rm.TaskSchedulerManager|:
> Shutting down AppCallbackExecutor
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
