Jonathan Eagles created HADOOP-14891:
----------------------------------------
Summary: Guava 21.0+ libraries not compatible with user jobs
Key: HADOOP-14891
URL: https://issues.apache.org/jira/browse/HADOOP-14891
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 2.8.1
Reporter: Jonathan Eagles
Assignee: Jonathan Eagles
Use provided a guava 23.0 jar as part of the job submission.
{code}
2017-09-20 16:10:42,897 [INFO] [main] |service.AbstractService|: Service
org.apache.tez.dag.app.DAGAppMaster failed in state STARTED; cause:
org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
org.apache.hadoop.service.ServiceStateException: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1989)
at
org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:2056)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2707)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936)
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2703)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2508)
Caused by: java.lang.NoSuchMethodError:
com.google.common.base.Objects.toStringHelper(Ljava/lang/Object;)Lcom/google/common/base/Objects$ToStringHelper;
at
org.apache.hadoop.metrics2.lib.MetricsRegistry.toString(MetricsRegistry.java:419)
at java.lang.String.valueOf(String.java:2994)
at java.lang.StringBuilder.append(StringBuilder.java:131)
at org.apache.hadoop.ipc.metrics.RpcMetrics.<init>(RpcMetrics.java:74)
at org.apache.hadoop.ipc.metrics.RpcMetrics.create(RpcMetrics.java:80)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2658)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:968)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:367)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:342)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:810)
at
org.apache.tez.dag.api.client.DAGClientServer.createServer(DAGClientServer.java:134)
at
org.apache.tez.dag.api.client.DAGClientServer.serviceStart(DAGClientServer.java:82)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1909)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1930)
2017-09-20 16:10:42,898 [ERROR] [main] |rm.TaskSchedulerManager|: Failed to do
a clean initiateStop for Scheduler: [0:TezYarn]
{code}
Metrics2 has been relying on deprecated toStringHelper for some time now which
was finally removed in guava 21.0. Removing the dependency on this method will
free up the user to supplying their own guava jar again.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
