[
https://issues.apache.org/jira/browse/HBASE-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165903#comment-16165903
]
Duo Zhang commented on HBASE-18803:
-----------------------------------
I think we need to find out why there are conflicts...
For netty, 4.1 and 4.0 does have some incompatible changes, and also netty-all
can not overwrite other netty modules such as netty-transport so it is
reasonable to shade netty. But I do not think curator has the same problem
between 2.7.x and 2.12.x?
For the long lived connection to zk, IIRC, I used to implement the logic by a
watcher and finally we changed to get data from zk every time as we have caches
in the upper layer. So the long lived connection is not a big deal for now, if
we want to change, just create curator framework every time or close it if it
idles for a long time.
Thanks.
> Mapreduce job get failed caused by NoClassDefFoundError:
> org/apache/commons/lang3/ArrayUtils
> --------------------------------------------------------------------------------------------
>
> Key: HBASE-18803
> URL: https://issues.apache.org/jira/browse/HBASE-18803
> Project: HBase
> Issue Type: Bug
> Affects Versions: 2.0.0-alpha-2
> Reporter: Yi Liang
> Assignee: Yi Liang
> Fix For: 2.0.0
>
> Attachments: HBASE-18803-v1-master.patch
>
>
> 2017-09-12 17:44:13,020 INFO [main] mapreduce.Job: Task Id :
> attempt_1505170797673_0010_m_000000_0, Status : FAILED
> Error: java.io.IOException: java.lang.reflect.InvocationTargetException
> at
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:221)
> at
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:114)
> at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:311)
> at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:264)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:219)
> ... 11 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/commons/lang3/ArrayUtils
> at org.apache.hadoop.hbase.HConstants.<clinit>(HConstants.java:1144)
> at
> org.apache.hadoop.hbase.client.ConnectionUtils.getPauseTime(ConnectionUtils.java:84)
> at
> org.apache.hadoop.hbase.client.AsyncProcess.<init>(AsyncProcess.java:209)
> at
> org.apache.hadoop.hbase.client.ConnectionImplementation.<init>(ConnectionImplementation.java:266)
> ... 16 more
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
