With Shaded client it is not able to find below class import org.apache.hadoop.hbase.mapred.TableOutputFormat
-----Original Message----- From: Sean Busbey [mailto:[email protected]] Sent: Wednesday, July 20, 2016 12:00 PM To: user <[email protected]> Subject: Re: Hbase Es -Quava lib conflict why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and o.a.hbase:hbase-common? If you have those, then the shaded client won't do you any good. You should only need the hbase-shaded-client artifact. There hasn't been a CDH release with a functioning shaded client yet. AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version is the cluster you are trying to work with? On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) <[email protected]> wrote: > This is my sbt looks like > > val hbaseVersion = "1.0.0-cdh5.5.0" > > "org.apache.hbase" % "hbase" % hbaseVersion, > "org.apache.hbase" % "hbase-server" % hbaseVersion, > "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client > as well not working (Used all version upto 1.2.1) > "org.apache.hbase" % "hbase-common" % hbaseVersion, > "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile", > "org.elasticsearch" % "elasticsearch" % "2.3.3", > "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove > this elastic search will not work. > > > -----Original Message----- > From: Sean Busbey [mailto:[email protected]] > Sent: Wednesday, July 20, 2016 10:25 AM > To: user <[email protected]> > Subject: Re: Hbase Es -Quava lib conflict > > how are you making use of hbase shaded client? that module should remove this > issue entirely. > > On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) > <[email protected]> wrote: >> Hi, >> >> I am addressing one issue to make Hbase and ES work together in same >> spark project >> >> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H >> B >> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505 >> >> If anyone have any pointer let me know, Even Hbase-shaded-client does not >> help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" >> It will works but Elastic search failed in that case. >> >> Exception in thread "main" java.lang.IllegalAccessError: tried to access >> method com.google.common.base.Stopwatch.<init>()V from class >> org.apache.hadoop.hbase.zookeeper.MetaTableLocator >> at >> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) >> at >> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) >> at >> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) >> at >> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) >> at >> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185) >> at >> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152) >> at >> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126) >> at >> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331) >> at >> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155) >> at >> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370) >> at >> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321) >> at >> org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206) >> at >> org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183) >> at >> org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425) >> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018) >> at >> common.TaskTracker$.updateStatus(TaskTracker.scala:55) >> >> > > > > -- > busbey -- busbey
