that's part of our mapreduce support. for it, you currently need to use the hbase-shaded-server artifact.
On Thu, Jul 21, 2016 at 1:23 PM, Saurabh Malviya (samalviy) <[email protected]> wrote: > With Shaded client it is not able to find below class > > import org.apache.hadoop.hbase.mapred.TableOutputFormat > > > -----Original Message----- > From: Sean Busbey [mailto:[email protected]] > Sent: Wednesday, July 20, 2016 12:00 PM > To: user <[email protected]> > Subject: Re: Hbase Es -Quava lib conflict > > why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and > o.a.hbase:hbase-common? If you have those, then the shaded client won't do > you any good. You should only need the hbase-shaded-client artifact. > > There hasn't been a CDH release with a functioning shaded client yet. > AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version > is the cluster you are trying to work with? > > On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) > <[email protected]> wrote: >> This is my sbt looks like >> >> val hbaseVersion = "1.0.0-cdh5.5.0" >> >> "org.apache.hbase" % "hbase" % hbaseVersion, >> "org.apache.hbase" % "hbase-server" % hbaseVersion, >> "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded >> client as well not working (Used all version upto 1.2.1) >> "org.apache.hbase" % "hbase-common" % hbaseVersion, >> "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile", >> "org.elasticsearch" % "elasticsearch" % "2.3.3", >> "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove >> this elastic search will not work. >> >> >> -----Original Message----- >> From: Sean Busbey [mailto:[email protected]] >> Sent: Wednesday, July 20, 2016 10:25 AM >> To: user <[email protected]> >> Subject: Re: Hbase Es -Quava lib conflict >> >> how are you making use of hbase shaded client? that module should remove >> this issue entirely. >> >> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) >> <[email protected]> wrote: >>> Hi, >>> >>> I am addressing one issue to make Hbase and ES work together in same >>> spark project >>> >>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H >>> B >>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505 >>> >>> If anyone have any pointer let me know, Even Hbase-shaded-client does not >>> help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" >>> It will works but Elastic search failed in that case. >>> >>> Exception in thread "main" java.lang.IllegalAccessError: tried to access >>> method com.google.common.base.Stopwatch.<init>()V from class >>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator >>> at >>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596) >>> at >>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580) >>> at >>> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559) >>> at >>> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155) >>> at >>> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370) >>> at >>> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321) >>> at >>> org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206) >>> at >>> org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183) >>> at >>> org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425) >>> at >>> org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018) >>> at >>> common.TaskTracker$.updateStatus(TaskTracker.scala:55) >>> >>> >> >> >> >> -- >> busbey > > > > -- > busbey -- busbey
