hbase-dev to bcc; adding hive-user. this is a question for the user lists, and more for Hive's than HBase, as HBaseStorageHandler is code in Hive project, not HBase.
Hi Sai, You are embarking into a brave world. Because your aim is the interop across these different Apache projects, I highly recommend using a vendor's distribution. The reason being that the vendor has done the work of certifying interoperability for you, so you won't be left finding bugs in the edges that aren't well tested in the communities. Notice in the blog post referenced, I was using a distribution and even then I've found interop issues. Hive 0.11 will require you manually specify the HBase jars. Please don't copy them around, instead use environment variables. You can follow along with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you can use `hbase mapredcp` instead of itemizing jars manually. This requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379 and HIVE-2055. Finally, are you using Hive on the CLI or through a web tool (Hue?). The details change slightly based on all these... details. Good luck. Keep asking questions. Please file bugs. Thanks, Nick On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id4gpa...@gmail.com>wrote: > Hi, > > Here is my document in an attached file. It contains my flow of hive-hbase > integration. > 1. I created a table in mysql and imported into hbase, > 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in > Hadoop-2.2.0/share/mapred/lib folder > 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase > jars to hive > 4. Trying to create a table in hive with hbase properties but gets error as > > > *FAILED: Error in metadata: MetaException(message:java.io.IOException: > java.lang.reflect.InvocationTargetException* > > > I think so hbase-0.96.1.1-hadoop2.jar file is not present in HBase > directory. > > So, Suggest for further step to proceed. > > > On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >> Hi Sai, >> >> If you can show us what specific exception you are seeing, we would be >> able >> to help you out in a better way. >> >> Thanks, >> >> >> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpa...@gmail.com >> >wrote: >> >> > Hi, >> > Thanks for reply... but >> > >> > I worked with hadoop-1.2.1 which is fine working, but need with real >> > requirement is Hadoop-2.2.0 i.e, YARN >> > >> > Please show the way to get solve with apache products >> > >> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed >> > hive-0.11.0 too, >> > >> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar, >> zookeeper.jar >> > >> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and >> worked >> > but not getting connected with hive. I suppose to work with >> hadoop-0.94.x >> > but the version is not compatible with hadoop-2.2.0 >> > >> > I tried in all the way, not found the solution, please suggest me >> > >> > >> > >> > >> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <rekha_jo...@intuit.com >> > >wrote: >> > >> > > Hi, >> > > >> > > We have successfully created external hive table pointing to hbase >> table >> > > with settings for hive, zookeeper, HBase security tokens. >> > > >> > > If it is a jar problem, then mostly the env is not set correctly.Hive >> > > should be able to recognize HBaseStorageHandler. >> > > >> > > Thanks >> > > Rekha >> > > >> > > http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/ >> > > >> > > >> > > >> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id4gpa...@gmail.com> wrote: >> > > >> > > >Hi, >> > > > >> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0 >> version >> > > >for a project. I got a requirement such that i have to integrate >> hbase >> > to >> > > >hive , so that table reflection should happens. >> > > > >> > > >while i am doing this, i got error like TARGET INNOVOCATION >> EXCEPTION. >> > > >This is because jar file target missing. please suggest me to >> overcome >> > the >> > > >problem >> > > > >> > > >-- >> > > >*THANKS & REGARDS,* >> > > >G.SAI PAVAN, >> > > >CCDH4 CERTIFIED, >> > > >Ph: 8121914494, >> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>* >> > > >linkedin profile < >> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/> >> > > >HYDERABAD. >> > > >> > > >> > >> > >> > -- >> > *THANKS & REGARDS,* >> > G.SAI PAVAN, >> > CCDH4 CERTIFIED, >> > Ph: 8121914494, >> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* >> > linkedin profile < >> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/> >> > HYDERABAD. >> > >> >> >> >> -- >> Swarnim >> > > > > -- > *THANKS & REGARDS,* > G.SAI PAVAN, > CCDH4 CERTIFIED, > Ph: 8121914494, > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>* > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/> > HYDERABAD. >
