Hello,
some questions about the hbase/hive integration:
I am running a cloudera hadoop/hbase cluster. I want to get access with hive to
hbase tables.
This actually works fine with cli like
sudo -u hdfs hive --auxpath
/usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar,/usr/lib/hive/lib/hbase-0.90.1-cdh3u0.jar,/usr/lib/hive/lib/zookeeper-3.3.1.jar
The zookeeper quorum is defined in the hife-site.xml.
If I run it without the jars config like
sudo -u hdfs
or in standalone mode with
sudo -u hdfs hive --auxpath
/usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar,/usr/lib/hive/lib/hbase-0.90.1-cdh3u0.jar,/usr/lib/hive/lib/zookeeper-3.3.1.jar
--service hiveserver
for (map/reduced) queries I do get
java.io.FileNotFoundException: File does not exist:
/usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:546)
at
org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
at
org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:804)
at
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:746)
at
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:637)
at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:848)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
Seems hive is not very interested my hive-site.xml property:
<property>
<name>hive.aux.jars.path</name>
<value>/usr/lib/hive/lib/hive-hbase-handler-0.7.0-cdh3u0.jar,/usr/lib/hive/lib/hbase-0.90.1-cdh3u0.jar,/usr/lib/hive/lib/zookeeper-3.3.1.jar</value>
</property>
I already tried different configs like file:///... or file:///${HIVE_HOME}.
Any clues?
Thanks in advance
labtrax
--
Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir
belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de
