Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "Hive/HBaseIntegration" page has been changed by JohnSichi. http://wiki.apache.org/hadoop/Hive/HBaseIntegration?action=diff&rev1=20&rev2=21 -------------------------------------------------- The storage handler is built as an independent module, {{{hive_hbase_handler.jar}}}, which must be available on the Hive - client auxpath, along with HBase and Zookeeper jars. It requires + client auxpath, along with HBase and Zookeeper jars. It also requires - configuration property {{{hbase.master}}} in order to connect to the + the correct configuration property to be set in order to connect to the right HBase master. See [[http://hadoop.apache.org/hbase/docs/current/api/overview-summary.html#overview_description|the HBase documentation]] for how to set up an HBase cluster. - Here's an example using CLI from a source build environment: + Here's an example using CLI from a source build environment, targeting a single-node HBase server: {{{ $HIVE_SRC/build/dist/bin/hive --auxpath $HIVE_SRC/build/hbase-handler/hive_hbase-handler.jar,$HIVE_SRC/hbase-handler/lib/hbase-0.20.3.jar,$HIVE_SRC/hbase-handler/lib/zookeeper-3.2.2.jar -hiveconf hbase.master=hbase.yoyodyne.com:60000 }}} + Here's an example which instead targets a distributed HBase cluster where a quorum of 3 zookeepers is used to elect the HBase master: + + {{{ + $HIVE_SRC/build/dist/bin/hive --auxpath $HIVE_SRC/build/hbase-handler/hive_hbase-handler.jar,$HIVE_SRC/hbase-handler/lib/hbase-0.20.3.jar,$HIVE_SRC/hbase-handler/lib/zookeeper-3.2.2.jar -hiveconf hbase.zookeeper.quorum=zk1.yoyodyne.com,zk2.yoyodyne.com,zk3.yoyodyne.com + }}} + The handler requires Hadoop 0.20 or higher, and has only been tested - with dependency versions hadoop-0.20.0, hbase-0.20.3 and zookeeper-3.2.2. + with dependency versions hadoop-0.20.0, hbase-0.20.3 and zookeeper-3.2.2. If you are not using hbase-0.20.3, you will need to rebuild the handler with the HBase jar matching your version, and change the --auxpath above accordingly. Failure to use matching versions will lead to misleading connection failures such as HMasterNotRunningException since the HBase RPC protocol changes often. In order to create a new HBase table which is to be managed by Hive, use the STORED BY clause on CREATE TABLE:
