Re: Hive UDF for creating row key in HBASE

2017-12-18 Thread James Taylor
Hi Chethan, As Ethan mentioned, take a look first at the Phoenix/Hive integration. If that doesn't work for you, the best way to get the row key for a phoenix table is to execute an UPSERT VALUES against the primary key columns without committing it. We have a utility function that will return the

Re: Hive UDF for creating row key in HBASE

2017-12-17 Thread Ethan
Hi Chethan, When you write data from HDFS, are you planning to use hive to do the ETL? Can we do something like reading from HDFS and use Phoenix to write into to HBASE? There is https://phoenix.apache.org/hive_storage_handler.html, I think is enabling Hive to read from phoenix table, not the

Hive UDF for creating row key in HBASE

2017-12-16 Thread Chethan Bhawarlal
Hi Dev, Currently I am planning to write data from HDFS to HBASE. And to read data I am using Phoenix. Phoenix is converting its primary keys separated by bytes("\x00") and storing it in HBASE as row key. I want to write a custom UDF in hive to create ROW KEY value of HBASE such that Phoenix