Re: reading Hbase table in Spark

Hi Asher, As mentioned before Spark 2 does not work with Phoenix. However, you can use Spark 2 on top of Phoenix directly. Does that answer your point? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: reading Hbase table in Spark

Hi Mich, can you describe the detail about used phoenix read/write hbase table in spark for RDD's process. thx -- View this message in context: http://apache-hbase.679495.n3.nabble.com/reading-Hbase-table-in-Spark-tp4083260p4084996.html Sent from the HBase User mailing list archive at

Re: reading Hbase table in Spark

I have already done it with Hive and Phoenix thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com

Re: reading Hbase table in Spark

In that case I suggest polling user@hive to see if someone has done this. Thanks On Mon, Oct 10, 2016 at 2:56 PM, Mich Talebzadeh wrote: > Thanks I am on Spark 2 so may not be feasible. > > As a mater of interest how about using Hive on top of Hbase table? > > Dr

Re: reading Hbase table in Spark

Thanks I am on Spark 2 so may not be feasible. As a mater of interest how about using Hive on top of Hbase table? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: reading Hbase table in Spark

In hbase master branch, there is hbase-spark module which would allow you to integrate with Spark seamlessly. Note: support for Spark 2.0 is pending. For details, see HBASE-16179 Cheers On Mon, Oct 10, 2016 at 2:46 PM, Mich Talebzadeh wrote: > Thanks Ted, > > So

Re: reading Hbase table in Spark

Thanks Ted, So basically involves Java programming much like JDBC connection retrieval etc. Writing to Hbase is pretty fast. Now I have both views in Phoenix and Hive on the underlying Hbase tables. I am looking for flexibility here so I get I should use Spark on Hive tables with a view on

Re: reading Hbase table in Spark

For org.apache.hadoop.hbase.client.Result, there is this method: public byte[] getValue(byte [] family, byte [] qualifier) { which allows you to retrieve value for designated column. FYI On Mon, Oct 10, 2016 at 2:08 PM, Mich Talebzadeh wrote: > Hi, > > I am