HBase rest service did not respond in a secure cluster

2016-10-10 Thread kumar r
Hi, HBase Version 1.1.5 OS - Windows I have enabled HBase rest service with SSL and Proxy. When accessing HBase rest url, https://machine1:8082/ it returns nothing and keep on loading. hbase.rest.keytab.file thrift.keytab

Re: Coprocessor exception in ResionServer log

2016-10-10 Thread Ted Yu
Can you outline the steps taken in hbase shell ? If you can show skeleton of your endpoint, that may help as well. Lastly, consider upgrading :-) Cheers > On Oct 10, 2016, at 8:54 PM, big data wrote: > > I use the static load method, it seems ok... > > why it can

Re: Coprocessor exception in ResionServer log

2016-10-10 Thread big data
I use the static load method, it seems ok... why it can not running in dynamic load method? 在 16/10/11 上午10:18, big data 写道: > No, it is the original log from hbase, no missing. > > I'll try it through hbase-site.xml. > > thanks > > > > 在 16/10/11 上午10:05, Ted Yu 写道: >> bq. have different

Re: Coprocessor exception in ResionServer log

2016-10-10 Thread big data
No, it is the original log from hbase, no missing. I'll try it through hbase-site.xml. thanks 在 16/10/11 上午10:05, Ted Yu 写道: > bq. have different Class objects for the type otobuf/Service > > Was the above copied verbatim ? > > I wonder why protobuf was cut off. > > If you deploy through

Re: Coprocessor exception in ResionServer log

2016-10-10 Thread Ted Yu
bq. have different Class objects for the type otobuf/Service Was the above copied verbatim ? I wonder why protobuf was cut off. If you deploy through hbase.coprocessor.region.classes in hbase-site.xml, do you still have the same error ? Cheers On Mon, Oct 10, 2016 at 6:43 PM, big data

Re: Coprocessor exception in ResionServer log

2016-10-10 Thread Ted Yu
Could be related to incompatible protobuf versions. What's the output of: mvn dependency:tree Please pastebin it - it should be fairly long. On Mon, Oct 10, 2016 at 6:29 PM, big data wrote: > Dear all, > > I've created an Endpoint coprocessor, and deployed it through

Coprocessor exception in ResionServer log

2016-10-10 Thread big data
Dear all, I've created an Endpoint coprocessor, and deployed it through hbase shell. Then when I run client code, when code response = rpcCallback.get(); rpcCallback.get() return null; in the resion server log, i found this exception: 2016-10-10 15:50:07,636 ERROR

Re: reading Hbase table in Spark

2016-10-10 Thread Mich Talebzadeh
I have already done it with Hive and Phoenix thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com

Re: reading Hbase table in Spark

2016-10-10 Thread Ted Yu
In that case I suggest polling user@hive to see if someone has done this. Thanks On Mon, Oct 10, 2016 at 2:56 PM, Mich Talebzadeh wrote: > Thanks I am on Spark 2 so may not be feasible. > > As a mater of interest how about using Hive on top of Hbase table? > > Dr

Re: reading Hbase table in Spark

2016-10-10 Thread Mich Talebzadeh
Thanks I am on Spark 2 so may not be feasible. As a mater of interest how about using Hive on top of Hbase table? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: reading Hbase table in Spark

2016-10-10 Thread Ted Yu
In hbase master branch, there is hbase-spark module which would allow you to integrate with Spark seamlessly. Note: support for Spark 2.0 is pending. For details, see HBASE-16179 Cheers On Mon, Oct 10, 2016 at 2:46 PM, Mich Talebzadeh wrote: > Thanks Ted, > > So

Re: reading Hbase table in Spark

2016-10-10 Thread Mich Talebzadeh
Thanks Ted, So basically involves Java programming much like JDBC connection retrieval etc. Writing to Hbase is pretty fast. Now I have both views in Phoenix and Hive on the underlying Hbase tables. I am looking for flexibility here so I get I should use Spark on Hive tables with a view on

Re: reading Hbase table in Spark

2016-10-10 Thread Ted Yu
For org.apache.hadoop.hbase.client.Result, there is this method: public byte[] getValue(byte [] family, byte [] qualifier) { which allows you to retrieve value for designated column. FYI On Mon, Oct 10, 2016 at 2:08 PM, Mich Talebzadeh wrote: > Hi, > > I am

reading Hbase table in Spark

2016-10-10 Thread Mich Talebzadeh
Hi, I am trying to do some operation on an Hbase table that is being populated by Spark Streaming. Now this is just Spark on Hbase as opposed to Spark on Hive -> view on Hbase etc. I also have Phoenix view on this Hbase table. This is sample code scala> val tableName = "marketDataHbase" >

Re: Scan Performance Decreases Over Time

2016-10-10 Thread Ted Yu
Have you taken jstack for the slow scans ? If so, can you pastebin the stack trace ? 1.0.0 is quite old. Any chance of upgrading to 1.2 release ? Cheers > On Oct 10, 2016, at 2:04 AM, 陆巍 wrote: > > Hi All, > > I met with a problem where the scan perfoamance decreases

Scan Performance Decreases Over Time

2016-10-10 Thread 陆巍
Hi All, I met with a problem where the scan perfoamance decreases over time. Hbase connections are kept in a data access service (in tomcat), and there are table scan operations. The scan performance for each scan batch(~10 parallel scan) increases as below: dayavg. cost(ms) 156.213115