Re: Multiwal performance with HBase 1.x

Hi Vlad, >> the existing write performance is more than adequate (avg load per RS usually less than 1MB/sec) We have some different user scenarios and I'd like to share with you. We are using hbase to store data for building search index, and features like pv/uv of each online item will be

HBase Spark Streaming issue

Hi, I m seeing some strange error while inserting data from spark streaming to hbase. I can able to write the data from spark (without streaming) to hbase successfully, but when i use the same code to write dstream I m seeing the below error. I tried setting the below parameters, still didnt

Re: HBase Spark Streaming issue

Looks like you encountered the same problem described in this thread: http://search-hadoop.com/m/q3RTts2s4o5KaWK1 FYI On Mon, Sep 21, 2015 at 3:55 PM, Siva wrote: > Hi Ted, > > Generated of jar file from the same code and submitted to spark-submit in > yarn-cluster mode.

Re: HBase Spark Streaming issue

Dropping dev@ Looks like another version of hbase artifact was in the classpath. Can you double check ? Thanks > On Sep 21, 2015, at 12:45 AM, Siva wrote: > > Hi, > > I m seeing some strange error while inserting data from spark streaming to > hbase. > > I can able to

Re: HBase Spark Streaming issue

Hi Ted, Generated of jar file from the same code and submitted to spark-submit in yarn-cluster mode. It went through fine, and I see kafka data in hbase. Not sure what is the exact issue with spark-shell. Here is the spark-submit. spark-submit --class TestHbaseSpark --deploy-mode cluster

Re: HLog's AsyncHLogWriter aborted abruptly

On Mon, Sep 21, 2015 at 5:58 PM, Shrijeet wrote: > HBase Version: 0.94.26 > HDFS version: 2.5.x > > We backported HBASE-8755 onto 0.94.27 Have you put much work into it? If you went to HBASE-10156, write throughput is better again and you'd be on same system as

HLog's AsyncHLogWriter aborted abruptly

HBase Version: 0.94.26 HDFS version: 2.5.x We backported HBASE-8755 onto 0.94.27 and seeing a corner case that I wish to run by the list. In one of the write heavy use cases we noticed region server hanging forever (all server handlers busy on HLog.sync plus few other odd things). From logs we

Thinking of HBase 1.1.3 [was HBASE-14317 and 1.1.3]

Hi folks, It's that time again, I'm looking at spinning 1.1.3 bit this week, with hopes that we can get a release out in early October. The only issue I'm actively tracking as a must for this release is HBASE-14374, the back port for HBASE-14317. Is there anything else you're planning to get in

Re: Multiwal performance with HBase 1.x

@Ted, Sure, I've opened HBASE-14457 as an umbrella for all works done on multiwal and please allow me to give a more detailed sharing there, in format of documents rather than emails. :-) @Jingcheng and @Vlad, any comments/sharing from you will

Re: Multiwal performance with HBase 1.x

Thanks for sharing, Yu. Images didn't go through. Can you use third party site for sharing ? Cheers > On Sep 20, 2015, at 11:09 PM, Yu Li wrote: > > Hi Vlad, > > >> the existing write performance is more than adequate (avg load per RS > >> usually less than 1MB/sec) > We

Re: HBase Spark Streaming issue

bq. spark-hbase-0.0.3-clabs-20150225.184251-1.jar The above jar is yours, right ? Can you check its contents ? Thanks On Mon, Sep 21, 2015 at 11:40 AM, Siva wrote: > Hi Ted, > > Thanks for your response. I verified all the jars in class path. all of > them on 2.2.4.2-2.

Re: HBase Spark Streaming issue

I tried running removing that jar as well, still the same issue. That jar contains the connector to Hbase from spark developed by cloudera. Thanks On Mon, Sep 21, 2015 at 11:56 AM, Ted Yu wrote: > bq. spark-hbase-0.0.3-clabs-20150225.184251-1.jar > > The above jar is

Hbase shell reports 2 live servers

Hello, I currently have a cluster up and running (Name-node, Secondary name-node and 6 Data-nodes). I just recently learned about the "status" command in Hbase Shell. When I run the "status simple" command, I was surprised to see that it reported there being 2 live servers (datanode3 and

Re: Hbase shell reports 2 live servers

Did you start region servers on all the datanodes ? If so, please check on the nodes where region server was not reported being alive. Cheers On Mon, Sep 21, 2015 at 2:22 PM, Christopher Chase wrote: > Hello, > > I currently have a cluster up and running (Name-node,