Using HBase data

Hi, I am starting to think of a new project using Hadoop and Hbase as my persistent store. But I am quite confused as to how to use these HBASE data. 1. Can these HBASE data be used in web applications. Meaning retrieving the data and showing it on the web page. Can somebody please suggest how

Aw: Re: replication verifyrep

Hi Jean-Daniel, thank you for your answer and bring some light into the darkness. You can see the bad rows listed in the user logs for your MR job. What log do you mean. The output from the command line? I only see the count of GOOD or BAD rows. Are the bad rows listed in that log which are

Weird behavior splitting regions

I have a table in Hbase that sizes around 96Gb, I generate 4 regions of 30Gb. Some time, table starts to split because the max size for region is 1Gb (I just realize of that, I'm going to change it or create more pre-splits.). There're two things that I don't understand. how is it creating the

Re: Weird behavior splitting regions

There're some new regions that they're just a some KBytes!. Why they are so small?? When does HBase decide to split? because it started to split two hours later to create the table. When hbase does a split, it doesn't actually split at the disk/file level. Its just a metadata operation which

Re: Weird behavior splitting regions

The default split policy in hbase0.94.x is IncreaseToUpperBound rather than ConstantSizeSplitPolicy which was the default in the older versions of hbase. Please refer to the link given below to understand how a IncreaseToUpperBoundSplitPolicy works:

Re: Using HBase data

Please take a look at https://m.facebook.com/UsingHbase?id=191660807562816refsrc=https%3A%2F%2Fwww.facebook.com%2FUsingHbase On Apr 14, 2014, at 11:20 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, I am starting to think of a new project using Hadoop and Hbase as my persistent

Re: Weird behavior splitting regions

I read the article, that's why I typed the question, because I didn't understand the result I got. Oh, yes!!, that's true, so silly. I think some of the files are pretty small because the table has two families and one of them is much smaller than the another one. So, it has been splitted many

All regions stay on two nodes out of 18 nodes

I am using HDP 2.0.6, which has 18 nodes(region servers). One of my HBase tables has 50 regions but I found that the 50 regions all stay in just two nodes, not spread evenly in the 18 nodes. I did not pre-create splits so this table was gradually split into 50 regions itself. I'd like to know why

Re: All regions stay on two nodes out of 18 nodes

Check if hbase balancer is on. $hbase_shell balance_switch true Run the balancer from the hbase shell $hbase_shell balancer If the above command returns false check for any regions in transition on the HMaster UI or check HMaster logs. Thanks Divye Sheth On Tue, Apr 15, 2014 at 5:10 PM, Tao

Re: All regions stay on two nodes out of 18 nodes

Is load balancer enabled ? Can you grep this table in master log and pastebin what you found ? Cheers On Apr 15, 2014, at 4:40 AM, Tao Xiao xiaotao.cs@gmail.com wrote: I am using HDP 2.0.6, which has 18 nodes(region servers). One of my HBase tables has 50 regions but I found that the 50

Re: hbase exception: Could not reseek StoreFileScanner

bq. HFileScanner for reader reader=hdfs:// 192.168.11.150:8020/hbase/vc2.in_link/6http://192.168.11.150:8020/hbase/vc2.in_link/6b879cb43205cdae084a280c38fab34a/cf/4dc235709de44f53b2484d2903f1bb75

Re: Re: replication verifyrep

On Tue, Apr 15, 2014 at 12:17 AM, Hansi Klose hansi.kl...@web.de wrote: Hi Jean-Daniel, thank you for your answer and bring some light into the darkness. You're welcome! You can see the bad rows listed in the user logs for your MR job. What log do you mean. The output from the command

RE: endpoint coprocessor

Thanks Yu. I have added below coprocessor to my table. And tried to invoke coprocessor using java client. But fails with below error. But I could see coprocessor in describe table output. Caused by:

Re: HBase atomic append functionality (not just client)

Hmm... Wouldn't mvcc prevent seeing partial append? Append is just put in the end, the way it is currently implemented. On Mon, Apr 14, 2014 at 10:41 AM, Vladimir Rodionov vrodio...@carrieriq.com wrote: From HRegion.java: Appends performed are done under row lock but reads do not take locks

Re: All regions stay on two nodes out of 18 nodes

The command balance_switch true returns true, but the command balancer returns false. I checked the HMaster UI and found some regions of other tables in transition, not of this table. This table's name is E_MP_DAY_READ, I did grep it in the master log and found only the following lines: