Re: Internals of HBase shell to connect with a secure HBase cluster

2013-09-04 Thread anil gupta
Thanks, Andrew. On Tue, Sep 3, 2013 at 1:33 PM, Andrew Purtell apurt...@apache.org wrote: You will also need the below site properties for the HBase client / shell. They toggle on secure UGI and select the correct RPC engine. property namehbase.security.authentication/name

RE: java.lang.NegativeArraySizeException: -1 in hbase

2013-09-04 Thread Job Thomas
I am using Hbase 0.94.9 Best Regards, Job M Thomas From: Job Thomas [mailto:j...@suntecgroup.com] Sent: Wed 9/4/2013 11:08 AM To: user@hbase.apache.org Subject: java.lang.NegativeArraySizeException: -1 in hbase Hi All, I am getting the following

Re: Too many Compaction Complete messages

2013-09-04 Thread Frank Chow
Hi Tom, Below parameters may help to reduce the compaction number: property namehbase.hstore.compactionThreshold/name value3/value description If more than this number of HStoreFiles in any one HStore (one HStoreFile is written per flush of memstore) then a compaction is

Re: Check if a region is compacting or not

2013-09-04 Thread Frank Chow
Search the reagion name in regionserver logs, if there are starting compaction messages but no matched finishing messages, the region is compacting. Frank Chow From: Sandeep L Date: 2013-09-04 13:32 To: user@hbase.apache.org Subject: Check if a region is compacting or not Hi, I would like

Re: Too many Compaction Complete messages

2013-09-04 Thread Tom Brown
Is it normal to receive 3-5 distinct Compaction Complete statuses for the same region each second? For any individual region, it continuously generates Compacting d in {theregion}... Compaction Complete statuses for minutes or hours. In that status message, what is d? --Tom On Wed, Sep 4, 2013

Re: Too many Compaction Complete messages

2013-09-04 Thread Jimmy Xiang
Here d should be the column family being compacted. Do you have 3-5 column families of the same region being compacted? On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown tombrow...@gmail.com wrote: Is it normal to receive 3-5 distinct Compaction Complete statuses for the same region each second? For

Re: HBase - stable versions

2013-09-04 Thread lars hofhansl
I should also explicitly state that we (Salesforce) will stay with 0.94 for the foreseeable future. We will continue backport fixes that we need. If those are not acceptable or accepted into the open source 0.94 branch, they will have to go into an Salesforce internal repository. I would

Re: HBase - stable versions

2013-09-04 Thread Nicolas Liochon
It's open source. My personal point of view is that if someone is willing to spend time on the backport, there should be no issue, if the regression risk is clearly acceptable the rolling restart possible. If it's necessary (i.e. there is no agreement of the risk level), then we could as well go

Re: Too many Compaction Complete messages

2013-09-04 Thread Tom Brown
No, just one column family (called d, not surprisingly). --Tom On Wed, Sep 4, 2013 at 9:54 AM, Jimmy Xiang jxi...@cloudera.com wrote: Here d should be the column family being compacted. Do you have 3-5 column families of the same region being compacted? On Wed, Sep 4, 2013 at 8:36 AM, Tom

Re: HBase - stable versions

2013-09-04 Thread James Taylor
+1 to what Nicolas said. That goes for Phoenix as well. It's open source too. We do plan to port to 0.96 when our user community (Salesforce.com, of course, being one of them) demands it. Thanks, James On Wed, Sep 4, 2013 at 10:11 AM, Nicolas Liochon nkey...@gmail.com wrote: It's open

Re: HBase - stable versions

2013-09-04 Thread Shahab Yunus
This maybe a newbie or dumb question but I believe, this does not affect or apply to HBase distributions by other vendors like HortonWorks or Cloudera. If someone is using one of the versions of distributions provided by them then it is up to them (and not people and community here) what and till

Re: HBase - stable versions

2013-09-04 Thread Doug Meil
It's a very good point. Most people will go to 0.96 when CDH and Hortonworks support it. On 9/4/13 2:55 PM, Shahab Yunus shahab.yu...@gmail.com wrote: This maybe a newbie or dumb question but I believe, this does not affect or apply to HBase distributions by other vendors like HortonWorks

Re: HBase - stable versions

2013-09-04 Thread Andrew Purtell
If LarsH is willing to stay on as RM for 0.94 then IMHO we should proceed as today with the exception that 0.96 is what the stable symlink points to. As long as 0.94 has someone willing to RM and users such as Salesforce then there will be individuals there and in the community motivated to keep

Re: (HBASE-5261)HBase 0.94 cerification for JDK7

2013-09-04 Thread Stack
Anil: You having GC'ing issues Anil? You hitting Full GCs pretty regularly? (Setting up a jenkins build as Lars suggests or having us add a note to the website somewhere saying 0.94 runs on jdk7 -- presuming it passes a couple of jenkins builds -- would be no problem... just say what you need).

Re: HBase - stable versions

2013-09-04 Thread Varun Sharma
We, at Pinterest, are also going to stay on 0.94 for a while since it has worked well for us and we don't have the resources to test 0.96 in the EC2 environment. That may change in the future but we don't know when... On Wed, Sep 4, 2013 at 1:53 PM, Andrew Purtell apurt...@apache.org wrote: If

Re: HBase - stable versions

2013-09-04 Thread Enis Söztutar
As long as there is interest for 0.94, we will care for 0.94. However, when 0.96.0 comes out, it will be marked as the next stable release, so I expect that we would promote newcomers that branch. Any committer can propose any branch and release candidate any time, so if there are road blocks for

Re: (HBASE-5261)HBase 0.94 cerification for JDK7

2013-09-04 Thread anil gupta
@Stack: Inline On Wed, Sep 4, 2013 at 2:32 PM, Stack st...@duboce.net wrote: Anil: You having GC'ing issues Anil? You hitting Full GCs pretty regularly? While testing my cluster, i did a full table scan on a table having 600 million records(at that time very few writes were going on). I was

Re: (HBASE-5261)HBase 0.94 cerification for JDK7

2013-09-04 Thread anil gupta
@Andrew: Inline On Wed, Sep 4, 2013 at 2:14 PM, Andrew Purtell apurt...@apache.org wrote: I've been testing high loads with HBase 0.94 and JDK 7 for a while, .17 and .25, with no observed issues. This is on the EC2 HVM instance types. On running with large heaps, your mileage will vary

Suggestion need on desinging Flatten table for HBase given scenario

2013-09-04 Thread Ramasubramanian Narayanan
Dear All, For the below 1 to many relationship column sets, require suggestion on how to design a Flatten HBase table... Kindly refer the attached image for the scenario... Pls let me know if my scenario is not clearly explained... regards, Rams

Re: Performance analysis in Hbase

2013-09-04 Thread Vimal Jain
Just to add more information , i got following link which explains metrics related to RS. http://hbase.apache.org/book.html#rs_metrics Is there any resource which explains these metrics in detail ,( in official guide , there is just one line for each metric) . On Thu, Sep 5, 2013 at 10:06 AM,