Re: Questions about HBase replication

2013-05-20 Thread Varun Sharma
Hi Lars, Thanks for the response. Regarding #2 again, so if RS1 failed, then the following happens... 1) RS2 takes over its logs... 2) Master renames the log containing directory to have a -splitting in the path 3) Does RS2 already know about the -splitting path ? Also on a related note, was

Re: Scanner returning keys out of order

2013-05-20 Thread Jan Lukavský
Hi JM, thanks for reply, we will upgrade and check if the problem goes away. Cheers, Jan On 17.5.2013 15:44, Jean-Marc Spaggiari wrote: Hi Jan, 0.90.6 is a very old version of HBase... Will you have a chance to migrate to a more recent one? Most of your issues might probably be already

Re: Secure HBase upon Replication

2013-05-20 Thread Asaf Mesika
Just pinging the question, in case anyone missed it... (No answers were found in the resources I've searched for, so before diving into the code...) Thanks! On Fri, May 10, 2013 at 12:50 AM, Asaf Mesika asaf.mes...@gmail.com wrote: Thank you for the detailed answer. Regarding my 1st question

Re: [ANNOUNCE] Phoenix 1.2 is now available

2013-05-20 Thread Azuryy Yu
why off-list? it would be better share here. --Send from my Sony mobile. On May 18, 2013 12:14 AM, James Taylor jtay...@salesforce.com wrote: Anil, Yes, everything is in the Phoenix GitHub repo. Will give you more detail of specific packages and classes off-list. Thanks, James On

What is in BlockCache?

2013-05-20 Thread yun peng
Hi, All, I am wondering what is exactly stored in BlockCache: Is it the same raw blocks as in HFile? or does HBase merge several raw blocks and store the merged block in cache to serve future queries? To be more specific, when a get operation entails loading of block b1 from hfile f1, and of

Re: What is in BlockCache?

2013-05-20 Thread Anoop John
So in BlockCache, does HBase store b1 and b2 separately, or store the merged form? store b1 and b2 separately.. Stores the blocks read from HFiles. -Anoop- On Mon, May 20, 2013 at 5:37 PM, yun peng pengyunm...@gmail.com wrote: Hi, All, I am wondering what is exactly stored in BlockCache: Is

Re: [ANNOUNCE] Phoenix 1.2 is now available

2013-05-20 Thread James Taylor
Our coprocessors are all in com.salesforce.phoenix.coprocessor. The particular one that handles TopN is ScanRegionObserver. The expression evaluation classes are in com.salesforce.phoenix.expression, with a base interface of Expression. The type system is in com.salesforce.phoenix.schema. Take a

RE: NullPointerException while loading large amount of new rows into HBase, exception is thrown when trying to obtain lock for RowKey

2013-05-20 Thread Tianying Chang
Thanks Ram, will try that. Thanks Tian-Ying From: ramkrishna vasudevan [ramkrishna.s.vasude...@gmail.com] Sent: Thursday, May 16, 2013 8:49 PM To: user@hbase.apache.org Subject: Re: NullPointerException while loading large amount of new rows into HBase,

FW: HBase table not getting accessed

2013-05-20 Thread Kumar, Deepak8
Could you please assist. Regards, Deepak From: Kumar, Deepak8 [CCC-OT_IT NE] Sent: Monday, May 20, 2013 10:35 AM To: 'cdh-u...@cloudera.org' Cc: Kumar, Deepak8 [CCC-OT_IT NE] Subject: HBase table not getting accessed HI, I get the following error at hbase master. It seems the regionserver

Re: FW: HBase table not getting accessed

2013-05-20 Thread Ted Yu
Can you give us the HBase version number ? On Mon, May 20, 2013 at 11:36 AM, Kumar, Deepak8 deepak8.ku...@citi.comwrote: Could you please assist. Regards, Deepak From: Kumar, Deepak8 [CCC-OT_IT NE] Sent: Monday, May 20, 2013 10:35 AM To: 'cdh-u...@cloudera.org' Cc: Kumar, Deepak8

RE: FW: HBase table not getting accessed

2013-05-20 Thread Kumar, Deepak8
Hi, The hbase version is 0.92. All the tables are getting accessed except few which lies in vm-7d85-546b region server. hbase shell 13/05/20 15:05:54 WARN conf.Configuration: hadoop.native.lib is deprecated. Instead, use io.native.lib.available HBase Shell; enter 'helpRETURN' for list of

Replication during a disaster recovery situations

2013-05-20 Thread N Dm
Dear folks, I am learning how to take care the disaster recovery situation using Master-Slave replication. Assuming T1:CF1 is the table:colfamily replicated. In the case Master cluster is down(i.e HBASE is down), there are a couple minutes of delta between Master and Slave. From some of the

Re: Questions about HBase replication

2013-05-20 Thread Varun Sharma
Thanks JD for the response... I was just wondering if issues have ever been seen with regards to moving over a large number of WAL(s) entirely from one region server to another since that would double the replication related load on the one server which takes over. Another side question: After

Re: Questions about HBase replication

2013-05-20 Thread Jean-Daniel Cryans
On Mon, May 20, 2013 at 3:48 PM, Varun Sharma va...@pinterest.com wrote: Thanks JD for the response... I was just wondering if issues have ever been seen with regards to moving over a large number of WAL(s) entirely from one region server to another since that would double the replication

Re: Questions about HBase replication

2013-05-20 Thread Varun Sharma
On Mon, May 20, 2013 at 3:54 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: On Mon, May 20, 2013 at 3:48 PM, Varun Sharma va...@pinterest.com wrote: Thanks JD for the response... I was just wondering if issues have ever been seen with regards to moving over a large number of WAL(s)

Re: Questions about HBase replication

2013-05-20 Thread Jean-Daniel Cryans
Yes, but the region server now has 2X the number of WAL(s) to replicate and could suffer higher replication lag as a result... In my experience this hasn't been an issue. Keep in mind that the RS will only replicate what's in the queue when it was recovered and nothing more. It means you have

Re: Questions about HBase replication

2013-05-20 Thread Varun Sharma
So, we have a separate thread doing the recovered logs. That is good to know. I was mostly concerned about any potential races b/w the master renaming the log files, doing the distributed log split and doing a lease recovery over the final file when the DN also dies. Apart from that, it seemed to