Re: HBase: Paralel Query

2013-11-26 Thread Ted Yu
bq. I didn't enabled blockcache What if you enable blockcache ? Cheers On Tue, Nov 26, 2013 at 8:45 PM, Job Thomas wrote: > Hello lars, > > Here re the answers , > > -> I have only one region server. ( I am testing Hbase via phoenix with > Hbase in a single server). > -> All queries are fired

Re: Suddenly NameNode stopped responding

2013-11-26 Thread Azuryy Yu
I don't think there is HA because Sandeep using Hadoop-1.0.2. @Sandeep, did you check GC logs? On Wed, Nov 27, 2013 at 1:26 PM, Bharath Vissapragada wrote: > It is difficult to guess the reason behind this outage without the logs. > Can we have a look at them? (pastebin). Did you configure HA

Re: Suddenly NameNode stopped responding

2013-11-26 Thread Bharath Vissapragada
It is difficult to guess the reason behind this outage without the logs. Can we have a look at them? (pastebin). Did you configure HA for namenode? Did it failover to standby? On Wed, Nov 27, 2013 at 10:29 AM, Sandeep L wrote: > Hi, > Couple of hours back all of sudden NameNode of our production

Suddenly NameNode stopped responding

2013-11-26 Thread Sandeep L
Hi, Couple of hours back all of sudden NameNode of our production cluster got stopped responding, due to this our HBase also stopped responding(as expected). Here mysterious thing is we unable to get any reason for NameNode interruption. I went through all log files of NameNode and I couldn't find

RE: HBase: Paralel Query

2013-11-26 Thread Job Thomas
Hello lars, Here re the answers , -> I have only one region server. ( I am testing Hbase via phoenix with Hbase in a single server). -> All queries are fired through Phoenix only.( select Lastname from tablename where Id=? ( Here Id is the primary key)) -> hbase.regionserver.handler.count=30(

Re: Too Many CLOSE_WAIT make performance down

2013-11-26 Thread whxiyi100829
Hi, did you resolve the problem? I encounter the same problem as you. -- View this message in context: http://apache-hbase.679495.n3.nabble.com/Too-Many-CLOSE-WAIT-make-performance-down-tp4048930p4053136.html Sent from the HBase User mailing list archive at Nabble.com.

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread lars hofhansl
Oops. Disregard my other reply then, you figured it out yourself. From: Vineet Mishra To: user@hbase.apache.org Sent: Tuesday, November 26, 2013 6:10 AM Subject: Re: Hbase Filter for RDBMS IN and AND query operation Yes, Applying Filter List with Pass ALL

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread lars hofhansl
ValueFilter would filter on the value of any qualifier and SingleColumnValueFilter can filter on a specific column. You can combine the two with a FilterList with MUST_PASS_ALL. I agree with JM, though, that you should give Phoenix a try. -- Lars From: Vineet

Re: HBase: Paralel Query

2013-11-26 Thread lars hofhansl
Hi Job, first off some questions :) How many regions are you accessing? What type of query is this (get or scan)? How many handlers have you configured? What does you hardware look like (how many cores, etc)? Is the data all in the blockcache? If not, what does the disk IO look like? Are the clien

Re: Upgrading HBase 0.94.X

2013-11-26 Thread Ted Yu
Take a look at bin/rolling-restart.sh where you will see various options. bq. i would like to keep current (.7) folder and move my installation to .13 folder You mean installation folder where HBase binaries are expanded ? You can use separate folders for .7 and .13. On Tue, Nov 26, 2013 at 11:

Upgrading HBase 0.94.X

2013-11-26 Thread Federico Gaule
Hi everyone, I have in mind upgrading my productive cluster from 0.94.7 to 0.94.13. Rolling upgrade is recommended (http://hbase.apache.org/upgrading.html) . What is the step by step for that? I couldn't find it anywhere. In case i would like to keep current (.7) folder and move my installation to

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread Vineet Mishra
Yes, Applying Filter List with Pass ALL containing two filters for name and flag and iteratively adding it(previous filter list) to another filter list with (Pass One). On Tue, Nov 26, 2013 at 7:27 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Hi vineet, > > So how have you solve

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread Jean-Marc Spaggiari
Hi vineet, So how have you solved that finally? Using filters? JM 2013/11/26 Vineet Mishra > Thanks Marc, > > I got it working! > > > On Tue, Nov 26, 2013 at 6:49 PM, Jean-Marc Spaggiari < > jean-m...@spaggiari.org> wrote: > > > Hum. > > > > Phoenix guys will most probably reply that Phoenix

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread Vineet Mishra
Thanks Marc, I got it working! On Tue, Nov 26, 2013 at 6:49 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Hum. > > Phoenix guys will most probably reply that Phoenix is the solution for that > ;) And I will probably agree with them. > > I don't see any filter which can do that wit

Re: Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread Jean-Marc Spaggiari
Hum. Phoenix guys will most probably reply that Phoenix is the solution for that ;) And I will probably agree with them. I don't see any filter which can do that within a single call. One option I will apply in your case is to do a scan+filter on the flag=1 value then do a get name based on the

Hbase Filter for RDBMS IN and AND query operation

2013-11-26 Thread Vineet Mishra
Hi All, I want to fetch some rows from a table where the value for the Qualifier(say name) is any of ("joseph" ,"sandy", "lar" ) and another Qualifier(say flag) should always be 1. I am making multi SingleColumnValueFilter scan on a Table with Compare Operator to Equal and those list of values fo

Re: Bulk load fails to identify pre-split regions

2013-11-26 Thread Amit Sela
So far no issues after running in production for over a week now. I didn't commit any patches to the JIRA I opened because I have more changes in Algorithm on my environment (the other change I have is another bug fix that is related to GZ configuration and was fixed in later versions - I'm runnin

Re: HBase: Paralel Query

2013-11-26 Thread Asaf Mesika
The need is too broad. You need to do through the HBase jmx metrics, ands machine metrics to see what is your bottleneck. On Tuesday, November 26, 2013, Job Thomas wrote: > > > Hi All, > > How can we configure Hbase inorder to perform multythreading/parallel > query faster . > > These are some

Re: How to improve the write performance?

2013-11-26 Thread Asaf Mesika
How many client threads? On Tuesday, November 26, 2013, jingych wrote: > Hi, All! > > Recently, I just test the Client write performance with HBase Java API. > > I think the performance X-factor is : > > 1) client buffer size; > 2) server memstore size; > > But when i did the test, I have the re

How to improve the write performance?

2013-11-26 Thread jingych
Hi, All! Recently, I just test the Client write performance with HBase Java API. I think the performance X-factor is : 1) client buffer size; 2) server memstore size; But when i did the test, I have the result is : 1) As the client buffer size increase with 2M, 4M, 8M, 16M, 32M, and the write

HBase: Paralel Query

2013-11-26 Thread Job Thomas
Hi All, How can we configure Hbase inorder to perform multythreading/parallel query faster . These are some bits from my analysis: Each Thread contain 10 query ( Random) TreadH2(Msec) Phoenix(Msec) 134 215 263 222 4