In actual scenario we are using a table with 200 million records. Our doubt is, In hbase 0.94.6 or 12 after created a table with very less records without any extra configuration getting response in 0.01 or 0.02 sec. but in hbase 0.20.6 ( running in same machine , confutations and same size table ) getting response in 0.002 or 0.001 sec. ( ten times better performance ). since my primary aim is to use phoenix, requires hbase 0.94.X and above , I am worrying due to the less performance . I just try it with hadoop 1.2.1 version as you said, but no performance gain. ? I am running this program in server side . so there won't be any network issue as you said. Your help will be so useful in this situation , Thanks & Regards, Job M Thomas
________________________________ From: lars hofhansl [mailto:[email protected]] Sent: Mon 11/25/2013 9:36 AM To: [email protected] Subject: Re: Hbase 0.2.6 performance Not sure when that was added, that was long before my time, but can you disable Nagle's? (i.e. enabled tcpnodelay for both HBase and HDFS - search these mailing lists for how to do that) If your table is 50 records you're not measuring HBase you are measuring your network :) I would suggest you test with a few million rows. When you scan make sure you use scanner caching. (Scan.setCaching) -- Lars ________________________________ From: Job Thomas <[email protected]> To: [email protected] Sent: Sunday, November 24, 2013 7:45 PM Subject: RE: Hbase 0.2.6 performance Hi Ted, Thank you for the response. * For testing Hbase 0.20.6 am used Hadoop 0.20.2, and for testing HBase 0.94.12 , used Hadoop 1.0.4 . * I am used default parameters for testing both these version. * My table is very small ( 50 or less records). * Another question: Can I get multy Threading , while querying hbase using Phoenix. Best Regards, Job M Thomas ________________________________ From: Ted Yu [mailto:[email protected]] Sent: Fri 11/22/2013 11:44 PM To: [email protected] Subject: Re: Hbase 0.2.6 performance bq. and hadoop 1.0.4 Were you using the same hadoop version for testing 0.20.6 ? Please consider using hadoop 1.2.1 for testing. See HBASE-9799 Change Hadoop 1.2 dependency to 1.2.1 I assume you used default parameters for 0.94.12 How about 0.20.6 - did you tune parameters for that ? Were you loading data into the same table at the time of performing query testing ? Thanks On Fri, Nov 22, 2013 at 7:42 AM, Job Thomas <[email protected]> wrote: > Hi , > > I am getting the query performance in > Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec) > but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) , > considerably very less as compared to the first combination. > > I want to use phoenix and that requires hbase0.94.X and greater. but > performance of hbase0.94.x versions are very less. > Please let me know what will be the reason. or How can we increase the > performance of latest hbase versions. > > With Thanks, > Job M Thomas >
