: Vimal Jain vkj...@gmail.com javascript:;
To: user@hbase.apache.org javascript:;
Sent: Saturday, August 3, 2013 11:28 PM
Subject: Re: How many column families in one table ?
Hi,
I have tested read performance after reducing number of column families
from 14 to 3 and yes
column families in one table ?
Hi,
I have tested read performance after reducing number of column families
from 14 to 3 and yes there is improvement.
Meanwhile i was going through the paper published by google on
BigTable.
It says
It is our intent that the number
Hi,
I have tested read performance after reducing number of column families
from 14 to 3 and yes there is improvement.
Meanwhile i was going through the paper published by google on BigTable.
It says
It is our intent that the number of distinct column
families in a table be small (in the hundreds
Kevin
Would love to hear your thoughts around hbase not big table.
Thanks
inder
you are the average of 5 people you spend the most time with
On Aug 4, 2013 8:15 PM, Kevin O'dell kevin.od...@cloudera.com wrote:
Hi Vimal,
It really depends on your usage pattern but HBase != Bigtable.
On
Hi Inder,
Here is an excellent blog post which is a little dated:
http://www.larsgeorge.com/2009/11/hbase-vs-bigtable-comparison.html?m=1
On Aug 4, 2013 10:55 AM, Inder Pall inder.p...@gmail.com wrote:
Kevin
Would love to hear your thoughts around hbase not big table.
Thanks
inder
Thanks kevin
inder
you are the average of 5 people you spend the most time with
On Aug 4, 2013 8:35 PM, Kevin O'dell kevin.od...@cloudera.com wrote:
Hi Inder,
Here is an excellent blog post which is a little dated:
http://www.larsgeorge.com/2009/11/hbase-vs-bigtable-comparison.html?m=1
to mitigate this by
tweaking the compaction policies.
-- Lars
From: Vimal Jain vkj...@gmail.com
To: user@hbase.apache.org
Sent: Saturday, August 3, 2013 11:28 PM
Subject: Re: How many column families in one table ?
Hi,
I have tested read performance after
.
-- Lars
From: Vimal Jain vkj...@gmail.com javascript:;
To: user@hbase.apache.org javascript:;
Sent: Saturday, August 3, 2013 11:28 PM
Subject: Re: How many column families in one table ?
Hi,
I have tested read performance after reducing number of column
Thanks Dhaval/Michael/Ted/Otis for your replies.
Actually , i asked this question because i am seeing some performance
degradation in my production Hbase setup.
I have configured Hbase in pseudo distributed mode on top of HDFS.
I have created 17 Column families :( . I am actually using 14 out of
When you did the scan, did you check what the bottleneck was ? Was it I/O ?
Did you see any GC locks ? How much RAM are you giving to your RS ?
-Viral
On Mon, Jul 1, 2013 at 1:44 AM, Vimal Jain vkj...@gmail.com wrote:
To completely scan the table for all 140 columns , it takes around 30-40
I scanned it during normal traffic hours.There was no I/O load on the
server.
I dont see any GC locks too.
Also i have given 1.5G to RS , 512M to each Master and Zookeeper.
One correction in the post above :
Actual time to scan whole table is even more , it takes 10 mins to scan 0.1
million rows
Can someone please reply ?
Also what is the typical read/write speed of hbase and how much deviation
would be there in my scenario mentioned above (14 cf , total 140 columns ) ?
I am asking this because i am not simply printing out the scanned values ,
instead i am applying some logic on the data
Subject: Re: How many column families in one table ?
Can someone please reply ?
Also what is the typical read/write speed of hbase and how much deviation
would be there in my scenario mentioned above (14 cf , total 140 columns ) ?
I am asking this because i am not simply printing out the scanned
? Otherwise each call to next() is a RPC
roundtrip and you are basically measuring your networks RTT.
-- Lars
From: Vimal Jain vkj...@gmail.com
To: user@hbase.apache.org
Sent: Monday, July 1, 2013 4:11 AM
Subject: Re: How many column families in one table ?
Can
bq. I have configured Hbase in pseudo distributed mode on top of HDFS.
What was the reason for using pseudo distributed mode in production setup ?
Cheers
On Mon, Jul 1, 2013 at 1:44 AM, Vimal Jain vkj...@gmail.com wrote:
Thanks Dhaval/Michael/Ted/Otis for your replies.
Actually , i asked
Hi,
We had some hardware constraints along with the fact that our total data
size was in GBs.
Thats why to start with Hbase , we first began with pseudo distributed
mode and thought if required we would upgrade to fully distributed mode.
On Mon, Jul 1, 2013 at 5:09 PM, Ted Yu
, 2013 4:44 AM
Subject: Re: How many column families in one table ?
Hi,
We had some hardware constraints along with the fact that our total data
size was in GBs.
Thats why to start with Hbase , we first began with pseudo distributed
mode and thought if required we would upgrade to fully
column families in one table ?
Hi,
We had some hardware constraints along with the fact that our total data
size was in GBs.
Thats why to start with Hbase , we first began with pseudo distributed
mode and thought if required we would upgrade to fully distributed mode.
On Mon, Jul 1
On Mon, Jul 1, 2013 at 10:06 AM, Vimal Jain vkj...@gmail.com wrote:
Sorry for the typo .. please ignore previous mail.. Here is the corrected
one..
1)I have around 140 columns for each row , out of 140 , around 100 columns
hold java primitive data type , remaining 40 columns contain
Vimal:
Please also refer to:
http://search-hadoop.com/m/qOx8l15Z1q42/column+families+fbsubj=Re+HBase+Column+Family+Limit+Reasoning
On Fri, Jun 28, 2013 at 1:37 PM, Michel Segel michael_se...@hotmail.comwrote:
Short answer... As few as possible.
14 CF doesn't make too much sense.
Sent from a
Hi All ,
Thanks for your replies.
Ted,
Thanks for the link, but its not working . :(
On Fri, Jun 28, 2013 at 5:57 PM, Ted Yu yuzhih...@gmail.com wrote:
Vimal:
Please also refer to:
http://search-hadoop.com/m/qOx8l15Z1q42/column+families+fbsubj=Re+HBase+Column+Family+Limit+Reasoning
On
Beyond the physical limitations (cost constraints) there's a logical one in
terms of design.
I just did a talk at the CHUG on schema design and the key was to understand
how and why one should use column families.
From a logical design perspective you would want to limit data within a CF to
Hm, works for me -
http://search-hadoop.com/m/qOx8l15Z1q42/column+families+fbsubj=Re+HBase+Column+Family+Limit+Reasoning
Shorter version: http://search-hadoop.com/m/qOx8l15Z1q42
Otis
--
Solr ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm
On
Hi,
How many column families should be there in an hbase table ? Is there any
performance issue in read/write if we have more column families ?
I have designed one table with around 14 column families in it with each
having on average 6 qualifiers.
Is it a good design ?
--
Thanks and Regards,
24 matches
Mail list logo
