Re: Region hot spotting

2012-11-22 Thread Mohammad Tariq
Good point Mike. Regards, Mohammad Tariq On Thu, Nov 22, 2012 at 2:51 AM, Michael Segel michael_se...@hotmail.comwrote: Salting is not a good idea and I don't know why people suggest it. Case in point you want to fetch a single row/record back. Because the salt is arbitrary, you

RE: Region hot spotting

2012-11-22 Thread Ajay Bhosle
: Re: Region hot spotting Salting is not a good idea and I don't know why people suggest it. Case in point you want to fetch a single row/record back. Because the salt is arbitrary, you will need to send N number of get()s one for each salt value. Doing a simple one way hash of the data

Re: Region hot spotting

2012-11-21 Thread ramkrishna vasudevan
Hotspotting is bound to happen until the region starts splitting and gets assigned to diff region servers. Regards Ram On Wed, Nov 21, 2012 at 12:49 PM, Ajay Bhosle ajay.bho...@relianceada.comwrote: Hi, I am inserting some data in hbase which is getting hot spotted in a particular server.

Re: Region hot spotting

2012-11-21 Thread Mohammad Tariq
Hello Ajay, You can use 'salting' if you don't want to presplit your table. You might this link useful : http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/ HTH Regards, Mohammad Tariq On Wed, Nov 21, 2012 at 1:49 PM,

Re: Region hot spotting

2012-11-21 Thread ramkrishna vasudevan
Hi This link is pretty much useful. But still there too it says if you dont pre split you need to wait for the salting to help you from hotspotting till the region gets splitted. Mohammad just pointing this to say the usefulness of presplitting definitely your's is a good pointer to Ajay. :)

RE: Region hot spotting

2012-11-21 Thread Ajay Bhosle
: Wednesday, November 21, 2012 2:14 PM To: user@hbase.apache.org Subject: Re: Region hot spotting Hi This link is pretty much useful. But still there too it says if you dont pre split you need to wait for the salting to help you from hotspotting till the region gets splitted. Mohammad just pointing

Re: Region hot spotting

2012-11-21 Thread Suraj Varma
[mailto:ramkrishna.s.vasude...@gmail.com] Sent: Wednesday, November 21, 2012 2:14 PM To: user@hbase.apache.org Subject: Re: Region hot spotting Hi This link is pretty much useful. But still there too it says if you dont pre split you need to wait for the salting to help you from hotspotting till

Re: Region hot spotting

2012-11-21 Thread Mohammad Tariq
Hello again, Just a small query. Is your data getting streamed continuously or are you making use of bulk load. In case of latter, I don't find any harm in creating pre-splitted tables. Regards, Mohammad Tariq On Wed, Nov 21, 2012 at 2:14 PM, ramkrishna vasudevan

Re: Region hot spotting

2012-11-21 Thread Doug Meil
, November 21, 2012 2:14 PM To: user@hbase.apache.org Subject: Re: Region hot spotting Hi This link is pretty much useful. But still there too it says if you dont pre split you need to wait for the salting to help you from hotspotting till the region gets splitted. Mohammad just pointing

Re: Region hot spotting

2012-11-21 Thread Michael Segel
Salting is not a good idea and I don't know why people suggest it. Case in point you want to fetch a single row/record back. Because the salt is arbitrary, you will need to send N number of get()s one for each salt value. Doing a simple one way hash of the data, even appending the data,

Region hot spotting

2012-11-20 Thread Ajay Bhosle
Hi, I am inserting some data in hbase which is getting hot spotted in a particular server. The format of the row key is (0 or 1)|[timestamp]_[sequence]. Basically I want to add log information to hbase and search the records based on range of dates. Can someone suggest any configuration