Re: Regions and Rowkeys

2015-05-12 Thread Talat Uyarer
Hi Arun, Please read this document http://hbase.apache.org/book.html#rowkey.design i think it will be help figure out to rowkey design. Talat On May 12, 2015 6:00 PM, "Arun Patel" wrote: > Thank you all. This info is really helpful.I have a follow up question > related to my use case. > >

Re: Regions and Rowkeys

2015-05-12 Thread Arun Patel
Thank you all. This info is really helpful.I have a follow up question related to my use case. I need to create a table called as LOGS to log event info generated from multiple services that I am calling. For each rowkey (a random UUID generated in this case), multiple services are called an

Re: Regions and Rowkeys

2015-05-12 Thread Ted Yu
Arun: See the following for details: http://hbase.apache.org/book.html#_determining_split_points http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/util/RegionSplitter.HexStringSplit.html Cheers On Tue, May 12, 2015 at 6:11 AM, Talat Uyarer wrote: > Hi Arun, > > rowKeys. Hbase decide whic

Re: Regions and Rowkeys

2015-05-12 Thread Michael Segel
Yeah, its about time. What a slacker! :-P > On May 11, 2015, at 6:56 PM, Jean-Marc Spaggiari > wrote: > > This? http://shop.oreilly.com/product/0636920033943.do > > 2015-05-11 18:55 GMT-04:00 Michael Segel : > >> Why would you expect to have a region allocated to all of the region >> servers?

Re: Regions and Rowkeys

2015-05-12 Thread Talat Uyarer
Hi Arun, rowKeys. Hbase decide which data is stored which region by rowkeys. the RegionSplitter uses MD5 algorithm to generate region starting keys of MD5 checksum. Talat 2015-05-12 15:48 GMT+03:00 Arun Patel : > Thank you. This helps. > > So, when I pre-split regions with below command, SPLI

Re: Regions and Rowkeys

2015-05-12 Thread Arun Patel
Thank you. This helps. So, when I pre-split regions with below command, SPLITALGO is creating the rowkey boundaries for each region? create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit'} I am failing to understand HexStringSplit. As per documentation,The format of a HexStringSpl

Re: Regions and Rowkeys

2015-05-11 Thread Nick Dimiduk
On Mon, May 11, 2015 at 3:38 PM, Arun Patel wrote: > 1) I have a 10 node HBase cluster. When I create a table in HBase, > how many regions will be allocated by default? In HBase, the number of region servers is orthogonal to table partitions. These two operational details are related but manag

Re: Regions and Rowkeys

2015-05-11 Thread Jean-Marc Spaggiari
This? http://shop.oreilly.com/product/0636920033943.do 2015-05-11 18:55 GMT-04:00 Michael Segel : > Why would you expect to have a region allocated to all of the region > servers? > You generate a region based on either pre-splitting (you set the region’s > key range) , or you start with one regi

Re: Regions and Rowkeys

2015-05-11 Thread Michael Segel
Why would you expect to have a region allocated to all of the region servers? You generate a region based on either pre-splitting (you set the region’s key range) , or you start with one region and grow from there. Please read either Lars George’s book (dated) or Nick Dimiduk’s book. (Sorry bu

Re: Regions and Rowkeys

2015-05-11 Thread Ted Yu
You can presplit table at time of creation. e.g. table 't1' is split into 15 regions in the following example: hbase(main):002:0> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit'} 0 row(s) in 2.3140 seconds The regions of the table would be spread evenly across the region serve

Regions and Rowkeys

2015-05-11 Thread Arun Patel
I have some basic questions on regions. 1) I have a 10 node HBase cluster. When I create a table in HBase, how many regions will be allocated by default? I looked at the HBase Master UI and it seems regions are not allocated to all the Regionservers by default. How can I allocate the regions in