Hey, The max sizes of these things are determined by how many bits we use to specify lengths in the file format. Changing it isn't an option because the file format depends on it and done by code.
However you shouldn't be hitting limits based on the data you told us... perhaps if you could paste the exception backtrace it might indicate something useful. -ryan On Sat, Oct 2, 2010 at 10:56 PM, Taylor, Ronald C <[email protected]> wrote: > > Hi Ryan, > > Well, the key is only 50 chars or so, and the data in the cell is about 12 > Meg, in one string. So - obviously this is way less than the 2 Gb limit for > each. Does this have anything to do with the row length, which is supposed to > be kept to less than, from what you say below, > Short.MAX_LENGTH ? > > I do not see MAX_LENGTH being set anywhere in the conf files (just did a > grep), so - what is the default row max length, and where would I reset it, > if needed? > > And if that's *not* the problem, any other possibilities for an error msg of > KeyValue size too large > > being given on a rather prosaic Put insertion? > > Ron > > -----Original Message----- > From: Ryan Rawson [mailto:[email protected]] > Sent: Saturday, October 02, 2010 10:42 PM > To: [email protected] > Cc: Taylor, Ronald C > Subject: Re: How do you increase the max cell size in Hbase? > > Hey, > > The limits are due to code/data limits, eg: how many bits of space we use to > indicate lengths and such. This is something like ~ 2gb for the "key" part > and the "value" part each. Furthermore the row can only be Short.MAX_LENGTH. > > There is specific exceptions for each one of these in trunk/0.89, do you have > a specific exception text? > > -ryan > > On Sat, Oct 2, 2010 at 10:31 PM, Taylor, Ronald C <[email protected]> > wrote: >> >> Hello, >> >> I would like to increase the max cell size in one of my Hbase tables. >> Just got an error msg when trying to insert something about 12 Meg in >> size that said >> >> KeyValue size too large >> >> I presume that I'm using the default cell max size at present - I cannot >> find anything regarding cell size in the conf files, so the default setting >> must be being used. >> >> How do I increase the max size allowed? For example, if I want to allow a >> string of up to 20 Meg in size, which conf file do I change, and what is the >> precise wording? >> >> I googled around and found a note on MAX_LENGTH, but it is unclear how >> to set it and where. Do I do something like >> >> MAX_LENGTH=20 >> >> in the conf//hbase-env.sh file? >> >> And, if that works, do I need to restart Hbase and then recreate all the >> tables in which I want to use the new max cell size? >> >> Cheers, >> Ron >> >> ___________________________________________ >> Ronald Taylor, Ph.D. >> Computational Biology & Bioinformatics Group Pacific Northwest >> National Laboratory >> 902 Battelle Boulevard >> P.O. Box 999, Mail Stop J4-33 >> Richland, WA 99352 USA >> Office: 509-372-6568 >> Email: [email protected] >> >> >> >
