Hi Ryan,
Well, the key is only 50 chars or so, and the data in the cell is about 12 Meg,
in one string. So - obviously this is way less than the 2 Gb limit for each.
Does this have anything to do with the row length, which is supposed to be kept
to less than, from what you say below,
Short.MAX_LENGTH ?
I do not see MAX_LENGTH being set anywhere in the conf files (just did a grep),
so - what is the default row max length, and where would I reset it, if needed?
And if that's *not* the problem, any other possibilities for an error msg of
KeyValue size too large
being given on a rather prosaic Put insertion?
Ron
-----Original Message-----
From: Ryan Rawson [mailto:[email protected]]
Sent: Saturday, October 02, 2010 10:42 PM
To: [email protected]
Cc: Taylor, Ronald C
Subject: Re: How do you increase the max cell size in Hbase?
Hey,
The limits are due to code/data limits, eg: how many bits of space we use to
indicate lengths and such. This is something like ~ 2gb for the "key" part and
the "value" part each. Furthermore the row can only be Short.MAX_LENGTH.
There is specific exceptions for each one of these in trunk/0.89, do you have a
specific exception text?
-ryan
On Sat, Oct 2, 2010 at 10:31 PM, Taylor, Ronald C <[email protected]> wrote:
>
> Hello,
>
> I would like to increase the max cell size in one of my Hbase tables.
> Just got an error msg when trying to insert something about 12 Meg in
> size that said
>
> KeyValue size too large
>
> I presume that I'm using the default cell max size at present - I cannot find
> anything regarding cell size in the conf files, so the default setting must
> be being used.
>
> How do I increase the max size allowed? For example, if I want to allow a
> string of up to 20 Meg in size, which conf file do I change, and what is the
> precise wording?
>
> I googled around and found a note on MAX_LENGTH, but it is unclear how
> to set it and where. Do I do something like
>
> MAX_LENGTH=20
>
> in the conf//hbase-env.sh file?
>
> And, if that works, do I need to restart Hbase and then recreate all the
> tables in which I want to use the new max cell size?
>
> Cheers,
> Ron
>
> ___________________________________________
> Ronald Taylor, Ph.D.
> Computational Biology & Bioinformatics Group Pacific Northwest
> National Laboratory
> 902 Battelle Boulevard
> P.O. Box 999, Mail Stop J4-33
> Richland, WA 99352 USA
> Office: 509-372-6568
> Email: [email protected]
>
>
>
