FWIW, last I looked into this,
https://issues.apache.org/jira/browse/HBASE-15154 would be the long-term
solution to the Master also requiring the MaxDirectMemorySize
configuration (even when it is not acting as a RegionServer).
Obviously, it's a lower priority fix as there is a simple workaround.
On 9/12/17 12:50 PM, Arul Ramachandran wrote:
Ted,
For #1, I was following:
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_data-access/content/ch_managing-hbase.html#ref-db219cd6-c586-49c1-bc56-c9c1c5475276.1
++
For #2, I got the error "Caused by: java.lang.OutOfMemoryError: Direct
buffer memory" when starting hbase master.
https://community.hortonworks.com/questions/129825/hbase-bucket-cache-causing-hmaster-to-go-down.html
describes the fix.
++
On Tue, Sep 12, 2017 at 9:10 AM, Ted Yu <yuzhih...@gmail.com> wrote:
Looks like the config you meant should be hbase.bucketcache.size
As the refguide says:
A float that EITHER represents a percentage of total heap memory size to
give to the cache (if < 1.0) OR, it is the total capacity in megabytes of
BucketCache. Default: 0.0
If you specify the size as capacity, -XX:MaxDirectMemorySize should be
bigger than the capacity.
For #2, did you encounter some error ?
Cheers
On Tue, Sep 12, 2017 at 8:52 AM, Arul Ramachandran <arkup...@gmail.com>
wrote:
In HBase 1.1.2, I am setting up bucket cache. I set MaxDirectMemory size
greater than hbase.bucket.cache.size - only then it would work.
1) Does HBASE_REGIONSERVER_OPTS -XX:MaxDirectMemorySize needs to be
greater
than hbase.bucket.cache.size?
2) It seems with hbase 1.1.2, HBASE_MASTER_OPTS also needs the
-XX:MaxDirectMemorySize setting?
IIRC, in Hbase 0.98, I had to set -XX:MaxDirectMemorySize less than
hbase.bucket.cache.size --and-- I did not have to set
-XX:MaxDirectMemorySize for HBASE_MASTER_OPTS.
Thanks,
Arul
