[
https://issues.apache.org/jira/browse/HBASE-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nick Dimiduk updated HBASE-10500:
---------------------------------
Component/s: (was: hbck)
HFile
Description:
Running {{hbck --repair}} or {{LoadIncrementalHFiles}} when BucketCache is
enabled in offheap mode can cause OOM. This is apparently because {{bin/hbase}}
does not include $HBASE_REGIONSERVER_OPTS for these tools. This results in
HRegion or HFileReaders initialized with a CacheConfig that doesn't have the
necessary Direct Memory.
Possible solutions include:
- disable blockcache in the config used by hbck when running its repairs
- include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
I'm leaning toward the former because it's possible that hbck is run on a host
with different hardware profile as the RS.
was:
Running {{hbck --repair}} when BucketCache is enabled in offheap mode can cause
OOM. This is apparently because {{bin/hbase}} does not include
$HBASE_REGIONSERVER_OPTS for hbck. It instantiates an HRegion instance as part
of HDFSIntegrityFixer.handleHoleInRegionChain. That HRegion initializes its
CacheConfig, which doesn't have the necessary Direct Memory.
Possible solutions include:
- disable blockcache in the config used by hbck when running its repairs
- include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
I'm leaning toward the former because it's possible that hbck is run on a host
with different hardware profile as the RS.
Summary: Some tools OOM when BucketCache is enabled (was: hbck and OOM
when BucketCache is enabled)
> Some tools OOM when BucketCache is enabled
> ------------------------------------------
>
> Key: HBASE-10500
> URL: https://issues.apache.org/jira/browse/HBASE-10500
> Project: HBase
> Issue Type: Bug
> Components: HFile
> Affects Versions: 0.98.0, 0.96.0, 0.99.0
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Attachments: HBASE-10500.00.patch
>
>
> Running {{hbck --repair}} or {{LoadIncrementalHFiles}} when BucketCache is
> enabled in offheap mode can cause OOM. This is apparently because
> {{bin/hbase}} does not include $HBASE_REGIONSERVER_OPTS for these tools. This
> results in HRegion or HFileReaders initialized with a CacheConfig that
> doesn't have the necessary Direct Memory.
> Possible solutions include:
> - disable blockcache in the config used by hbck when running its repairs
> - include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
> I'm leaning toward the former because it's possible that hbck is run on a
> host with different hardware profile as the RS.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
