[
https://issues.apache.org/jira/browse/HBASE-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924549#comment-13924549
]
Nick Dimiduk commented on HBASE-10660:
--------------------------------------
Patch works as expected. I had the wrong jar deployed.
Mapper logs before patch:
{noformat}
2014-03-08 00:09:37,945 INFO [StoreOpener-cdbd3f22b30236572090d30e7a692c4e-1]
org.apache.hadoop.hbase.util.ByteBufferArray: Allocating buffers total=980 MB ,
sizePerBuffer=4 MB, count=245
2014-03-08 00:09:40,276 INFO [StoreOpener-cdbd3f22b30236572090d30e7a692c4e-1]
org.apache.hadoop.hbase.io.hfile.bucket.BucketCache: Started bucket cache
2014-03-08 00:09:40,277 INFO [StoreOpener-cdbd3f22b30236572090d30e7a692c4e-1]
org.apache.hadoop.hbase.io.hfile.CacheConfig: Allocating LruBlockCache with
maximum size 420.0 M
{noformat}
Mapper logs after patch:
{noformat}
2014-03-08 00:01:54,250 INFO [StoreOpener-e8c19c26e2d51cf67dec8ae4c9e5ac04-1]
org.apache.hadoop.hbase.io.hfile.CacheConfig: Allocating LruBlockCache with
maximum size 246.5 M
{noformat}
> MR over snapshots can OOM when alternative blockcache is enabled
> ----------------------------------------------------------------
>
> Key: HBASE-10660
> URL: https://issues.apache.org/jira/browse/HBASE-10660
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 0.98.0, 0.99.0
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Attachments: HBASE-10660.00.patch, HBASE-10660.01.patch,
> HBASE-10660.02.patch, HBASE-10660.03.patch
>
>
> Running {{IntegrationTestTableSnapshotInputFormat}} with the {{BucketCache}}
> enabled results in OOM. The map task is running a sequential scan over the
> region region it opened, so probably it's not benefiting much from a
> blockcache. Just disable blockcache entirely for these scans because it's
> likely the cache config detected is designed for a RS running on a different
> class of hardware than that running the map task.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
