[
https://issues.apache.org/jira/browse/HBASE-17738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006172#comment-16006172
]
ramkrishna.s.vasudevan commented on HBASE-17738:
------------------------------------------------
In case of using DBB's constructor to allocate the buffer, we do get OOME
{code}
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
at java.nio.Bits.reserveMemory(Bits.java:658)
at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311)
at
org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine$1.allocate(ByteBufferIOEngine.java:88)
at
org.apache.hadoop.hbase.util.ByteBufferArray.<init>(ByteBufferArray.java:67)
at
org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine.<init>(ByteBufferIOEngine.java:94)
at
org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getIOEngineFromName(BucketCache.java:325)
at
org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.<init>(BucketCache.java:230)
at
org.apache.hadoop.hbase.io.hfile.CacheConfig.getBucketCache(CacheConfig.java:662)
at
org.apache.hadoop.hbase.io.hfile.CacheConfig.getL2(CacheConfig.java:598)
at
org.apache.hadoop.hbase.io.hfile.CacheConfig.instantiateBlockCache(CacheConfig.java:684)
at
org.apache.hadoop.hbase.io.hfile.CacheConfig.<init>(CacheConfig.java:268)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:587)
... 10 more
{code}
while trying to reserve memory. So we will be losing this capability if we move
towards direct unsafe way of allocating memory.
> BucketCache startup is slow
> ---------------------------
>
> Key: HBASE-17738
> URL: https://issues.apache.org/jira/browse/HBASE-17738
> Project: HBase
> Issue Type: Sub-task
> Components: BucketCache
> Affects Versions: 2.0.0
> Reporter: stack
> Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0
>
> Attachments: HBASE-17738_2.patch, HBASE-17738_2.patch,
> HBASE-17738_3.patch, HBASE-17738.patch
>
>
> If you set bucketcache size at 64G say and then start hbase, it takes a long
> time. Can we do the allocations in parallel and not inline with the server
> startup?
> Related, prefetching on a bucketcache is slow. Speed it up.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
