[ 
https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283047#comment-16283047
 ] 

ramkrishna.s.vasudevan commented on HBASE-19435:
------------------------------------------------

When ever a compaction happens we try to remove that hfile that was compacted 
from the cache. So all those blocks related to that hfile is removed. 
But since this is bucket cache - what we have is buckets that has these blocks 
and those are always in the fixed set of files that we have configured for file 
mode bucket cache. And when we evict a block for the compacted file there is 
nothing like we go and close the file associated with it inside bucket cache 
becuase that does not have any knowledge on what file's blocks are evicted or 
cached.
May be there are too many file channels open due to heavy compaction and that 
internally closes the socket channel open on this bucket cache's files? 

> Reopen Files for ClosedChannelException in BucketCache
> ------------------------------------------------------
>
>                 Key: HBASE-19435
>                 URL: https://issues.apache.org/jira/browse/HBASE-19435
>             Project: HBase
>          Issue Type: Bug
>          Components: BucketCache
>    Affects Versions: 2.0.0, 1.3.1
>            Reporter: Zach York
>            Assignee: Zach York
>             Fix For: 1.4.1, 2.0.0-beta-1
>
>         Attachments: HBASE-19435.branch-1.001.patch, 
> HBASE-19435.master.001.patch, HBASE-19435.master.002.patch, 
> HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, 
> HBASE-19435.master.005.patch, HBASE-19435.master.006.patch, 
> HBASE-19435.master.007.patch, HBASE-19435.master.007.patch
>
>
> When using the FileIOEngine for BucketCache, the cache will be disabled if 
> the connection is interrupted or closed. HBase will then get 
> ClosedChannelExceptions trying to access the file. After 60s, the RS will 
> disable the cache. This causes severe read performance degradation for 
> workloads that rely on this cache. FileIOEngine never tries to reopen the 
> connection. This JIRA is to reopen files when the BucketCache encounters a 
> ClosedChannelException.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to