[ https://issues.apache.org/jira/browse/HBASE-19435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283047#comment-16283047 ]
ramkrishna.s.vasudevan commented on HBASE-19435: ------------------------------------------------ When ever a compaction happens we try to remove that hfile that was compacted from the cache. So all those blocks related to that hfile is removed. But since this is bucket cache - what we have is buckets that has these blocks and those are always in the fixed set of files that we have configured for file mode bucket cache. And when we evict a block for the compacted file there is nothing like we go and close the file associated with it inside bucket cache becuase that does not have any knowledge on what file's blocks are evicted or cached. May be there are too many file channels open due to heavy compaction and that internally closes the socket channel open on this bucket cache's files? > Reopen Files for ClosedChannelException in BucketCache > ------------------------------------------------------ > > Key: HBASE-19435 > URL: https://issues.apache.org/jira/browse/HBASE-19435 > Project: HBase > Issue Type: Bug > Components: BucketCache > Affects Versions: 2.0.0, 1.3.1 > Reporter: Zach York > Assignee: Zach York > Fix For: 1.4.1, 2.0.0-beta-1 > > Attachments: HBASE-19435.branch-1.001.patch, > HBASE-19435.master.001.patch, HBASE-19435.master.002.patch, > HBASE-19435.master.003.patch, HBASE-19435.master.004.patch, > HBASE-19435.master.005.patch, HBASE-19435.master.006.patch, > HBASE-19435.master.007.patch, HBASE-19435.master.007.patch > > > When using the FileIOEngine for BucketCache, the cache will be disabled if > the connection is interrupted or closed. HBase will then get > ClosedChannelExceptions trying to access the file. After 60s, the RS will > disable the cache. This causes severe read performance degradation for > workloads that rely on this cache. FileIOEngine never tries to reopen the > connection. This JIRA is to reopen files when the BucketCache encounters a > ClosedChannelException. -- This message was sent by Atlassian JIRA (v6.4.14#64029)