Cool, thanks for the poke, Ben!
Last I checked, our version of the LRUBlockCache was nearly identical to
what was in HBase 1.x. I would imagine this would be easy to bring over.
Maybe we can also try to swipe BucketCache while we're at it and get
some off-heap support for blocks.
Aside: it would be nice if we could somehow find a way to share code
like this across the projects. HBase was interested in FATE for some
time, but eventually created their own new solution. I'm not sure what
else exists that we might want to share between projects.
[email protected] wrote:
Associated issue: https://issues.apache.org/jira/browse/ACCUMULO-4177
-----Original Message-----
From: Christopher [mailto:[email protected]]
Sent: Sunday, April 03, 2016 1:31 PM
To: [email protected]
Subject: Re: LruBlockCache alternative
Thanks for the pointer!
On Sun, Apr 3, 2016, 12:08 Benjamin Manes<[email protected]> wrote:
Hi,
I noticed that Accumulo's LruBlockCache [1] appears to be based on
HBase's.
I currently have a patch being reviewed in HBASE-15560 [2] that
replaces the pseudo Segmented LRU with the TinyLFU eviction policy.
That should allow the cache to make better predictions based on
frequency and recency, such as improved scan resistance. Full details
are in the JIRA ticket. I think it should be easy to port if there is interest.
Cheers,
Ben
[1]
https://github.com/apache/accumulo/blob/master/core/src/main/java/org/
apache/accumulo/core/file/blockfile/cache/LruBlockCache.java
[2] https://issues.apache.org/jira/browse/HBASE-15560
