[
https://issues.apache.org/jira/browse/BLUR-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530072#comment-14530072
]
Ravikumar commented on BLUR-431:
--------------------------------
As per discussions on the mailing-list thread for auto-save/load of
block-cache, I've done the following…
1. AutoSavingBaseCache periodically dumps block-cache meta-data into HDFS.
Every cached-file has an associated HDFS meta-file that will be written…
2. IndexWarmup is extended to re-populate the block-cache during openShard.
3. A CacheIOContext is created for warm-up, so that underlying directories
{HdfsDirectory etc…} can examine the context and internally use a
ThrottledIndexInput class…
4. Cache warmup completion is a pre-requiste to writing block-cache for any
given shard. This is to avoid race issues…
The set of files may not compile, as I wanted to get feedback on it before
proceeding...
> Auto-Save/Load Block-cache
> --------------------------
>
> Key: BLUR-431
> URL: https://issues.apache.org/jira/browse/BLUR-431
> Project: Apache Blur
> Issue Type: Improvement
> Affects Versions: 0.2.2
> Reporter: Ravikumar
>
> Experimental Block-Cache/Load initial version attached here...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
