[ 
https://issues.apache.org/jira/browse/BLUR-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13691033#comment-13691033
 ] 

Aaron McCurry commented on BLUR-148:
------------------------------------

Take a look at the org.apache.blur.manager.indexserver.DefaultBlurIndexWarmup 
class.  This class walks through all the indexreader and warming each field as 
needed or configured after the index has been opened in a shard server.  And 
what I mean by warming is that it calculates via sampling where information for 
the given fields reside each file in the Directory.  After it has calculated 
the offsets, the DefaultBlurIndexWarmup class will read in small blocks the 
proper positions in the files to populate the BlockCache.

The org.apache.blur.manager.writer.FieldBasedWarmer class is used to warm only 
the new segments that have been loaded by the NRT updates in the IndexWriter.  
The goal is to have the FieldBasedWarmer class warm the new segments the same 
way the DefaultBlurIndexWarmup warms the whole index.  So basically we need to 
copy much of the logic in the DefaultBlurIndexWarmup class into the 
FieldBasedWarmer class.

Aaron
                
> Need to warm up new segments after NRT reloads
> ----------------------------------------------
>
>                 Key: BLUR-148
>                 URL: https://issues.apache.org/jira/browse/BLUR-148
>             Project: Apache Blur
>          Issue Type: Improvement
>          Components: Blur
>    Affects Versions: 0.2.0
>            Reporter: Aaron McCurry
>             Fix For: 0.2.0
>
>
> Need to call the warm index code on new segments after the NRT writer creates 
> a new segment.  Will also need to add a new state for the 
> shardServerLayoutState call.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to