Aaron McCurry created BLUR-105:
----------------------------------

             Summary: Index Import rollback
                 Key: BLUR-105
                 URL: https://issues.apache.org/jira/browse/BLUR-105
             Project: Apache Blur
          Issue Type: Improvement
    Affects Versions: 0.1.5, 0.1.6
            Reporter: Aaron McCurry
             Fix For: 0.1.6


During the index import (after a map reduce job) if there is an exception 
thrown or a server shutdown the imported (and committed data from the MapReduce 
job) could be lost.  This is because instead of copying the segments from the 
import directories into the main index.  The index importer merely renames them 
and the reason for this is to improve performance.

I suggest that we create a import logger to log what files have moved where so 
that in the event that the import fails, the files that have been moved into 
the main index and can be saved.  I may need to create a diagram to illustrate 
the potential problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to