[ https://issues.apache.org/jira/browse/LUCENE-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694810#action_12694810 ]
Jason Rutherglen edited comment on LUCENE-1313 at 4/1/09 3:50 PM: ------------------------------------------------------------------ The patch includes RealtimeIndex a basic class for performing atomic transactional realtime indexing and search. A single thread periodically flushes to disk the ram index. It relies on LUCENE-1516. We need to benchmark this, specifically 1) realtime w/ramdir transaction 2) realtime w/queued documents transaction 3) normal indexing. Realtime w/ramdir encodes the transaction to a RAMDirectory which is added to the RAM writer using IW.addIndexesNoOptimize. Option 1 may be slower than option 2, however if the system is replicating it may be the only option? Long term I believe we need to implement searching over the IndexWriter ram buffer (if possible). However I am not sure how option 1 and replication would work with it? was (Author: jasonrutherglen): The patch includes RealtimeIndex a basic class for performing atomic transactional realtime indexing and search. A single thread periodically flushes to disk the ram index. It relies on LUCENE-1516. We need to benchmark this, specifically 1) realtime w/ramdir transaction 2) realtime w/queued documents transaction 3) normal indexing. Realtime w/ramdir encodes the transaction to a RAMDirectory which is added to the RAM writer using IW.addIndexesNoOptimize. Option 1 may be slower than option 2, however if the system is replicating it may be the only option? Long term I believe we need to implement searching over the IndexWriter ram buffer (if possible). However I am not sure how option 2 would work with it? > Realtime Search > --------------- > > Key: LUCENE-1313 > URL: https://issues.apache.org/jira/browse/LUCENE-1313 > Project: Lucene - Java > Issue Type: New Feature > Components: Index > Affects Versions: 2.4.1 > Reporter: Jason Rutherglen > Priority: Minor > Fix For: 2.9 > > Attachments: LUCENE-1313.patch, LUCENE-1313.patch, lucene-1313.patch, > lucene-1313.patch, lucene-1313.patch, lucene-1313.patch > > > Realtime search with transactional semantics. > Possible future directions: > * Optimistic concurrency > * Replication > Encoding each transaction into a set of bytes by writing to a RAMDirectory > enables replication. It is difficult to replicate using other methods > because while the document may easily be serialized, the analyzer cannot. > I think this issue can hold realtime benchmarks which include indexing and > searching concurrently. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org