Re: Best strategy to commit often under load.

2009-09-17 Thread Lance Norskog
Yes, the Solr autoCommit feature is the right tool for this task. It lets the indexing app be simple. In some earlier Solr releases, the "number of documents" feature did not work, so you had to use the "number of milliseconds" feature. Note that each commit causes Solr to forget all cached data a

Re: Best strategy to commit often under load.

2009-09-15 Thread Jason Rutherglen
Hi Jerome, 5 seconds is too little using Solr 1.3 or 1.4 because of caching and segment warming. If you turn off caching and segment warming, then you may be able do 5s latency using either a RAMDirectory or an SSD. In the future these issues will be fixed and less than 1s will be possible. -J O