Re: IndexWriter, DirectoryTaxonomyWriter & SearcherTaxonomyManager synchronization

2016-09-28 Thread William Moss
nd > ordinals that are unknown you to the TIR? > > So I'd say that if you refresh() from the same thread that you do commit(), > then commit to IW first then TIW, and use SearcherTaxoManager as it's > currently implemented. But I'd like to hear your thoughts abo

Re: IndexWriter, DirectoryTaxonomyWriter & SearcherTaxonomyManager synchronization

2016-09-27 Thread William Moss
gt; luc...@mikemccandless.com> wrote: > > > Hitting NoSuchFileException is no good! Something serious is wrong. > > Can you include the full stack trace? > > > > Responses inlined below: > > > > On Tue, Sep 27, 2016 at 2:08 AM, William Moss > > wrote:

IndexWriter, DirectoryTaxonomyWriter & SearcherTaxonomyManager synchronization

2016-09-26 Thread William Moss
We're using Lucene 5.2.0 (I know it's old, we're in the process of upgrading) to handle searching over our listings here at Airbnb. I've been digging into our realtime indexing code and how we use Lucene and I wanted to check a few assumptions around synchronization, since we see some periodic exce