Re: Lucene cluster with NFS or synchronization tool such as rsync

2016-07-05 Thread Sanne Grinovero
I had a similar need some ~5 years ago, and contributed this Lucene extension to the Infinispan project: - http://infinispan.org/docs/8.2.x/user_guide/user_guide.html#_infinispan_as_a_storage_for_lucene_indexes It since matured and is now being actively maintained by several other people using i

IndexWriter and IndexReader in a shared environment

2016-07-05 Thread Desteny Child
Hi, In my Spring Boot application I have implemented 2 API endpoints - one for Lucene(I use 5.2.1) document indexing and another one for searching. Right now I open every time on each request IndexWriter and IndexReader. With a big index it works pretty slow. I know that there is a possibility t

Document retrieval, performance, and DocValues

2016-07-05 Thread Randy Tidd
My Lucene index has about 3 million documents and result sets can be large, often 1000’s and sometimes as many as 100,000. I am expecting the index size to grow 5-10x as the system matures. I index 5 fields, and per recommendations I’ve read, am storing the minimal data in Lucene, currently ju

Re: Document retrieval, performance, and DocValues

2016-07-05 Thread Sanne Grinovero
Hi Randy, a first quick and easy win would be to rewrite it as: DocumentStoredFieldVisitor visitor = new DocumentStoredFieldVisitor(Collections.singleton("pos_id”)); for(int i=0; i wrote: > My Lucene index has about 3 million documents and result sets can be large, > often 1000’s and sometimes a