Re: Incremental Field Updates

2014-07-08 Thread Ravikumar Govindarajan
That's a cool patch. Thanks On Thursday, July 3, 2014, Gopal Patwa wrote: > Thanks Ravi, it is good to know general problem with updatable field. In > our use-case where we have few fields which update more frequently then > main index. We are using this SOLR join contrib patch with DocTransfor

Re: Incremental Field Updates

2014-07-03 Thread Gopal Patwa
Thanks Ravi, it is good to know general problem with updatable field. In our use-case where we have few fields which update more frequently then main index. We are using this SOLR join contrib patch with DocTransformer for returning data from join core. But this approach has some performance impact

Re: Incremental Field Updates

2014-07-03 Thread Ravikumar Govindarajan
In case of sorting, updatable DocValues may be what you are looking for. But updatable fields for searching is a different beast. A sample approach is documented at http://www.flax.co.uk/blog/2012/06/22/updating-individual-fields-in-lucene-with-a-redis-backed-codec/ The general problems with upd

Re: Incremental Field Updates

2014-07-02 Thread Shai Erera
Using BinaryDocValues is not recommended for all scenarios. It is a "catchall" alternative to the other DocValues types. I would not use it unless it makes sense for your application, even if it means that you need to re-index a document in order to update a single field. DocValues are not good fo

Re: Incremental Field Updates

2014-07-01 Thread Sandeep Khanzode
Hi Shai, So one follow-up question. Assume that my use case is to have approx. ~50M documents indexed with each document having about ~10-15 indexed but not stored fields. These fields will never change, but there are another ~5-6 fields that will change and will continue to change after the i

Re: Incremental Field Updates

2014-07-01 Thread Shai Erera
Except that Lucene now offers efficient numeric and binary DocValues updates. See IndexWriter.updateNumeric/Binary... On Jul 1, 2014 5:51 PM, "Erick Erickson" wrote: > This JIRA is "complicated", don't really expect it in 4.9 as it's > been hanging around for quite a while. Everyone would like th

Re: Incremental Field Updates

2014-07-01 Thread Erick Erickson
This JIRA is "complicated", don't really expect it in 4.9 as it's been hanging around for quite a while. Everyone would like this, but it's not easy. Atomic updates will work, but you have to stored="true" for all source fields. Under the covers this actually reads the document out of the stored f