How to use FieldCache and Custom Collector to improve search speed

2017-04-10 Thread neeraj shah
I am using Lucene 3.6 and i am trying to implement FieldCache. I have seen some posts but did not get any clear idea. Can anyone please suggest me any link where i can find proper example of FieldCache and how to use it while searching.

Re: custom collector

2015-04-30 Thread Robust Links
Hi West thank you for the help. I will try your suggestion. thank you again Peyman On Wed, Apr 29, 2015 at 10:01 PM, west suhanic wrote: > Hi Robust Links: > > I think you want to build a class that implements the LeafCollector. > For example: > > public class theLeafCollectorDocid implements

Re: custom collector

2015-04-29 Thread west suhanic
Hi Robust Links: I think you want to build a class that implements the LeafCollector. For example: public class theLeafCollectorDocid implements LeafCollector { theLeafCollectorDocid( final LeafReaderContext context ) { } collect( int doc ) { } } Onc

Re: custom collector

2015-04-29 Thread Robust Links
Hi Erick The index I am searching is lucene. I am trying to perform some operations over ALL the documents in that index. I can rebuild the index as a solr index and then use the export functionality. Up to now I've been using the lucene index searcher with custom collector. Would the below

Re: custom collector

2015-04-29 Thread Erick Erickson
Hmmm, it's not clear to me whether you're using Solr or not, but if you are have you considered using the export functionality? This is already built to stream large result sets back to the client. And lately (5.1), you can combine that with "streaming aggregation" to do some pretty cool stuff. No

custom collector

2015-04-29 Thread Robust Links
Hi I need help porting my lucene code from 4 to 5. In particular, I need to customize a collector (to collect all doc Ids in the index - which can be >30MM docs..). Below is how I achieved this in lucene 4. Is there some guidelines how to do this in lucene 5, specially on semantics changes of Atom

Re: Upgrading from 3.6.1 to 4.3.0 and Custom collector

2013-06-18 Thread Peyman Faratin
Hi Adrien thank you very much. It worked. have a good day On Jun 18, 2013, at 5:35 AM, Adrien Grand wrote: > Hi, > > You didn't say specifically what your problem is so I assume it is > with the following method: > > On Tue, Jun 18, 2013 at 4:37 AM, Peyman Faratin > wrote: >>

Re: Upgrading from 3.6.1 to 4.3.0 and Custom collector

2013-06-18 Thread Adrien Grand
Hi, You didn't say specifically what your problem is so I assume it is with the following method: On Tue, Jun 18, 2013 at 4:37 AM, Peyman Faratin wrote: > public void setNextReader(IndexReader reader, int docBase) > throws IOException{ > this.docBase =

Upgrading from 3.6.1 to 4.3.0 and Custom collector

2013-06-17 Thread Peyman Faratin
Hi I am migrating from Lucene 3.6.1 to 4.3.0. I am however not sure how to migrate my custom collector below to 4.3.0 (this page http://lucene.apache.org/core/4_3_0/MIGRATE.html gives some hints but is the instructions are incomplete and looking at the source examples of custom collectors

Re: Extending TopScoreDocCollector to write a custom collector

2013-01-23 Thread saisantoshi
-write-a-custom-collector-tp4035861p4035869.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h

Extending TopScoreDocCollector to write a custom collector

2013-01-23 Thread saisantoshi
I would like to write a custom collector ( similar to the one which is inside the source of TopScoreDocCollector like InOrderTopScoreDocCollector). The reason for extending this is because InOrderTopScoreDocCollector and OutOfOrderTopScoreDocCollector are private to the class and I really wanted

Re: Combining TopFieldCollector with custom Collector

2010-03-12 Thread Peter Keegan
ier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Peter Keegan [mailto:peterlkee...@gmail.com] > > Sent: Thursday, March 11, 2010 9:41 PM > > To: java-user@lucene.apache.org > > Subject: R

RE: Combining TopFieldCollector with custom Collector

2010-03-12 Thread Uwe Schindler
o: java-user@lucene.apache.org > Subject: Re: Combining TopFieldCollector with custom Collector > > Yes, but none of the other TFC methods would get called because none of > the > TFC classes can be extended. Or am I missing something? > > On Thu, Mar 11, 2010 at 3:

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Michael McCandless
On Thu, Mar 11, 2010 at 4:10 PM, Peter Keegan wrote: > I want the TFC to do all the cool things it does like custom sorting, saving > the field values, max score, etc. I suppose the custom Collector could > explicitly delegate all TFC's methods, but this doesn't seem right. R

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Yonik Seeley
On Thu, Mar 11, 2010 at 4:10 PM, Peter Keegan wrote: > I want the TFC to do all the cool things it does like custom sorting, saving > the field values, max score, etc. I suppose the custom Collector could > explicitly delegate all TFC's methods, but this doesn't seem right.

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Peter Keegan
I want the TFC to do all the cool things it does like custom sorting, saving the field values, max score, etc. I suppose the custom Collector could explicitly delegate all TFC's methods, but this doesn't seem right. Peter On Thu, Mar 11, 2010 at 3:40 PM, Peter Keegan wrote: > Yes

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Peter Keegan
; On Thu, Mar 11, 2010 at 2:30 PM, Peter Keegan > >> wrote: > >> > Is it possible to issue a single search that combines a > TopFieldCollector > >> > (MultiComparatorScoringMaxScoreCollector) with a custom Collector? The > >> > custom Collecto

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Michael McCandless
eter Keegan >> wrote: >> > Is it possible to issue a single search that combines a TopFieldCollector >> > (MultiComparatorScoringMaxScoreCollector) with a custom Collector? The >> > custom Collector just collects the doc IDs into a BitSet (or DocIdSet).

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Peter Keegan
n > wrote: > > Is it possible to issue a single search that combines a TopFieldCollector > > (MultiComparatorScoringMaxScoreCollector) with a custom Collector? The > > custom Collector just collects the doc IDs into a BitSet (or DocIdSet). > The > > collect() methods of

Re: Combining TopFieldCollector with custom Collector

2010-03-11 Thread Michael McCandless
Can you make your own collector and then just delegate internally to TFC? Mike On Thu, Mar 11, 2010 at 2:30 PM, Peter Keegan wrote: > Is it possible to issue a single search that combines a TopFieldCollector > (MultiComparatorScoringMaxScoreCollector) with a custom Collector? The &g

Combining TopFieldCollector with custom Collector

2010-03-11 Thread Peter Keegan
Is it possible to issue a single search that combines a TopFieldCollector (MultiComparatorScoringMaxScoreCollector) with a custom Collector? The custom Collector just collects the doc IDs into a BitSet (or DocIdSet). The collect() methods of the various TopFieldCollectors cannot be overridden