Re: Large disjunction query practices

2014-06-10 Thread Joe Gresock
They're really just seeking a bulk read of the data. The user has 300K+ terms they want to search in the textual data. It seems to be a pretty rare case. I think your answers have given me some good info. On Mon, Jun 9, 2014 at 9:07 AM, Jack Krupansky wrote: > Are they expecting relevancy ra

Re: Large disjunction query practices

2014-06-10 Thread Gili Nachum
Yes, most cases there would be some other, better, way to accomplish what you're after, share your high level goal. By default, Lucene, and Solr, limit the max number of clauses to 1024, even before that your performance would go down the drain. 1024 On Tue, Jun 10, 2014 at 10:21 AM, Ahmet Ars

Re: Large disjunction query practices

2014-06-10 Thread Ahmet Arslan
Hi, Where are these ORed terms coming from? A user cannot enter this much term. THere are other solutions, joins, post filters etc. You need to tell us your high level goal. On Monday, June 9, 2014 3:51 PM, Joe Gresock wrote: I'm wondering what the best practice for large disjunct queries in

Re: Large disjunction query practices

2014-06-09 Thread Jack Krupansky
Are they expecting relevancy ranking or merely seeking to a bulk read of those documents? Please detail what the user is trying to accomplish with such a monster list of IDs. Generally, queries of more than a few dozen terms are a bad idea. If for no other reason than that if you need to debug