Re: Performance problems with extremely common terms in collection (Solr 7.4)

2019-04-09 Thread Diego Ceccarelli
Another way to make queries faster is, if you can, identify a subset of documents that are in general relevant for the users (most recent ones, most browsed etc etc), index those documents into a separate collection and then query the small collection and back out to the full one if the small one

Re: Performance problems with extremely common terms in collection (Solr 7.4)

2019-04-08 Thread Michael Gibney
In addition to Toke's suggestions (and those in the linked article), some more ideas: If single-term, bare queries are slow, it might be productive to check config/performance of your queryResultCache (I realize this doesn't directly address the concern of slow queries, but might nonetheless be

Re: Performance problems with extremely common terms in collection (Solr 7.4)

2019-04-08 Thread Ash Ramesh
Hi Toke, Thanks for the prompt reply. I'm glad to hear that this is a common problem. In regards to stop words, I've been thinking about trying that out. In our business case, most of these terms are keywords related to stock photography, therefore it's natural for 'photography' or 'background'

Re: Performance problems with extremely common terms in collection (Solr 7.4)

2019-04-08 Thread Toke Eskildsen
On Mon, 2019-04-08 at 09:58 +1000, Ash Ramesh wrote: > We have a corpus of 50+ million documents in our collection. I've > noticed that some queries with specific keywords tend to be extremely > slow. > E.g. the q=`photography' or q='background'. After digging into the > raw documents, I could see

Performance problems with extremely common terms in collection (Solr 7.4)

2019-04-07 Thread Ash Ramesh
Hi everybody, We have a corpus of 50+ million documents in our collection. I've noticed that some queries with specific keywords tend to be extremely slow. E.g. the q=`photography' or q='background'. After digging into the raw documents, I could see that these two terms appear in greater than 90%