Using Solr 8.0.0, single instance, single core, 50m records (38gb  index)
on one SSD, 96gb ram, 16 cores CPU

Most queries run very very fast <1 sec however we have noticed queries
containing "common" words are quite slow sometimes 10+sec , currently using
edismax with 2 text_general fields,. qf, and pf, qs=0,ps=0

I came across these which describe the issue.
https://www.hathitrust.org/blogs/large-scale-search/slow-queries-and-common-words-part-2

https://lucene.apache.org/core/5_5_3/queries/org/apache/lucene/queries/CommonTermsQuery.html

Test queries with issues :
1. things to do in seattle with eric
2. year of the cat
3. time of my life
4. when will i be loved
5. once upon a time in the west

Stopwords are not an option as in the case of #2, if of and the are removed
it essentially destroys relevance.  Is there a common suggested solution to
what would seem to be a common issue besides adding stopwords.

Thank you.
Craig Stadler

Reply via email to