Re: CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
> > All great advice thanks Michael, have an excellent weekend! Testing the > common grams > -Craig

Re: CommonTerms & slow queries

2019-03-29 Thread Michael Gibney
You might take a look at CommonGramsFilter ( https://lucene.apache.org/solr/guide/6_6/filter-descriptions.html#FilterDescriptions-CommonGramsFilter), especially if you're either not using pf, or if ps=0. An absolute setting of mm=2 strikes me as unusual (though quite possibly appropriate for your

Re: CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
Michael, select/?=12=title+description=once+upon+a+time+in+the+west=*=true=desc=250=20=1=1=title=2=edismax=off=on=json=true "rawquerystring":"once upon a time in the west", "querystring":"once upon a time in the west", "parsedquery":"+(DisjunctionMaxQuery((description:once |

Re: CommonTerms & slow queries

2019-03-29 Thread Michael Gibney
Can you post the query that's actually built for some of these inputs ("parsedquery" or "parsedquery_toString" output included for requests with "debug=query" parameter)? What is performance like if you turn off pf (i.e., no implicit phrase searching)? Michael On Fri, Mar 29, 2019 at 11:53 AM

CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
Using Solr 8.0.0, single instance, single core, 50m records (38gb index) on one SSD, 96gb ram, 16 cores CPU Most queries run very very fast <1 sec however we have noticed queries containing "common" words are quite slow sometimes 10+sec , currently using edismax with 2 text_general fields,. qf,