Hi,
We're starting to see issues on a test cluster where Solr breaks up query
string parameters that are either defined in the request handler or are passed
in the URL in the initial request.
In our request handler we have an SF parameter for edismax (SOLR-3925):
<str name="sf">
title_general~2^4
title_nl~2^4
title_en~2^4
title_de~2^4
</str>
Almost all queries pass without issue but some fail because the parameter
arrives in an incorrect format, i've logged several occurences:
2012-12-12 12:01:12,159 ERROR [solr.core.SolrCore] - [http-8080-exec-23] - : org
.apache.solr.common.SolrException: org.apache.solr.search.SyntaxError: Invalid a
rguments for sf, must be sf=FIELD~DISTANCE^BOOST, got
title_general~2^4
title_nl~2^4
title_en~2^4
title_de~2
4
at org.apache.solr.handler.component.QueryComponent.prepare(QueryCompone
nt.java:154)
....
2012-12-12 12:00:57,164 ERROR [solr.core.SolrCore] - [http-8080-exec-1] - : org.
apache.solr.common.SolrException: org.apache.solr.search.SyntaxError: Invalid ar
guments for sf, must be sf=FIELD~DISTANCE^BOOST, got
title_general~2^4
title_nl~2
4
title_en~2^4
title_de~2^4
at org.apache.solr.handler.component.QueryComponent.prepare(QueryCompone
nt.java:154)
....
2012-12-12 12:01:11,223 ERROR [solr.core.SolrCore] - [http-8080-exec-8] - : org.
apache.solr.common.SolrException: org.apache.solr.search.SyntaxError: Invalid ar
guments for sf, must be sf=FIELD~DISTANCE^BOOST, got ^ title_general~2^4
title_nl~2^4
title_en~2^4
title_de~2^4
at org.apache.solr.handler.component.QueryComponent.prepare(QueryCompone
nt.java:154)
....
This seems crazy! For some reason, some times, the parameter get corrupted in
some manner! We've also seen this with a function query in the edismax boost
parameter where for some reasons a comma is replaced by a newline:
2012-12-12 11:11:45,527 ERROR [solr.core.SolrCore] - [http-8080-exec-16] - :
org.apache.solr.common.SolrException: org.apache.solr.search.SyntaxError:
Expected ',' at position 55 in
'if(exists(date),max(recip(ms(NOW/DAY,date),3.17e-8,143
.9),.8),.7)'
at
org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:154)
...
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.solr.search.SyntaxError: Expected ',' at position 55 in
'if(exists(date),max(recip(ms(NOW/DAY,date),3.17e-8,143
.9),.8),.7)'
Accompanying these errors is a number of AIOOBexceptions without stack trace
and Spellchecker NPE's (SOLR-4049). I'm completely puzzled here because it
queries get randomly mangled in some manner. The SF parameter seems to get
mangled only by replacing ^ with a newline. The boost query seems to be mangled
in the same way if it fails. Only about 6% of all queries fired to the cluster
end in such an error.
We're also seeing strange facets returned where two constraints seem to appear
in a single returned value for a field, completely messed up :)
2012-12-12 12:00:56,341 ERROR [handler.component.FacetComponent] -
[http-8080-exec-11] - : Unexpected term returned for facet refining. key=host
term='aandeanderekant.domain.ext^aanoukk.domain.ext'
request
params=spellcheck=false&facet=true&sort=score+desc&tie=0.35&spellcheck.maxCollationTries=2&ps3=5&facet.limit=8&hl.simple.pre=%3Cem%3E&q.alt=*%3A*&distrib=true&facet.method=enum&hl=false&shards.tolerant=true&omitHeader=true&echoParams=none&fl=md_*+title_*+id+type+subcollection+host+cat+date+size+lang&ps2=10&hl.simple.post=%3C%2Fem%3E&spellcheck.count=1&qs=9&spellcheck.alternativeTermCount=1&hl.fragsize=192&mm=80%25&spellcheck.maxResultsForSuggest=12&facet.mincount=1&spellcheck.extendedResults=true&uf=-*&f.host.facet.method=fc&qf=%0A++++++++domain_grams%5E3.7%0A++++++++domain_idx%5E15.9%0A++++++++host_idx%5E2.8%0A++++++++url%5E3.64%0A++++++++content_general%5E1.6+title_general%5E6.4+h1_general%5E5.4+h2_general%5E2.3%0A++++++++content_nl%5E1.6+title_nl%5E6.4+h1_nl%5E5.4+h2_nl%5E2.3%0A++++++++content_en%5E1.6+title_en%5E6.4+h1_en%5E5.4+h2_en%5E2.3%0A++++++++content_de%5E1.6+title_de%5E6.4+h1_de%5E5.4+h2_d
e%5E2.3%0A%0A++++++&sf=%0A++++++++title_general%7E2%5E4%0A++++++++title_nl%7E2%5E4%0A++++++++title_en%7E2%5E4%0A++++++++title_de%7E2%5E4%0A%0A++++++&hl.fl=content_*&json.nl=map&spellcheck.collate=true&wt=json&rows=0&defType=edismax&pf=%0A++++++++content_general%0A++++++++content_nl%0A++++++++content_en%0A++++++++content_de%0A%0A++++++&hl.useFastVectorHighlighter=true&hl.snippets=1&hl.maxAlternateFieldLength=192&facet.sort=count&spellcheck.dictionary=default&hl.alternateField=content_*&ps=25&spellcheck.q=aanvraagformulier+sterabonnement&spellcheck.q=aanvraagformulier+sterabonnement&bqhomepage=homepage%3Atrue&ssi=5b4fc43933c03c4f&ssi=5b4fc43933c03c4f&boost=def%28query%28%24bqhomepage%29%2C.68%29&boost=if%28exists%28date%29%2Cmax%28recip%28ms%28NOW%2FDAY%2Cdate%29%2C3.17e-8%2C143%2C.9%29%2C.8%29%2C.7%29&q=aanvraagformulier+sterabonnement&q=aanvraagformulier+sterabonnement&facet.field=%7B%21terms%3D%24host__terms+ex%3Dhost%7Dhost
&host__terms=nl.wikipedia.org%2Ccorenwilvandee.domain.ext%2Cannevandervelde.domain.ext%2Cbramvantriest.domain.ext%2Cdewilepelaar.domain.ext%2Cdirkenjasper.domain.ext%2Cverslootinqatar.domain.ext%2Cwww.kieskeurig.nl%2Cyvonnetromp.domain.ext%2C2goglobal.domain.ext%2C888888.domain.ext%2Caafkezuidervliet.domain.ext%2Caandeanderekant.domain.ext%2Caanoukk.domain.ext%2Cagdoun.domain.ext%2Caishakuipers.domain.ext%2Cakkelyn.domain.ext%2Calbertinev.domain.ext%2Calexandra1987.domain.ext%2Calva.domain.ext%2Canamika.domain.ext%2Cangelicawibmer.domain.ext%2Cangeliquetijs.domain.ext%2Caniekduyverman.domain.ext%2Cankeroeffen.domain.ext%2Cannekegouw.domain.ext%2Canneliesvanheek.domain.ext%2Canneman.domain.ext%2Cannemiekenlisette.domain.ext%2Cannevelthorst.domain.ext%2Cannewieke.domain.ext%2Canoek82.domain.ext%2Canoukenjulie.domain.ext%2Canoukensjoerd.domain.ext%2Carendenbarbara.domain.ext%2Carieenruubje.domain.ext%2Carindafamilie.domain.ext%2Carjankreeft.domain.ext%2Carletontour.domain.ext
%2Casiatraveller.domain.ext%2Cassistanatlille.domain.ext%2Caukeenannemieke.domain.ext%2Cavontuurlijkediana.domain.ext%2Cbabeth.domain.ext%2Cbartschillings.domain.ext%2Cbartvanhoorn.domain.ext%2Cbasbronsing.domain.ext%2Cbasenalberto.domain.ext%2Cbasinzuidafrika.domain.ext%2Cbelanda.domain.ext%2Cbenjealintokyo.domain.ext%2Cbertenbeasoest.domain.ext%2Cbianca2007.domain.ext%2Cbiancaenleeinmalta.domain.ext%2Cbiancaf.domain.ext%2Cbienekeenrene.domain.ext%2Cbobhendriks.domain.ext%2Cbonke.domain.ext%2Cboontje.domain.ext%2Cbramvanworkum.domain.ext%2Ccaatjevanrijswijk.domain.ext%2Ccelinevd.domain.ext%2Ccharlyn.domain.ext%2Cchelsey.domain.ext%2Cchina2006.domain.ext%2Cchrisenmarleen.domain.ext%2Cchrisvanhaften.domain.ext%2Ccindyverheij.domain.ext%2Cconnyengeorge.domain.ext%2Cconstantijnbrouwer.domain.ext%2Ccostapiet.domain.ext%2Cdaaninzuidafrika.domain.ext%2Cdaniellewillems.domain.ext%2Cdappel.domain.ext%2Cdebbyatbulamu.domain.ext%2Cdiannehofenk.domain.ext%2Cdickenellenoppad.domain.ext%
2Cdickenirene.domain.ext%2Cdidikortekaas.domain.ext%2Cdielange1982.domain.ext%2Cdigigee.domain.ext%2Cdikhuizing.domain.ext%2Cdirkopdefiets.domain.ext%2Cdocent.domain.ext%2Cdorienstraathof.domain.ext%2Cdorijnsuriname.domain.ext%2Cdutchpebble.domain.ext%2Ceddienicole.domain.ext%2Cedenheleen.domain.ext%2Ceelcokarin.domain.ext%2Ceelkeeva.domain.ext%2Celianneansems.domain.ext%2Celkeheurkens.domain.ext%2Cellenenhenkjan.domain.ext%2Celleninnz.domain.ext%2Cellenvandenberg.domain.ext%2Cellisscheinhardt.domain.ext%2Cellyenhans.domain.ext%2Cericenyvonchina.domain.ext%2Cericschuit.domain.ext%2Cestherinoeganda.domain.ext%2Cevamagre.domain.ext%2Ceveliendelijster.domain.ext%2Ceveliensombekke.domain.ext%2Cfajalobi.domain.ext%2Cfeemeel.domain.ext%2Cfemkeennienkeinghana.domain.ext%2Cfennahijlkjealbertine.domain.ext%2Cfernanenlininazie.domain.ext%2Cfleurhinzuidafrika.domain.ext%2Cfop.domain.ext%2Cfranksjak.domain.ext%2Cfudith.domain.ext%2Cganze77venezuela2005.domain.ext%2Cgeerte07.domain.ext%2
Cgeng.domain.ext%2Cgerbenendorien.domain.ext%2Cgertencisca.domain.ext%2Cgewoonmarin.domain.ext%2Cgezien.domain.ext%2Cgieneneric.domain.ext%2Cgrita.domain.ext%2Cguapa.domain.ext%2Cguill.domain.ext%2Channyenhans.domain.ext%2Chanszweers.domain.ext%2Chasaka.domain.ext%2Chegoestochina.domain.ext%2Chenrikepeters.domain.ext%2Chettyvanewijk.domain.ext%2Cils.domain.ext%2Cinganiet.domain.ext%2Cingekortekaas.domain.ext%2Cjacinthameilink.domain.ext%2Cjasperwildenborg.domain.ext%2Cjennieelam.domain.ext%2Cjossmits.domain.ext%2Ckarindekeijzer.domain.ext
toRefine=[Ljava.util.List;@35a76700
response={nl.wikipedia.org=1,corenwilvandee.domain.ext=0,annevandervelde.domain.ext=0,bramvantriest.domain.ext=0,dewilepelaar.domain.ext=0,dirkenjasper.domain.ext=0,verslootinqatar.domain.ext=0,www.kieskeurig.nl=0,yvonnetromp.domain.ext=0,2goglobal.domain.ext=0,888888.domain.ext=0,aafkezuidervliet.domain.ext=0,aandeanderekant.domain.ext^aanoukk.domain.ext=0,agdoun.domain.ext=0,aishakuipers.domain.ext=0,akkelyn.domain.ext=0,albertinev.domain.ext=0,alexandra1987.domain.ext=0,alva.domain.ext=0,anamika.domain.ext=0,angelicawibmer.domain.ext
angeliquetijs.domain.ext=0,aniekduyverman.domain.ext=0,ankeroeffen.domain.ext=0,annekegouw.domain.ext=0,anneliesvanheek.domain.ext=0,anneman.domain.ext=0,annemiekenlisette.domain.ext=0,annevelthorst.domain.ext=0,annewieke.domain.ext=0,anoek82.domain.ext=0,anoukenjulie.domain.ext=0,anoukensjoerd.domain.ext=0,arendenbarbara.domain.ext=0,arieenruubje.domain.ext=0,arindafamilie.domain.ext=0,arjankreeft.domain.ext=0,arletontour.domain.ext=0,asiatraveller.domain.ext=0,assistanatlille.domain.ext=0,aukeenannemieke.domain.ext=0,avontuurlijkediana.domain.ext=0,babeth.domain.ext=0,bartschillings.domain.ext=0,bartvanhoorn.domain.ext=0,basbronsing.domain.ext=0,basenalberto.domain.ext=0,basinzuidafrika.domain.ext=0,belanda.domain.ext=0,benjealintokyo.domain.ext=0,bertenbeasoest.domain.ext=0,bianca2007.domain.ext=0,biancaenleeinmalta.domain.ext=0,biancaf.domain.ext=0,bienekeenrene.domain.ext=0,bobhendriks.domain.ext=0,bon
ke.domain.ext=0,boontje.domain.ext=0,bramvanworkum.domain.ext=0,caatjevanrijswijk.domain.ext=0,celinevd.domain.ext=0,charlyn.domain.ext=0,chelsey.domain.ext=0,china2006.domain.ext=0,chrisenmarleen.domain.ext=0,chrisvanhaften.domain.ext=0,cindyverheij.domain.ext=0,connyengeorge.domain.ext=0,constantijnbrouwer.domain.ext=0,costapiet.domain.ext=0,daaninzuidafrika.domain.ext=0,daniellewillems.domain.ext=0,dappel.domain.ext=0,debbyatbulamu.domain.ext=0,diannehofenk.domain.ext=0,dickenellenoppad.domain.ext=0,dickenirene.domain.ext=0,didikortekaas.domain.ext=0,dielange1982.domain.ext=0,digigee.domain.ext=0,dikhuizing.domain.ext=0,dirkopdefiets.domain.ext=0,docent.domain.ext=0,dorienstraathof.domain.ext=0,dorijnsuriname.domain.ext=0,dutchpebble.domain.ext=0,eddienicole.domain.ext=0,edenheleen.domain.ext=0,eelcokarin.domain.ext=0,eelkeeva.domain.ext=0,elianneansems.domain.ext=0,elkeheurkens.domain.ext=0,ellenenhe
nkjan.domain.ext=0,elleninnz.domain.ext=0,ellenvandenberg.domain.ext=0,ellisscheinhardt.domain.ext=0,ellyenhans.domain.ext=0,ericenyvonchina.domain.ext=0,ericschuit.domain.ext=0,estherinoeganda.domain.ext=0,evamagre.domain.ext=0,eveliendelijster.domain.ext=0,eveliensombekke.domain.ext=0,fajalobi.domain.ext=0,feemeel.domain.ext=0,femkeennienkeinghana.domain.ext=0,fennahijlkjealbertine.domain.ext=0,fernanenlininazie.domain.ext=0,fleurhinzuidafrika.domain.ext=0,fop.domain.ext=0,franksjak.domain.ext=0,fudith.domain.ext=0,ganze77venezuela2005.domain.ext=0,geerte07.domain.ext=0,geng.domain.ext=0,gerbenendorien.domain.ext=0,gertencisca.domain.ext=0,gewoonmarin.domain.ext=0,gezien.domain.ext=0,gieneneric.domain.ext=0,grita.domain.ext=0,guapa.domain.ext=0,guill.domain.ext=0,hannyenhans.domain.ext=0,hanszweers.domain.ext=0,hasaka.domain.ext=0,hegoestochina.domain.ext=0,henrikepeters.domain.ext=0,hettyvanewijk.doma
in.ext=0,ils.domain.ext=0,inganiet.domain.ext=0,ingekortekaas.domain.ext=0,jacinthameilink.domain.ext=0,jasperwildenborg.domain.ext=0,jennieelam.domain.ext=0,jossmits.domain.ext=0,karindekeijzer.domain.ext=0}
Before opening an issue i'd like to know in which direction to look.
Thanks,
Markus
