understanding queryNorm
Hi, i wanted to understand how the queryNorm is calculated. i did read similarity documentation of lucene it says it is 1 �C�C�C�C�C�C�C�C�C�C�C�C�C�C sqrt(sumOfSquaredWeights) sumOfSquaredWeights = q.getBoost() 2 ・ ∑ ( idf(t) ・ t.getBoost() ) 2 what would be default q.getBoost() ? ( as i am not giving any value specifically any where in solr). t.getBoost() is 1 in my case as i am not boosting any term at query time. can some one explain with an example if you could ? thank you, vinay _ Send e-mail anywhere. No map, no compass. http://windowslive.com/oneline/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_anywhere_122008
RE: http internal error if i enable debugQuery=on
thank you. Date: Thu, 1 Jan 2009 15:31:44 +0900 From: k...@r.email.ne.jp To: solr-user@lucene.apache.org Subject: Re: http internal error if i enable debugQuery=on Vinay, This is a bug. I opened SOLR-947. The fix will be committed shortly. So please try the next nightly build. Thank you, Koji _ It’s the same Hotmail®. If by “same” you mean up to 70% faster. http://windowslive.com/online/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_broad1_122008
RE: http internal error if i enable debugQuery=on
you mean query term? if so i do have ?q=xyz etc... if not what is that parameter you are talking about?i will send to only one mailing list here on.thanks,vinay Date: Mon, 29 Dec 2008 18:38:33 -0800 From: otis_gospodne...@yahoo.com Subject: Re: http internal error if i enable debugQuery=on To: solr-user@lucene.apache.org Hi, Do you have q=XXX parameter in your URL as well? Try specifying it. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch- Original Message From: vinay kumar kaku vk...@hotmail.com To: solr-user@lucene.apache.org Sent: Monday, December 29, 2008 6:09:24 PM Subject: http internal error if i enable debugQuery=on Hi, i got solr on 23rd dec and using for my application. i have a filter fq=-filtername[1+TO+*] all works fine until i say debugQuery=on i get below error from my tomcat catalina.out logfile. if i change that filter to say fq=-filtername[1+TO+10]debugQuery=on it works fine.HTTP Status 500 - java.lang.NullPointerException: value cannot be null java.lang.RuntimeException: java.lang.NullPointerException: value cannot be null at org.apache.solr.search.QueryParsing.toString(QueryParsing.java:469) at org.apache.solr.handler.component.DebugComponent.process(DebugComponent.java:75) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:179) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:233) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1325) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:568) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) at java.lang.Thread.run(Thread.java:619) Caused by: java.lang.NullPointerException: value cannot be null at org.apache.lucene.document.Field.(Field.java:275) at org.apache.lucene.document.Field.(Field.java:251) at org.apache.solr.search.QueryParsing.writeFieldVal(QueryParsing.java:306) at org.apache.solr.search.QueryParsing.toString(QueryParsing.java:338) at org.apache.solr.search.QueryParsing.toString(QueryParsing.java:401) at org.apache.solr.search.QueryParsing.toString(QueryParsing.java:466) ... 20 more thanks,vinay _ Send e-mail anywhere. No map, no compass. http://windowslive.com/oneline/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_anywhere_122008 _ Send e-mail faster without improving your typing skills. http://windowslive.com/online/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_speed_122008
Hi w.r.t solr 1.4
Hi, is there a stable build of solr 1.4 that i could grab from? vinay _ Send e-mail faster without improving your typing skills. http://windowslive.com/online/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_speed_122008
can i reuse the index built with 1.3 with current solr from trunk
Hi, I have an index thats built using 1.3 (before official release). can i re-use same data with current solr i get from trunk? what are the things that i need to keep in mind.vinay _ Send e-mail anywhere. No map, no compass. http://windowslive.com/oneline/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_anywhere_122008
RE: minimum match issue with dismax
Thank you chris, I tried you suggestion it worked but one more problem for me is that i have defined my request handler in solrConfig.xml as below requestHandler name=dismax class=solr.DisMaxRequestHandler lst name=defaults str name=echoParamsexplicit/str float name=tie0/float str name=qf txt1^1.1 txt2^1.2 txt3^1.3 txt4^1.4 txt5^1.5 /str str name=pf txt4^1.4 txt5^1.5 /str str name=ps1/str str name=bftotal_boost/str str name=mm2lt;-25%/str /lst /requestHandler correct me if i am wrong isn't the above mm config means if its 1 or 2 terms then match all but if its more than 2 terms then 25% can be missing. i get below as parsed query str name=parsedquery_toString+(((txt2:monti^1.2 | txt3:monti^1.3 | txt1:monti^1.1 | txt4:monti^1.4 | txt5:monti^1.5) (txt2:python^1.2 | txt3:python^1.3 | txt1:python^1.1 | txt4:python^1.4 | txt5:python^1.5) (txt2:scandal^1.2 | txt3:scandal^1.3 | txt1:scandal^1.1 | txt4:scandal^1.4 | txt5:scandal^1.5))~3) (txt4:monti python scandal~1^1.4 | txt5:monti python scandal~1^1.5) sum(product(float(total_boost),const(0.7)),60.0/(1.0*float(rord(upload_time))+2.0)) /str if i change str name=mm2lt;-50%/str and do solrCtl restart indexname i don't see any change in parsed query. what am i doing wrong? thanks, vinay Date: Fri, 12 Dec 2008 22:53:13 -0800 From: hossman_luc...@fucit.org To: solr-user@lucene.apache.org Subject: Re: minimum match issue with dismax : do any one know how to make sure minimum match in dismax is working? i : change the values and try doing solrCtl restart indexname but i don't : see it taking into effect. any body have an idea on this? use debugQuery=true, and then look at the parsedquery ... it can be somewhat confusing if you aren't use to it, but for simple testing: don't use a pf, bf, or bq, set qf to a single field, and set tie=0 using the example configs a url like this... http://localhost:8983/solr/select/?tie=0pf=bq=bf=q=first+second+thirdqt=dismaxqf=textmm=50%25debugQuery=true produces... +((DisjunctionMaxQuery((text:first)) DisjunctionMaxQuery((text:second)) DisjunctionMaxQuery((text:third)))~1) () ...that ~1 is the result of computing 50% of 3 rounded down. if i change it to 70%... http://localhost:8983/solr/select/?tie=0pf=bq=bf=q=first+second+thirdqt=dismaxqf=textmm=70%25debugQuery=true ...i get... +((DisjunctionMaxQuery((text:first)) DisjunctionMaxQuery((text:second)) DisjunctionMaxQuery((text:third)))~2) () ...etc. One thing to watch out for is that the ~X syntax only shows you the minNrShouldMath value for boolean queries. for phrase queries it shows you the slop value, and for the individual DisjunctionMaxQueries it shows you the tie breaker value (hence blanking out all those params keeps it simpler and easier to spot the mm value getting used) -Hoss _ You live life online. So we put Windows on the web. http://clk.atdmt.com/MRT/go/127032869/direct/01/
minimum match issue with dismax
Hi, do any one know how to make sure minimum match in dismax is working? i change the values and try doing solrCtl restart indexname but i don't see it taking into effect. any body have an idea on this? thank you vinay _ You live life online. So we put Windows on the web. http://clk.atdmt.com/MRT/go/127032869/direct/01/
multiword query using dismax
Hi, i have this config in my solrconfig.xml requestHandler name=dismax class=solr.DisMaxRequestHandler lst name=defaults str name=echoParamsexplicit/str float name=tie0/float str name=qf field1^1.1 field2^1.2 field3^1.3 field4^1.4 field5^1.5 /str str name=pf field4^1.4 field5^1.5 /str str name=ps1/str str name=mm2lt;-25%/str /lst /requestHandler my query is = monty+python+scandal when i just issue monty+python i get bunch of documents but when i issue monty+python+scandal then i just get 1. isn't the case that i should get documents which match monty+python+scandal then followed by documents that match monty+python or python+scandal or monty+scandal as per mm criteria? can some one explain from above example how many clauses we have ( i think it is 4 since 3 words across five fields and a phrase boost correct me if i am wrong) for minimal match criteria. thanks, vinay _ Suspicious message? There’s an alert for that. http://windowslive.com/Explore/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_broad2_122008
