Urgent | Query Issue with Dismax | Please help
Hi, I am facing very strange issue with query with dismaxrequest. Issue: I am Querying solr for field specific value, Query is returning correct results with Pfqs Cassette Sfqs while it does not work with Pfqs ePub eBook Sfqs. Sample queries: ?q=facetFormat_product_s:Pfqs ePub eBook Sfqs - return correct results ?q=facetFormat_product_s:Pfqs ePub eBook Sfqsqt=dismaxrequest - dose not return results, although field facetFormat_product_s is defined in dismaxrequest Handler of solrconfig.xml ?q=facetFormat_product_s:Pfqs Cassette Sfqsqt=dismaxrequest - return correct results Please suggest if there are issues with dismaxrequest or Query mentioned above. Any help around this, would be of great help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Urgent-%7C-Query-Issue-with-Dismax-%7C-Please-help-tp24114728p24114728.html Sent from the Solr - User mailing list archive at Nabble.com.
Phrase Search Issue
Hi, I am facing one issue in phrase query. I am entering 'Top of the world' as my search criteria. I am expecting it to return all the records in which, one field should all these words in any order. But it is treating as OR and returning all the records, which are having either of these words. I am doing this using dismax request. I would appreciate if somebody can provide me some pointers. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Phrase-Search-Issue-tp23648813p23648813.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Phrase Search Issue
This problem is related with the default operator in dismax. Currently OR is the default operator and it is behaving perfectly fine. I have changed the default operator in schema.xml to AND, I also have changed the minimum match to 100%. But it seems like AND as default operator doesnt work with Dismax. Please suggest. Thanks, Amit Garg dabboo wrote: Hi, I am facing one issue in phrase query. I am entering 'Top of the world' as my search criteria. I am expecting it to return all the records in which, one field should all these words in any order. But it is treating as OR and returning all the records, which are having either of these words. I am doing this using dismax request. I would appreciate if somebody can provide me some pointers. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Phrase-Search-Issue-tp23648813p23649189.html Sent from the Solr - User mailing list archive at Nabble.com.
Strange Phrase Query Issue with Dismax
Hi, I am facing very strange issue on solr, not sure if it is already a bug. If I am searching for 'Top 500' then it returns all the records which contains either of these anywhere, which is fine. But if I search for 'Top 500 Companies' in any order, it gives me all those records, which contains these 3 words in any one of the field, irrespective of sequence. In this case, it is not returning me the records, which contains either of these word (which actually is my requirement). Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Strange-Phrase-Query-Issue-with-Dismax-tp23650114p23650114.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with AND/OR Operator in Dismax Request
Hi, Yeah you are right. Can you please tell me the URL of JIRA. Thanks, Amit Otis Gospodnetic wrote: Amit, That's the same question as the other day, right? Yes, DisMax doesn't play well with Boolean operators. Check JIRA, it has a search box, so you may be able to find related patches. I think the patch I was thinking about is actually for something else - allowing field names to be specified in query string and DixMax handling that correctly. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: dabboo ag...@sapient.com To: solr-user@lucene.apache.org Sent: Wednesday, May 20, 2009 1:35:00 AM Subject: Issue with AND/OR Operator in Dismax Request Hi, I am not getting correct results with a Query which has multiple AND | OR operator. Query Format q=((A AND B) OR (C OR D) OR E) ?q=((intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[3+TO+*])+OR+(intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[0+TO+3])+OR+(ageFrom_product_s:Adult))qt=dismaxrequest Query return correct result without Dismaxrequest, but incorrect results with Dismaxrequest. I have to use dismaxrequest because i need boosting of search results According to some posts there are issues with AND | OR operator with dismaxrequest. Please let me know if anyone has faced the same problem and if there is any way to make the query work with dismaxrequest. I also believe that there is some patch available for this in one of the JIRA. I would appreciate if somebody can let me know the URL, so that I can take a look at the patch. Thanks for the help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Issue-with-AND-OR-Operator-in-Dismax-Request-tp23629269p23629269.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Issue-with-AND-OR-Operator-in-Dismax-Request-tp23629269p23639786.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Query with AND|OR operator with Dismaxrequest
Hi, Thanks for the information. I would appreciate if somebody can share the URL of the JIRA issue. Otis Gospodnetic wrote: Prerna, Yes, DisMax doesn't take in queries with Boolean operators. But I believe there is a patch in JIRA that makes that possible. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: prerna07 pkhandelw...@sapient.com To: solr-user@lucene.apache.org Sent: Monday, May 18, 2009 6:05:50 AM Subject: Query with AND|OR operator with Dismaxrequest Hi, I am not getting correct results with a Query which has multiple AND | OR operator. Query Format q=((A AND B) OR (C OR D) OR E) ?q=((intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[3+TO+*])+OR+(intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[0+TO+3])+OR+(ageFrom_product_s:Adult))qt=dismaxrequest Query return correct result without Dismaxrequest, but incorrect results with Dismaxrequest. I have to use dismaxrequest because i need boosting of search results According to some posts there are issues with AND | OR operator with dismaxrequest. Please let me know if anyone has faced the same problem and if there is any way to make the query work with dismaxrequest. Thanks, Prerna -- View this message in context: http://www.nabble.com/Query-with-AND%7COR-operator-with-Dismaxrequest-tp23594592p23594592.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Query-with-AND%7COR-operator-with-Dismaxrequest-tp23594592p23612577.html Sent from the Solr - User mailing list archive at Nabble.com.
Issue with AND/OR Operator in Dismax Request
Hi, I am not getting correct results with a Query which has multiple AND | OR operator. Query Format q=((A AND B) OR (C OR D) OR E) ?q=((intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[3+TO+*])+OR+(intAgeFrom_product_i:[0+TO+3]+AND+intAgeTo_product_i:[0+TO+3])+OR+(ageFrom_product_s:Adult))qt=dismaxrequest Query return correct result without Dismaxrequest, but incorrect results with Dismaxrequest. I have to use dismaxrequest because i need boosting of search results According to some posts there are issues with AND | OR operator with dismaxrequest. Please let me know if anyone has faced the same problem and if there is any way to make the query work with dismaxrequest. I also believe that there is some patch available for this in one of the JIRA. I would appreciate if somebody can let me know the URL, so that I can take a look at the patch. Thanks for the help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Issue-with-AND-OR-Operator-in-Dismax-Request-tp23629269p23629269.html Sent from the Solr - User mailing list archive at Nabble.com.
Default Query Operator
Hi, Presently OR is the default operator for search in Solr. for e.g. If I am searching for these 2 words with a space: abc xyz then it will return all the records which has either abc or xyz or both. It means it is executing query like abc or xyz. But my requirement is that it should return only those records which contains abc and xyz both i.e. It should execute the query using AND operator as default like abc and xyz. Please suggest how I can do this. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Default-Query-Operator-tp23477955p23477955.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Default Query Operator
Sorry to mention in the problem that I am trying to do this with dismax request. Without dismax request, it is working fine but not with dismax request. Avlesh Singh wrote: Having solrQueryParser defaultOperator=AND/ in your schema.xml should address your requirements. Cheers Avlesh On Mon, May 11, 2009 at 12:18 PM, dabboo ag...@sapient.com wrote: Hi, Presently OR is the default operator for search in Solr. for e.g. If I am searching for these 2 words with a space: abc xyz then it will return all the records which has either abc or xyz or both. It means it is executing query like abc or xyz. But my requirement is that it should return only those records which contains abc and xyz both i.e. It should execute the query using AND operator as default like abc and xyz. Please suggest how I can do this. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Default-Query-Operator-tp23477955p23477955.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Default-Query-Operator-tp23477955p23478820.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Default Query Operator
Hi, I already have done this but still I am not getting any record. But if I remove the qt=dismaxrequest, then it works fine. Erik Hatcher wrote: With dismax, to get all terms required, set mm (minimum match) to 100% Erik On May 11, 2009, at 4:08 AM, dabboo wrote: Sorry to mention in the problem that I am trying to do this with dismax request. Without dismax request, it is working fine but not with dismax request. Avlesh Singh wrote: Having solrQueryParser defaultOperator=AND/ in your schema.xml should address your requirements. Cheers Avlesh On Mon, May 11, 2009 at 12:18 PM, dabboo ag...@sapient.com wrote: Hi, Presently OR is the default operator for search in Solr. for e.g. If I am searching for these 2 words with a space: abc xyz then it will return all the records which has either abc or xyz or both. It means it is executing query like abc or xyz. But my requirement is that it should return only those records which contains abc and xyz both i.e. It should execute the query using AND operator as default like abc and xyz. Please suggest how I can do this. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Default-Query-Operator- tp23477955p23477955.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Default-Query-Operator-tp23477955p23478820.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Default-Query-Operator-tp23477955p23485608.html Sent from the Solr - User mailing list archive at Nabble.com.
Wildcard Search
Hi, I am facing a n wierd issue while searching. I am searching for word *sytem*, it displays all the records which contains system, systems etc. But when I tried to search *systems*, it only returns me those records, which have systems-, systems/ etc etc. It is considering wildcard as 1 or more character and not zero character. So, it is not returning records which has systems has one word. Is there any way to resolve this. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-Search-tp23440795p23440795.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Wildcard Search
Yes, thats correct. I have applied EnglishPorterFilterFactory at index time as well. Do you think, I should remove it and do the indexing again. Erick Erickson wrote: Are you by any chance stemming the field when you index? Erick On Fri, May 8, 2009 at 2:29 AM, dabboo ag...@sapient.com wrote: Hi, I am facing a n wierd issue while searching. I am searching for word *sytem*, it displays all the records which contains system, systems etc. But when I tried to search *systems*, it only returns me those records, which have systems-, systems/ etc etc. It is considering wildcard as 1 or more character and not zero character. So, it is not returning records which has systems has one word. Is there any way to resolve this. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-Search-tp23440795p23440795.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Wildcard-Search-tp23440795p23445966.html Sent from the Solr - User mailing list archive at Nabble.com.
Wildcard with Double Quotes Query
Hi, I am searching for English Portal using double quotes and I am getting all the records which contains English Portal as together anywhere in any field. for e.g. records are appearing which have, English Portal, English Portal Sacromanto, Core English Portal etc. Problem is, if I am passing only nglish Portal then it is not returning any of these results. Is there any way I can pass the wildcards as prefix and suffix with this search string and get the desired results. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-with-Double-Quotes-Query-tp23387746p23387746.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Wildcard with Double Quotes Query
Hi Eric, I searched but couldnt find anything related. I am still looking in some threads to find out if I can get somthing related. I would appreciate if you can please provide me some pointers. Thanks, Amit Garg Erick Erickson wrote: I don't remember the answer, but I'm sure this has been discussed many times on the mailing list. Have you tried searching that? You're essentially asking about wildcarded phrase queries Best Erick On Tue, May 5, 2009 at 9:52 AM, dabboo ag...@sapient.com wrote: Hi, I am searching for English Portal using double quotes and I am getting all the records which contains English Portal as together anywhere in any field. for e.g. records are appearing which have, English Portal, English Portal Sacromanto, Core English Portal etc. Problem is, if I am passing only nglish Portal then it is not returning any of these results. Is there any way I can pass the wildcards as prefix and suffix with this search string and get the desired results. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-with-Double-Quotes-Query-tp23387746p23387746.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Wildcard-with-Double-Quotes-Query-tp23387746p23388979.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Wildcard with Double Quotes Query
I am using dismax request to achieve this. Though I am able to do wildcard search with dismax but I am not sure if I can do the wildcard with phrase. Please suggest. Amit Erick Erickson wrote: I don't remember the answer, but I'm sure this has been discussed many times on the mailing list. Have you tried searching that? You're essentially asking about wildcarded phrase queries Best Erick On Tue, May 5, 2009 at 9:52 AM, dabboo ag...@sapient.com wrote: Hi, I am searching for English Portal using double quotes and I am getting all the records which contains English Portal as together anywhere in any field. for e.g. records are appearing which have, English Portal, English Portal Sacromanto, Core English Portal etc. Problem is, if I am passing only nglish Portal then it is not returning any of these results. Is there any way I can pass the wildcards as prefix and suffix with this search string and get the desired results. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-with-Double-Quotes-Query-tp23387746p23387746.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Wildcard-with-Double-Quotes-Query-tp23387746p23389978.html Sent from the Solr - User mailing list archive at Nabble.com.
Pass Quoted Query to Solr
Hi, I am sending a query to the solr search engine from my application using httpClient. I want to search for a specific title from the available. for e.g. If user wants to search for the book which have titled Complete Java Reference, I am sending this query to Solr having double quotes with the search string. I have encoded the search criteria but it is still giving me Invalid Query Exception. Please suggest as if there is any way to pass this query to Solr. I am not sure though, but can we do this using SolrJ client instead of httpClient. If yes, then how Solrj is handing this kind of request. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Pass-Quoted-Query-to-Solr-tp22911184p22911184.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Pass Double Quotes using SolrJ
My application is using the httpclient. I will have to replace this from solrj client. But do Solrj client supports passing query with double quotes in it. like ?q=Glorious Revolutionqt=dismaxrequest Thanks, Amit Garg Shalin Shekhar Mangar wrote: On Mon, Apr 6, 2009 at 10:56 AM, dabboo ag...@sapient.com wrote: I want to pass double quotes to my solr from the front end, so that it can return the specific results of that particular phrase which is there in double quotes. If I use httpClient, it doesnt allow me to send the query in this format. As it throws me an invalid query exception. I want to know, if I can do this with SolrJ Client. If yes, can somebody please let me know as how SolrJ is doing this and parsing this type of query. Amit, look at http://lucene.apache.org/java/2_4_0/queryparsersyntax.html#Escaping%20Special%20Charactersfor the list of characters that need to be escaped. Look at ClientUtils.escapeQueryChars() method in Solrj. I'm curious to know why you are trying to roll your own solr client when Solrj exists? -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Pass-Double-Quotes-using-SolrJ-tp22902404p22912443.html Sent from the Solr - User mailing list archive at Nabble.com.
Pass Double Quotes using SolrJ
Hi, I want to pass double quotes to my solr from the front end, so that it can return the specific results of that particular phrase which is there in double quotes. If I use httpClient, it doesnt allow me to send the query in this format. As it throws me an invalid query exception. I want to know, if I can do this with SolrJ Client. If yes, can somebody please let me know as how SolrJ is doing this and parsing this type of query. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Pass-Double-Quotes-using-SolrJ-tp22902404p22902404.html Sent from the Solr - User mailing list archive at Nabble.com.
Phrase Query Issue
Hi, I am implementing phrase search query using my application. I am trying to search Glorious Revolution, I am expecting all the records which contains this as whole string in any of its field should display. Below is my query: ?q=fieldname:Glorious Revolutionqt=dismaxrequest I am passing this to my solr search engine using httpclient. But it is thrwoing me Invaild Query exception. If I append double quotes with backslash, it passes the query but it doesnt shows the right values. Instead it creates the query like: isbn13_product_s:\Glorious Revolution\ Please suggest how I should tackle this. If I give the phrase search in my solr console, it returns me the correct results. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Phrase-Query-Issue-tp22863529p22863529.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Phrase Query Issue
Erik, Thanks a lot for your reply. I have made some changes in the solr code and now field clauses are working fine with dismax request. Not only this, wildcard characters are also working with dismax and q query parameter. If you want I can share modified code with you. Thanks, Amit Garg Erik Hatcher wrote: Also note that the dismax parser does NOT support fielded clauses, so fieldname:some phrase is not parsed as you might expect with dismax. Erik On Apr 3, 2009, at 3:41 AM, dabboo wrote: Hi, I am implementing phrase search query using my application. I am trying to search Glorious Revolution, I am expecting all the records which contains this as whole string in any of its field should display. Below is my query: ?q=fieldname:Glorious Revolutionqt=dismaxrequest I am passing this to my solr search engine using httpclient. But it is thrwoing me Invaild Query exception. If I append double quotes with backslash, it passes the query but it doesnt shows the right values. Instead it creates the query like: isbn13_product_s:\Glorious Revolution\ Please suggest how I should tackle this. If I give the phrase search in my solr console, it returns me the correct results. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Phrase-Query-Issue-tp22863529p22863529.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Phrase-Query-Issue-tp22863529p22880202.html Sent from the Solr - User mailing list archive at Nabble.com.
Issue in Range Search Query
Hi, I am searching for all the records in the index where author's last name starts with a or b. I am giving my query like au_last_name:[a* TO b*] But it is returning all the other records where last name starts with E, P or other letter. Please suggest how I can achieve this. I dont want to hit solr 2 times. Because in future it could be the case, if I have to search for a to z. Also, is there any way I can get individual count of records starting with one particular alphabet. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Issue-in-Range-Search-Query-tp22798861p22798861.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Not getting the proper result.
Did you try creating your indexes again after modifying the schema.xml The way Solr search is, whatever string you have Radha C. wrote: Thanks Grant, I used the analysis page in the example, the StandardTokenizerFactory does not split by dots, It is passing the L.I.C as it is to solr.StandardFilterFactory and this Filter class also did not split or remove the dots. My question is I read in the wiki page ( http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters ) that the StandardFilterFactory class removes dots and provides LIC . But it is not working as mentioned in wiki page. Am I missing anything here? Please suggest me What went wrong with my below schema.xml. -Original Message- From: Grant Ingersoll [mailto:gsing...@apache.org] Sent: Monday, March 30, 2009 7:46 PM To: solr-user@lucene.apache.org Subject: Re: Not getting the proper result. The StandardTokenizer splits on punctuation, so L.I.C. is likely becoming 'l', 'i', 'c', while LIC - lic. One helpful tool is the Analysis page on the Solr admin: http://localhost:8983/solr/admin/analysis.jsp as it can help you figure out what is going on with analysis on both the query and indexing side. HTH, Grant On Mar 30, 2009, at 7:50 AM, Radha C. wrote: Hi, I am having following analyzer set up in schema.xml fieldType name=text class=solr.TextField positionIncrementGap=100 analyzer tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.StandardFilterFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType I am indexing a database field which contains L.I.C and I am trying to search the field as follows but getting zero response. http://localhost:8080/solr/select/?q=LIC http://localhost:8080/solr/select/?q=LICdebugQuery=on debugQuery=on and http://localhost:8080/solr/select/?q=lic http://localhost:8080/solr/select/?q=licdebugQuery=on debugQuery=on But it is giving result for q=L.I.C It is not identifying the L.I.C and lic . what is the wrong here? can anyone help me ? Thanks -- View this message in context: http://www.nabble.com/Not-getting-the-proper-result.-tp22781710p22800476.html Sent from the Solr - User mailing list archive at Nabble.com.
How to take Index Backup
Hi, I have to take backup of the indexes, which are there in my solr server. I know that we will have to give the target path in scripts.conf file, but I want to know below things. 1. What is the userId to be given in scripts.conf file. 2. How where to run the scripts given in bin folder under solr? 3. Where to mention if we want to take the back up of indexes under a particular core or all the indexes under all cores? Thanks, Amit Garg -- View this message in context: http://www.nabble.com/How-to-take-Index-Backup-tp22736224p22736224.html Sent from the Solr - User mailing list archive at Nabble.com.
Issue with Facet Query
Hi, I am searching the indexes with facet query. Below is the query. q=Answerversion=2.2start=0rows=10indent=onqt=dismaxrequestfacet=truefacet.field=productPrice_product_str_s:[0%20TO%2020] It is giving me an exception saying: str name=exceptionorg.apache.solr.common.SolrException: undefined field productPrice_product_str_s:[0 TO 20] at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:994) at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:152) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:182) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:96) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:70) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:169) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) at org.apache.solr.core.SolrCore.execute Can someone please guide me, how to prevent this exception. I guess, I am missing some entries in some config file like solrConfig or schema. I would appreciate if someone can tell me the specific entries, I need to make in any config file. Thanks a lot. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22615577.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with Facet Query
Thanks a lot for this information. But is there any way, I can impose the range on the facet. for e.g. If I want to search the data between a specific range, how should I form my query. Do I need to make some entries some where. Thanks, Amit Garg Shalin Shekhar Mangar wrote: On Fri, Mar 20, 2009 at 1:14 PM, dabboo ag...@sapient.com wrote: Hi, I am searching the indexes with facet query. Below is the query. q=Answerversion=2.2start=0rows=10indent=onqt=dismaxrequestfacet=truefacet.field=productPrice_product_str_s:[0%20TO%2020] facet.field takes a field name. It does not accept queries. Use facet.query for getting count of a query. Use fq to restrict facets by a certain query. See http://wiki.apache.org/solr/SimpleFacetParameters -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22615979.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with Facet Query
Shalin, thanks a lot. One quick question: Now, after putting the query in the way, you suggested, I am getting: - lst name=facet_counts - lst name=facet_queries int name=productPrice_product_s:[0 TO 20]23315/int /lst lst name=facet_fields / lst name=facet_dates / /lst But it is not returning me records. Do I need to enter this field entry in schema.xml to get the records or anywhere else. Thanks, Amit Garg Shalin Shekhar Mangar wrote: On Fri, Mar 20, 2009 at 1:49 PM, dabboo ag...@sapient.com wrote: Thanks a lot for this information. But is there any way, I can impose the range on the facet. for e.g. If I want to search the data between a specific range, how should I form my query. Use a filter query, fq=productPrice_product_str_s:[0 TO 20] -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22616536.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with Facet Query
Thanks Shalin, thanks a lot. I appreciate your help in resolving this issue. Thanks, Amit Shalin Shekhar Mangar wrote: On Fri, Mar 20, 2009 at 2:27 PM, dabboo ag...@sapient.com wrote: Shalin, thanks a lot. One quick question: Now, after putting the query in the way, you suggested, I am getting: - lst name=facet_counts - lst name=facet_queries int name=productPrice_product_s:[0 TO 20]23315/int /lst lst name=facet_fields / lst name=facet_dates / /lst But it is not returning me records. Do I need to enter this field entry in schema.xml to get the records or anywhere else. facet.query returns the number of documents matching that query after applying any filters (fq) that you may have specified. Can you tell us your use-case? -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22616724.html Sent from the Solr - User mailing list archive at Nabble.com.
Facet Query Results Issue
Hi, this is my facet query. facet.field=productPrice_product_str_sfacet.query=productPrice_product_str_s:[0%20TO%20100] This is my query and these are results, I am getting: int name=100202/int int name=1057/int int name=10.614/int int name=10.211/int int name=10.6710/int int name=10.89/int int name=10.999/int int name=1.337/int int name=16/int int name=10.45/int int name=10.344/int int name=1.012/int int name=1.22/int int name=1.662/int int name=10.632/int int name=10.662/int int name=1.41/int int name=1.71/int int name=1.81/int int name=10.331/int int name=10.751/int int name=10.91/int int name=.010/int int name=.20/int int name=100.050/int int name=100.070/int int name=100.130/int int name=100.20/int int name=100.250/int int name=100.330/int int name=100.40/int int name=100.450/int int name=100.530/int int name=100.60/int int name=100.670/int int name=100.730/int int name=100.80/int int name=100.870/int int name=100.950/int int name=100.960/int int name=1010/int int name=101.10/int int name=101.130/int int name=101.20/int int name=101.270/int int name=101.330/int int name=101.40/int int name=101.470/int int name=101.60/int int name=101.670/int int name=101.730/int int name=101.80/int int name=101.870/int int name=1020/int int name=102.070/int int name=102.190/int int name=102.20/int int name=102.270/int int name=102.330/int int name=102.40/int int name=102.530/int int name=102.60/int int name=102.670/int int name=102.80/int int name=102.870/int int name=102.930/int int name=1022.40/int int name=1030/int It is only returning results, which are having values started with 2, 3, 4 or some other integer instead of only 1. It is not returning records in which value is 10 and 100. Please suggest. thanks, Amit -- View this message in context: http://www.nabble.com/Facet-Query-Results-Issue-tp22617883p22617883.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with Facet Query
Hi Shalin, One more thing, facet.field=productPrice_product_str_sfacet.query=productPrice_product_str_s:[0%20TO%20100] This is my query and these are results, I am getting: int name=100202/int int name=1057/int int name=10.614/int int name=10.211/int int name=10.6710/int int name=10.89/int int name=10.999/int int name=1.337/int int name=16/int int name=10.45/int int name=10.344/int int name=1.012/int int name=1.22/int int name=1.662/int int name=10.632/int int name=10.662/int int name=1.41/int int name=1.71/int int name=1.81/int int name=10.331/int int name=10.751/int int name=10.91/int int name=.010/int int name=.20/int int name=100.050/int int name=100.070/int int name=100.130/int int name=100.20/int int name=100.250/int int name=100.330/int int name=100.40/int int name=100.450/int int name=100.530/int int name=100.60/int int name=100.670/int int name=100.730/int int name=100.80/int int name=100.870/int int name=100.950/int int name=100.960/int int name=1010/int int name=101.10/int int name=101.130/int int name=101.20/int int name=101.270/int int name=101.330/int int name=101.40/int int name=101.470/int int name=101.60/int int name=101.670/int int name=101.730/int int name=101.80/int int name=101.870/int int name=1020/int int name=102.070/int int name=102.190/int int name=102.20/int int name=102.270/int int name=102.330/int int name=102.40/int int name=102.530/int int name=102.60/int int name=102.670/int int name=102.80/int int name=102.870/int int name=102.930/int int name=1022.40/int int name=1030/int It is only returning results, which are having values started with 2, 3, 4 or some other integer instead of only 1. It is not returning records in which value is 10 and 100. Please suggest. thanks, Amit dabboo wrote: Thanks Shalin, thanks a lot. I appreciate your help in resolving this issue. Thanks, Amit Shalin Shekhar Mangar wrote: On Fri, Mar 20, 2009 at 2:27 PM, dabboo ag...@sapient.com wrote: Shalin, thanks a lot. One quick question: Now, after putting the query in the way, you suggested, I am getting: - lst name=facet_counts - lst name=facet_queries int name=productPrice_product_s:[0 TO 20]23315/int /lst lst name=facet_fields / lst name=facet_dates / /lst But it is not returning me records. Do I need to enter this field entry in schema.xml to get the records or anywhere else. facet.query returns the number of documents matching that query after applying any filters (fq) that you may have specified. Can you tell us your use-case? -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22617745.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Issue with Facet Query
I am using this query only but I am getting the same results. facet=truefacet.field=productPrice_product_str_sfq=productPrice_product_str_s:[1%20TO%20100] - lst name=facet_fields - lst name=productPrice_product_str_s int name=100202/int int name=1057/int int name=10.614/int int name=10.211/int int name=10.6710/int int name=10.89/int int name=10.999/int int name=1.337/int int name=16/int int name=10.45/int int name=10.344/int int name=1.012/int int name=1.22/int int name=1.662/int int name=10.632/int int name=10.662/int int name=1.41/int int name=1.71/int int name=1.81/int int name=10.331/int int name=10.751/int int name=10.91/int int name=.010/int int name=.20/int int name=00/int int name=100.050/int int name=100.070/int int name=100.130/int int name=100.20/int int name=100.250/int int name=100.330/int int name=100.40/int int name=100.450/int int name=100.530/int int name=100.60/int int name=100.670/int int name=100.730/int int name=100.80/int int name=100.870/int int name=100.950/int int name=100.960/int int name=1010/int int name=101.10/int int name=101.130/int int name=101.20/int int name=101.270/int int name=101.330/int int name=101.40/int int name=101.470/int int name=101.60/int int name=101.670/int int name=101.730/int int name=101.80/int int name=101.870/int It still is not showing up the other values. Do I need to make any entry in schema or solrConfig xml files. Do I need to convert the string into numeric values etc etc. Please suggest. Thanks, Amit Shalin Shekhar Mangar wrote: On Fri, Mar 20, 2009 at 4:00 PM, dabboo ag...@sapient.com wrote: Hi Shalin, One more thing, facet.field=productPrice_product_str_sfacet.query=productPrice_product_str_s:[0%20TO%20100] This is my query and these are results, I am getting: int name=100202/int int name=1057/int int name=10.614/int int name=10.211/int int name=10.6710/int int name=10.89/int int name=10.999/int int name=1.337/int int name=16/int int name=10.45/int int name=10.344/int int name=1.012/int int name=1.22/int int name=1.662/int int name=10.632/int int name=10.662/int int name=1.41/int int name=1.71/int int name=1.81/int int name=10.331/int int name=10.751/int int name=10.91/int int name=.010/int int name=.20/int int name=100.050/int int name=100.070/int int name=100.130/int int name=100.20/int int name=100.250/int int name=100.330/int int name=100.40/int int name=100.450/int int name=100.530/int int name=100.60/int int name=100.670/int int name=100.730/int int name=100.80/int int name=100.870/int int name=100.950/int int name=100.960/int int name=1010/int int name=101.10/int int name=101.130/int int name=101.20/int int name=101.270/int int name=101.330/int int name=101.40/int int name=101.470/int int name=101.60/int int name=101.670/int int name=101.730/int int name=101.80/int int name=101.870/int int name=1020/int int name=102.070/int int name=102.190/int int name=102.20/int int name=102.270/int int name=102.330/int int name=102.40/int int name=102.530/int int name=102.60/int int name=102.670/int int name=102.80/int int name=102.870/int int name=102.930/int int name=1022.40/int int name=1030/int It is only returning results, which are having values started with 2, 3, 4 or some other integer instead of only 1. It is not returning records in which value is 10 and 100. Please do not send a duplicate mails. It will not help you get an answer faster. If you need to filter results to a specific range then you should use filter queries through the fq parameter: fq=productPrice_product_str_s:[0%20TO%20100] -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Issue-with-Facet-Query-tp22615577p22618714.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Problem with Facet Date Query
Thanks Eric. But where in schema.xml, I will have to give this value and how. Erik Hatcher wrote: On Mar 19, 2009, at 1:57 AM, dabboo wrote: This is my query: q=productPublicationDate_product_dt:[*%20TO %20NOW]facet=truefacet.field=productPublicationDate_product_dt:[* %20TO%20NOW]qt=dismaxrequest This is exception, I am facing after running this query. - lst name=facet_counts lst name=facet_queries / str name=exceptionorg.apache.solr.common.SolrException: undefined field productPublicationDate_product_dt:[* TO NOW] at Note the error message here str name=facet.queryproductPublicationDate_product_dt:[* TO NOW/DAY-1MONTH]^2.2/str /lst Do I need to do something else to run this query. Yes, you need to define that field in schema.xml Also note that the boosting on that query isn't going to give you anything useful - all you get back from that facet.query is a single count of matching documents. Erik -- View this message in context: http://www.nabble.com/Problem-with-Facet-Date-Query-tp22594164p22596450.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Index Creation Exception in solr
But if I already have some indexes in the index folder then these old indexes will also get deleted. Is there any way to roll back the operation. Shalin Shekhar Mangar wrote: On Wed, Mar 18, 2009 at 3:15 PM, dabboo ag...@sapient.com wrote: Hi, I am creating indexes in Solr and facing an unusual issue. I am creating 5 indexes and xml file of 4th index is malformed. So, while creating indexes it properly submits index #1, 2 3 and throws exception after submission of index 4. I think you mean documents not indexes. Each document goes into the Lucene/Solr index. Now, if I look for index #1,2 3, it doesnt show up, which I think is happening because the operation is not committed yet. But these indexes must be lying somewhere temporarily in the Solr and I am not able to delete these indexes. Just delete the your_solr_home/data/index directory. -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Index-Creation-Exception-in-solr-tp22575618p22576093.html Sent from the Solr - User mailing list archive at Nabble.com.
Index Creation Exception in solr
Hi, I am creating indexes in Solr and facing an unusual issue. I am creating 5 indexes and xml file of 4th index is malformed. So, while creating indexes it properly submits index #1, 2 3 and throws exception after submission of index 4. Now, if I look for index #1,2 3, it doesnt show up, which I think is happening because the operation is not committed yet. But these indexes must be lying somewhere temporarily in the Solr and I am not able to delete these indexes. Please suggest as where I can find these indexes and delete them. Thanks, Amit -- View this message in context: http://www.nabble.com/Index-Creation-Exception-in-solr-tp22575618p22575618.html Sent from the Solr - User mailing list archive at Nabble.com.
Problem with Facet Date Query
Hi, I want to use date field with facet query. This is my query: q=productPublicationDate_product_dt:[*%20TO%20NOW]facet=truefacet.field=productPublicationDate_product_dt:[*%20TO%20NOW]qt=dismaxrequest This is exception, I am facing after running this query. - lst name=facet_counts lst name=facet_queries / str name=exceptionorg.apache.solr.common.SolrException: undefined field productPublicationDate_product_dt:[* TO NOW] at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:994) at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:152) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:182) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:96) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:70) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:169) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1232) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) at java.lang.Thread.run(Unknown Source)/str /lst I have entered this field in solrConfig.xml also in the below manner. lst name=invariants str name=facet.fieldcat/str str name=facet.fieldmanu_exact/str str name=facet.queryprice:[* TO 500]/str str name=facet.queryprice:[500 TO *]/str str name=facet.queryproductPublicationDate_product_dt:[* TO NOW/DAY-1MONTH]^2.2/str /lst Do I need to do something else to run this query. I mean if I need to change something in config file or to change my query. Please help. thanks. Amit Garg -- View this message in context: http://www.nabble.com/Problem-with-Facet-Date-Query-tp22594164p22594164.html Sent from the Solr - User mailing list archive at Nabble.com.
Lemmatisation search in Solr
Hi, I am implementing Lemmatisation in Solr, which means if user looks for Mouse then it should display results of Mouse and Mice both. I understand that this is something context search. I think of using synonym for this but then synonyms.txt will be having so many records and this will keep on adding. Please suggest how I can implement it in some other way. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Lemmatisation-search-in-Solr-tp22555854p22555854.html Sent from the Solr - User mailing list archive at Nabble.com.
Special Characters search in solr
Hi, I am searching with any query string, which contains special characters like è in it. for e.g. If I search for tèst then it shud return all the results which contains tèst and test etc. There are other special characters also. I have updated my server.xml file of tomcat server and included UTF-8 as encoding type in the server entry but still it is not working. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Special-Characters-search-in-solr-tp22557230p22557230.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Lemmatisation search in Solr
stemming and synonyms are working fine in the application but these are working individually. I guess I will need to add the values in synomyms.txt to achieve it. Am I right? Actually its the project requirement to implement the lemmatisation. I also looked out for lemmatisation but couldnt get any. Thanks, Amit Grant Ingersoll-6 wrote: Have you looked for any open source lemmatizers? I didn't find any in a quick search, but there probably are some out there. Also, is there a particular reason you are after lemmatization instead of stemming? Maybe a light stemmer plus synonyms might suffice? On Mar 17, 2009, at 6:02 AM, dabboo wrote: Hi, I am implementing Lemmatisation in Solr, which means if user looks for Mouse then it should display results of Mouse and Mice both. I understand that this is something context search. I think of using synonym for this but then synonyms.txt will be having so many records and this will keep on adding. Please suggest how I can implement it in some other way. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Lemmatisation-search-in-Solr-tp22555854p22555854.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Lemmatisation-search-in-Solr-tp22555854p22558113.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Special Characters search in solr
This is the entry in schema.xml fieldType name=text class=solr.TextField positionIncrementGap=100 omitNorms=true analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ !--tokenizer class=solr.HTMLStripWhitespaceTokenizerFactory /-- !-- in this example, we will only use synonyms at query time filter class=solr.SynonymFilterFactory synonyms=index_synonyms.txt ignoreCase=true expand=false/ -- !-- Case insensitive stop word removal. enablePositionIncrements=true ensures that a 'gap' is left to allow for accurate phrase queries. -- filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt enablePositionIncrements=true / filter class=solr.ISOLatin1AccentFilterFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=1 catenateNumbers=1 catenateAll=0 splitOnCaseChange=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EnglishPorterFilterFactory protected=protwords.txt/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ analyzer class=org.apache.lucene.analysis.ru.RussianAnalyzer/ /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.ISOLatin1AccentFilterFactory/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=0 catenateNumbers=0 catenateAll=0 splitOnCaseChange=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EnglishPorterFilterFactory protected=protwords.txt/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ !--analyzer class=org.apache.lucene.analysis.ru.RussianAnalyzer/-- filter class=solr.ShingleFilterFactory outputUnigrams=true outputUnigramIfNoNgram=true maxShingleSize=99/ /analyzer /fieldType dabboo wrote: I have added this filter factory in my schema.xml also but still that is not working. I am sorry but I didnt get as how to create the field to handle the accents. Please help. Grant Ingersoll-6 wrote: You will need to create a field that handles the accents in order to do this. Start by looking at the ISOLatin1AccentFilter. -Grant On Mar 17, 2009, at 7:31 AM, dabboo wrote: Hi, I am searching with any query string, which contains special characters like è in it. for e.g. If I search for tèst then it shud return all the results which contains tèst and test etc. There are other special characters also. I have updated my server.xml file of tomcat server and included UTF-8 as encoding type in the server entry but still it is not working. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Special-Characters-search-in-solr-tp22557230p22557230.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Special-Characters-search-in-solr-tp22557230p22558353.html Sent from the Solr - User mailing list archive at Nabble.com.
Lemmatisation in Solr
Hi, I want to implement lemmatisation in solr search engine. Can someone please let me know how to achieve the same. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Lemmatisation-in-Solr-tp22532678p22532678.html Sent from the Solr - User mailing list archive at Nabble.com.
Linguistic Variations in Solr
Hi, I am implementing linguistic variations in solr search engine. I want to implement this for US/UK/CA/AU english. e.g. Color (UK) = Colour (US) when user searches for either of the word, both results should appear. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Linguistic-Variations-in-Solr-tp22532781p22532781.html Sent from the Solr - User mailing list archive at Nabble.com.
Multiple languages support in Solr
Hi, I am implementing multiple language support feature with solr. My requirement is to support US/UK/CA/AU english within the search. for e.g. if there are 2 records, one with COLOR (UK) and COLOUR (US), then both the records should display whenever user searches with either of the word. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Multiple-languages-support-in-Solr-tp22534096p22534096.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Linguistic Variations in Solr
Hi, Synonym is a good option but there may be so many words which sounds similiar in different languages but spell differently. Is there any way I can achieve how to implement it. Thanks, Amit Garg Otis Gospodnetic wrote: Amit, Have you considered using synonyms? Info on the Wiki. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: dabboo ag...@sapient.com To: solr-user@lucene.apache.org Sent: Monday, March 16, 2009 3:04:54 AM Subject: Linguistic Variations in Solr Hi, I am implementing linguistic variations in solr search engine. I want to implement this for US/UK/CA/AU english. e.g. Color (UK) = Colour (US) when user searches for either of the word, both results should appear. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Linguistic-Variations-in-Solr-tp22532781p22532781.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Linguistic-Variations-in-Solr-tp22532781p22552612.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to correctly boost results in Solr Dismax query
Hi Pete, bq parameter works with q,alt query parameter. If you are passing the search criteria using q.alt query parameter then this bq parameter comes into picture. Also, q.alt doesnt support field boosting. If you want to boost the records with their field value then you must use q query parameter instead of q.alt. 'q' parameter actually uses qf parameters from solrConfig for field boosting. Let me know if you have any questions. Thanks, Amit Garg Pete Smith-3 wrote: Hi, I have managed to build an index in Solr which I can search on keyword, produce facets, query facets etc. This is all working great. I have implemented my search using a dismax query so it searches predetermined fields. However, my results are coming back sorted by score which appears to be calculated by keyword relevancy only. I would like to adjust the score where fields have pre-determined values. I think I can do this with boost query and boost functions but the documentation here: http://wiki.apache.org/solr/DisMaxRequestHandler#head-6862070cf279d9a09bdab971309135c7aea22fb3 Is not particularly helpful. I tried adding adding a bq argument to my search: bq=media:DVD^2 (yes, this is an index of films!) but I find when I start adding more and more: bq=media:DVD^2bq=media:BLU-RAY^1.5 I find the negative results - e.g. films that are DVD but are not BLU-RAY get negatively affected in their score. In the end it all seems to even out and my score is as it was before i started boosting. I must be doing this wrong and I wonder whether boost function comes in somewhere. Any ideas on how to correctly use boost? Cheers, Pete -- Pete Smith Developer No.9 | 6 Portal Way | London | W3 6RU | T: +44 (0)20 8896 8070 | F: +44 (0)20 8896 8111 LOVEFiLM.com -- View this message in context: http://www.nabble.com/How-to-correctly-boost-results-in-Solr-Dismax-query-tp22476204p22490850.html Sent from the Solr - User mailing list archive at Nabble.com.
Two way Synonyms in Solr
Hi, I am implementing 2 way synonyms in solr using q query parameter. One way synonym is working fine with q query parameter but 2 way is not working. for e.g. If I defined 2 way synonyms in the file like: value1, value2 It doesnt show any result for either of the value. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Two-way-Synonyms-in-Solr-tp22492439p22492439.html Sent from the Solr - User mailing list archive at Nabble.com.
Phrase Synonyms in solr
Hi, Can someone please tell me how to implement phrase synonyms in solr. Thanks, Amit -- View this message in context: http://www.nabble.com/Phrase-Synonyms-in-solr-tp22492440p22492440.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to correctly boost results in Solr Dismax query
Pete, Sorry, if wasnt clear. Here is the explanation. Suppose you have 2 records and they have films and media as 2 columns. Now first record has values like films=Indiana and media=blue ray and 2nd record has values like films=Bond and media=Indiana Values for qf parameters str name=qfmedia^2.0 films^1.0/str Now, search for q=Indiana .. it should display both of the records but record #2 will display above than the 1st. Let me know if you still have questions. Cheers, amit Pete Smith-3 wrote: Hi Amit, Thanks very much for your reply. What you said makes things a bit clearer but I am still a bit confused. On Thu, 2009-03-12 at 23:14 -0700, dabboo wrote: If you want to boost the records with their field value then you must use q query parameter instead of q.alt. 'q' parameter actually uses qf parameters from solrConfig for field boosting. From the documentation for Dismax queries, I thought that q is simply a keyword parameter: From http://wiki.apache.org/solr/DisMaxRequestHandler: q The guts of the search defining the main query. This is designed to be support raw input strings provided by users with no special escaping. '+' and '-' characters are treated as mandatory and prohibited modifiers for the subsequent terms. Text wrapped in balanced quote characters '' are treated as phrases, any query containing an odd number of quote characters is evaluated as if there were no quote characters at all. Wildcards in this q parameter are not supported. And I thought 'qf' is a list of fields and boost scores: From http://wiki.apache.org/solr/DisMaxRequestHandler: qf (Query Fields) List of fields and the boosts to associate with each of them when building DisjunctionMaxQueries from the user's query. The format supported is fieldOne^2.3 fieldTwo fieldThree^0.4, which indicates that fieldOne has a boost of 2.3, fieldTwo has the default boost, and fieldThree has a boost of 0.4 ... this indicates that matches in fieldOne are much more significant than matches in fieldTwo, which are more significant than matches in fieldThree. But if I want to, say, search for films with 'indiana' in the title, with media=DVD scoring higher than media=BLU-RAY then do I need to do something like: solr/select?q=indiana And in my config: str name=qfmedia^2/str But I don't see where the actual *contents* of the media field would determine the boost. Sorry if I have misunderstood what you mean. Cheers, Pete Pete Smith-3 wrote: Hi, I have managed to build an index in Solr which I can search on keyword, produce facets, query facets etc. This is all working great. I have implemented my search using a dismax query so it searches predetermined fields. However, my results are coming back sorted by score which appears to be calculated by keyword relevancy only. I would like to adjust the score where fields have pre-determined values. I think I can do this with boost query and boost functions but the documentation here: http://wiki.apache.org/solr/DisMaxRequestHandler#head-6862070cf279d9a09bdab971309135c7aea22fb3 Is not particularly helpful. I tried adding adding a bq argument to my search: bq=media:DVD^2 (yes, this is an index of films!) but I find when I start adding more and more: bq=media:DVD^2bq=media:BLU-RAY^1.5 I find the negative results - e.g. films that are DVD but are not BLU-RAY get negatively affected in their score. In the end it all seems to even out and my score is as it was before i started boosting. I must be doing this wrong and I wonder whether boost function comes in somewhere. Any ideas on how to correctly use boost? Cheers, Pete -- Pete Smith Developer No.9 | 6 Portal Way | London | W3 6RU | T: +44 (0)20 8896 8070 | F: +44 (0)20 8896 8111 LOVEFiLM.com -- Pete Smith Developer No.9 | 6 Portal Way | London | W3 6RU | T: +44 (0)20 8896 8070 | F: +44 (0)20 8896 8111 LOVEFiLM.com -- View this message in context: http://www.nabble.com/How-to-correctly-boost-results-in-Solr-Dismax-query-tp22476204p22493646.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to correctly boost results in Solr Dismax query
Pete, bq works only with q.alt query and not with q queries. So, in your case you would be using qf parameter for field boosting, you will have to give both the fields in qf parameter i.e. both title and media. try this str name=qfmedia^1.0 title^100.0/str Pete Smith-3 wrote: Hi Amit, Thanks again for your reply. I am understanding it a bit better but I think it would help if I posted an example. Say I have three records: doc long name=id1/long str name=mediaBLU-RAY/str str name=titleIndiana Jones and the Kingdom of the Crystal Skull/str /doc doc long name=id2/long str name=mediaDVD/str str name=titleIndiana Jones and the Kingdom of the Crystal Skull/str /doc doc long name=id3/long str name=mediaDVD/str str name=titleCasino Royale/str /doc Now, if I search for indiana: select?q=indiana I want the first two rows to come back (not the third as it does not contain 'indiana'). I would like record 2 to be scored higher than record 1 as it's media type is DVD. At the moment I have in my config: str name=qftitle/str And i was trying to boost by media having a specific value by using 'bq' but from what you told me that is incorrect. Cheers, Pete On Fri, 2009-03-13 at 03:21 -0700, dabboo wrote: Pete, Sorry, if wasnt clear. Here is the explanation. Suppose you have 2 records and they have films and media as 2 columns. Now first record has values like films=Indiana and media=blue ray and 2nd record has values like films=Bond and media=Indiana Values for qf parameters str name=qfmedia^2.0 films^1.0/str Now, search for q=Indiana .. it should display both of the records but record #2 will display above than the 1st. Let me know if you still have questions. Cheers, amit Pete Smith-3 wrote: Hi Amit, Thanks very much for your reply. What you said makes things a bit clearer but I am still a bit confused. On Thu, 2009-03-12 at 23:14 -0700, dabboo wrote: If you want to boost the records with their field value then you must use q query parameter instead of q.alt. 'q' parameter actually uses qf parameters from solrConfig for field boosting. From the documentation for Dismax queries, I thought that q is simply a keyword parameter: From http://wiki.apache.org/solr/DisMaxRequestHandler: q The guts of the search defining the main query. This is designed to be support raw input strings provided by users with no special escaping. '+' and '-' characters are treated as mandatory and prohibited modifiers for the subsequent terms. Text wrapped in balanced quote characters '' are treated as phrases, any query containing an odd number of quote characters is evaluated as if there were no quote characters at all. Wildcards in this q parameter are not supported. And I thought 'qf' is a list of fields and boost scores: From http://wiki.apache.org/solr/DisMaxRequestHandler: qf (Query Fields) List of fields and the boosts to associate with each of them when building DisjunctionMaxQueries from the user's query. The format supported is fieldOne^2.3 fieldTwo fieldThree^0.4, which indicates that fieldOne has a boost of 2.3, fieldTwo has the default boost, and fieldThree has a boost of 0.4 ... this indicates that matches in fieldOne are much more significant than matches in fieldTwo, which are more significant than matches in fieldThree. But if I want to, say, search for films with 'indiana' in the title, with media=DVD scoring higher than media=BLU-RAY then do I need to do something like: solr/select?q=indiana And in my config: str name=qfmedia^2/str But I don't see where the actual *contents* of the media field would determine the boost. Sorry if I have misunderstood what you mean. Cheers, Pete Pete Smith-3 wrote: Hi, I have managed to build an index in Solr which I can search on keyword, produce facets, query facets etc. This is all working great. I have implemented my search using a dismax query so it searches predetermined fields. However, my results are coming back sorted by score which appears to be calculated by keyword relevancy only. I would like to adjust the score where fields have pre-determined values. I think I can do this with boost query and boost functions but the documentation here: http://wiki.apache.org/solr/DisMaxRequestHandler#head-6862070cf279d9a09bdab971309135c7aea22fb3 Is not particularly helpful. I tried adding adding a bq argument to my search: bq=media:DVD^2 (yes, this is an index of films!) but I find when I start adding more and more: bq=media:DVD^2bq=media:BLU-RAY^1.5 I find the negative results - e.g. films that are DVD but are not BLU-RAY get negatively affected in their score. In the end it all seems to even out and my score is as it was before i started boosting. I must be doing
Re: Two way Synonyms in Solr
Yes, I have defined expand=true for synonym definition. But still, 2 way synonym are not working. Also, is there any way, phrase synonym starts working. Koji Sekiguchi-2 wrote: dabboo wrote: Hi, I am implementing 2 way synonyms in solr using q query parameter. One way synonym is working fine with q query parameter but 2 way is not working. for e.g. If I defined 2 way synonyms in the file like: value1, value2 It doesnt show any result for either of the value. Please suggest. Thanks, Amit Garg Are you sure you have expand=true on your synonym definition? Also you can use /admin/analysis.jsp for debugging the field. Koji -- View this message in context: http://www.nabble.com/Two-way-Synonyms-in-Solr-tp22492439p22494772.html Sent from the Solr - User mailing list archive at Nabble.com.
Stemming in Solr
Hi, Can someone please let me know how to implement stemming in solr. I am particularly looking of the changes, I might need to do in the config files and also if I need to use some already supplied libraries/factories etc etc. It would be a great help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Stemming-in-Solr-tp22495961p22495961.html Sent from the Solr - User mailing list archive at Nabble.com.
Date Search with q query parameter
Hi, I am facing an issue with the date field, I have in my records. e.g. I am using q query parameter and passing some string as search criteria like test. While creating query with q parameter, how query forms is: column1:test | column2:test | column3:test . ... I have one column as date column, which is appended with _dt like column4_dt. Now, when it creates the query like column1:test | column2:test | column3:test | column4_dt:test Here it throws an exception saying Invalid date format. Please suggest how I can prevent this. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Date-Search-with-q-query-parameter-tp22471072p22471072.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Date Search with q query parameter
Hi, Date range query is working fine for me. This is the query I entered. q=productPublicationDate_product_dt:1993-02-01T12:00:00Zversion=2.2start=0rows=10indent=onqt=dismaxrequest It threw this exception: type Status report message Invalid Date String:'1993-02-01t12' description The request sent by the client was syntactically incorrect (Invalid Date String:'1993-02-01t12'). thanks, Amit Garg Shalin Shekhar Mangar wrote: On Thu, Mar 12, 2009 at 4:39 PM, dabboo ag...@sapient.com wrote: Hi, I am able to rectify that exception but now what I am looking for is : How I can pass the value to the date field to search for the record of a specific date value. e.g. I want to retrieve all the records of Jan 01, 2007. How I will pass the value with the column name. If I pass the value it throws an exception saying that it is expecting TO .. The format for range search is your_date_field:[minDate TO maxDate] and for a normal term query it is your_date_field:the_date Each of the dates should be in the format described in the example schema.xml -- Regards, Shalin Shekhar Mangar. -- View this message in context: http://www.nabble.com/Date-Search-with-q-query-parameter-tp22471072p22474608.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Date Search with q query parameter
Hi, I am able to rectify that exception but now what I am looking for is : How I can pass the value to the date field to search for the record of a specific date value. e.g. I want to retrieve all the records of Jan 01, 2007. How I will pass the value with the column name. If I pass the value it throws an exception saying that it is expecting TO .. Please suggest. thanks, Amit Garg Venu Mittal wrote: Is your final query in this format ? col1:[2009-01-01T00:00:00Z+TO+2009-01-01T23:59:59Z] From: dabboo ag...@sapient.com To: solr-user@lucene.apache.org Sent: Thursday, March 12, 2009 12:27:48 AM Subject: Date Search with q query parameter Hi, I am facing an issue with the date field, I have in my records. e.g. I am using q query parameter and passing some string as search criteria like test. While creating query with q parameter, how query forms is: column1:test | column2:test | column3:test . ... I have one column as date column, which is appended with _dt like column4_dt. Now, when it creates the query like column1:test | column2:test | column3:test | column4_dt:test Here it throws an exception saying Invalid date format. Please suggest how I can prevent this. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Date-Search-with-q-query-parameter-tp22471072p22471072.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Date-Search-with-q-query-parameter-tp22471072p22473029.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Column Specific Query with q parameter
Hi, Can somebody please give me an example as how to achieve it. Thanks, Amit Garg dabboo wrote: Hi, I am implementing column specific query with q query parameter. for e.g. ?q=prdMainTitle_product_s:math qt=dismaxrequest The above query doesnt work while if I use the same query with q.alt parameter, it works. ?q=q.alt= prdMainTitle_product_s:math qt=dismaxrequest Please suggest, how to achieve this with q query. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Column-Specific-Query-with-q-parameter-tp22345960p22348016.html Sent from the Solr - User mailing list archive at Nabble.com.
Column Query with q query Parameter
Hi, I am implementing column specific search with q query parameter. I have achieved the same but field boosting is not working in that. Below is the query which is getting formed for this URL: /?q=productURL_s:amit%20OR%20prdMainTitle_s:amitgversion=2.2start=0rows=10indent=onqt=dismaxrequest Query: productURL_s:amit prdMainTitle_s:amitg It is fetching the records, which mataches this criteria but it doesnt honour the field boosting. Can someone please tell me what query should be formed in order to get field boosting running. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Column-Query-with-q-query-Parameter-tp22351678p22351678.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Column Query with q query Parameter
^90 hindi^123 Glorious^2000 highlighting^1000 maths^100 ab^12 erer^4545 prdMainTitle_s^10.0 productURL_s^1.0 /str /arr − arr name=parsed_boost_queries − str all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 MultiPhraseQuery(all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0) MultiPhraseQuery(all:(product product url product url s) (url url s) s^1.0) /str /arr − arr name=boostfuncs str /str /arr − lst name=timing double name=time31.0/double − lst name=prepare double name=time0.0/double − lst name=org.apache.solr.handler.component.QueryComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.FacetComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.MoreLikeThisComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.HighlightComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.SpellCheckComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.DebugComponent double name=time0.0/double /lst /lst − lst name=process double name=time31.0/double − lst name=org.apache.solr.handler.component.QueryComponent double name=time15.0/double /lst − lst name=org.apache.solr.handler.component.FacetComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.MoreLikeThisComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.HighlightComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.SpellCheckComponent double name=time0.0/double /lst − lst name=org.apache.solr.handler.component.DebugComponent double name=time16.0/double /lst /lst /lst /lst /response I am able to achieve the field operations, wildcard with q query. But with field operations, field boosting is not working. If required, I can write you a separate email. Please suggest. Thanks, Amit Garg Erik Hatcher wrote: On Mar 5, 2009, at 8:31 AM, dabboo wrote: I am implementing column specific search with q query parameter. I have achieved the same but field boosting is not working in that. Below is the query which is getting formed for this URL: /?q=productURL_s:amit%20OR %20prdMainTitle_s:amitg version=2.2start=0rows=10indent=onqt=dismaxrequest Query: productURL_s:amit prdMainTitle_s:amitg It is fetching the records, which mataches this criteria but it doesnt honour the field boosting. Can someone please tell me what query should be formed in order to get field boosting running. Amit - it seems we keep revisiting the same question about q/q.alt/ dismax. Please provide complete details - what does your dismaxrequest handler config look like? What does debugQuery=true parsed query output say? If you're using the dismax parser, your field selections aren't going to work, nor is the OR syntax. For details, look at the dismax and solr query parser pages on the Solr wiki and that'll hopefully clarify some things. Erik -- View this message in context: http://www.nabble.com/Column-Query-with-q-query-Parameter-tp22351678p22366659.html Sent from the Solr - User mailing list archive at Nabble.com.
Custom Request Handler
Hi, Can someone please tell me if we can write our own Custom Request Handler and Custom Solr Core? I want to call execute method of custom solrcore class instead of SolrCore class. Actually, I have to modify getQParser method of SolrCore class, so that it shud start returning my custom plugin. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Custom-Request-Handler-tp22328365p22328365.html Sent from the Solr - User mailing list archive at Nabble.com.
Stemming in Solr
Hi, I am trying to implement stemming in solr. If user searches for walk then all the records which have walk, walking, walks, walked etc should display. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Stemming-in-Solr-tp22328850p22328850.html Sent from the Solr - User mailing list archive at Nabble.com.
Column Specific Query with q parameter
Hi, I am implementing column specific query with q query parameter. for e.g. ?q=prdMainTitle_product_s:math qt=dismaxrequest The above query doesnt work while if I use the same query with q.alt parameter, it works. ?q=q.alt= prdMainTitle_product_s:math qt=dismaxrequest Please suggest, how to achieve this with q query. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Column-Specific-Query-with-q-parameter-tp22345960p22345960.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Difference between q and q.alt parameter query
Hi Eric, Thanks a lot for the information. How I can add the clauses for boosting like bq. I have field names like prodMainTitle_s etc. Do you mean that I should add the field boosting in bq entry in solrConfig file. Please suggest. Thanks, Amit Garg Erik Hatcher wrote: The dismax parser does not support wildcard queries currently (but see also SOLR-756). Again, use defType=lucene to get that capability. But, you will lose the qf field specific boosting capability. You can, however, OR in additional clauses for boosting (like the dismax bq does). Query parsing is tricky business. Mark Miller blogged a great entry about the various options available: http://www.lucidimagination.com/blog/2009/02/22/exploring-query-parsers/ Erik On Mar 2, 2009, at 11:06 PM, dabboo wrote: Here is what I am getting with debugQuery=true ?xml version=1.0 encoding=UTF-8 ? - response - lst name=responseHeader int name=status0/int int name=QTime110/int - lst name=params str name=rows10/str str name=start0/str str name=defTypelucene/str str name=indenton/str str name=qda*/str str name=qtdismaxrequest/str str name=debugQuerytrue/str str name=version2.2/str /lst /lst result name=response numFound=0 start=0 maxScore=0.0 / - lst name=debug str name=rawquerystringda*/str str name=querystringda*/str str name=parsedquery +DisjunctionMaxQuery((programJacketImage_program_s:da* | courseCodeSeq_course_s:da* | authorLastName_product_s:da* | Index_Type_s:da* | prdMainTitle_s:da*^10.0 | discCode_course_s:da* | sourceGroupName_course_s:da* | indexType_course_s:da* | prdMainTitle_product_s:da* | isbn10_product_s:da* | displayName_course_s:da* | groupNm_program_s:da* | discipline_product_s:da* | courseJacketImage_course_s:da* | imprint_product_s:da* | introText_program_s:da* | productType_product_s:da* | isbn13_product_s:da* | copyrightYear_product_s:da* | prdPubDate_product_s:da* | programType_program_s:da* | editor_product_s:da* | courseType_course_s:da* | productURL_s:da*^1.0 | courseId_course_s:da* | categoryIds_product_s:da* | indexType_program_s:da* | strapline_product_s:da* | subCompany_course_s:da* | aluminator_product_s:da* | readBy_product_s:da* | subject_product_s:da* | edition_product_s:da* | programId_program_s:da*)~0.01) () all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 MultiPhraseQuery(all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0) MultiPhraseQuery(all:(product product url product url s) (url url s) s^1.0)/str str name=parsedquery_toString+(programJacketImage_program_s:da* | courseCodeSeq_course_s:da* | authorLastName_product_s:da* | Index_Type_s:da* | prdMainTitle_s:da*^10.0 | discCode_course_s:da* | sourceGroupName_course_s:da* | indexType_course_s:da* | prdMainTitle_product_s:da* | isbn10_product_s:da* | displayName_course_s:da* | groupNm_program_s:da* | discipline_product_s:da* | courseJacketImage_course_s:da* | imprint_product_s:da* | introText_program_s:da* | productType_product_s:da* | isbn13_product_s:da* | copyrightYear_product_s:da* | prdPubDate_product_s:da* | programType_program_s:da* | editor_product_s:da* | courseType_course_s:da* | productURL_s:da*^1.0 | courseId_course_s:da* | categoryIds_product_s:da* | indexType_program_s:da* | strapline_product_s:da* | subCompany_course_s:da* | aluminator_product_s:da* | readBy_product_s:da* | subject_product_s:da* | edition_product_s:da* | programId_program_s:da*)~0.01 () all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0 all:(product product url product url s) (url url s) s^1.0/str lst name=explain / str name=QParserDismaxQParser/str null name=altquerystring / - arr name=boost_queries strenglish^90 hindi^123 Glorious^2000 highlighting^1000 maths^100 ab^12 erer^4545 prdMainTitle_s^10.0 productURL_s^1.0/str /arr - arr name=parsed_boost_queries strall:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 MultiPhraseQuery(all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0) MultiPhraseQuery(all:(product product url product url s) (url url s) s^1.0)/str /arr - arr name=boostfuncs str / /arr - lst name=timing double name=time32.0/double - lst name=prepare double name=time16.0/double - lst name=org.apache.solr.handler.component.QueryComponent double name=time16.0/double /lst - lst name=org.apache.solr.handler.component.FacetComponent double name=time0.0/double /lst - lst name=org.apache.solr.handler.component.MoreLikeThisComponent double name
Re: Field Boosting with q.alt parameter Query
Hi, I tried this url but it threw nullpointer exception. Also, I am having underscores in the field name like ProductUrl_s etc. I also debug the query which gets formed with q.alt, it doesnt calculate the scores of the documents and hence doesnt support field boosting. Please suggest me as how I can achieve the field boosting with this q.alt parameter. Thanks, Amit Garg dabboo wrote: Hi, Is there any way, we can implement field boosting with q.alt parameter query. I would appreciate if somebody can suggest if there is any workaround for the same. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-with-q.alt-parameter-Query-tp22304491p22305790.html Sent from the Solr - User mailing list archive at Nabble.com.
Phrase Query
Hi, I want to search tes*t, where * is not considering as wildcard but as character. So, I am expecting the results which have tes*t as string as one of their field value. Please suggest how to achieve it. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Phrase-Query-tp22308387p22308387.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Field Boosting with q.alt parameter Query
Hi Eric, Thanks for all the inputs you have given. They are really helpful. I am able to achieve the field boosting * wildcard with dismax. For this, I had to make code changes in DisjunctionMaxQueryParser sub class in SolrPluginUtils class. Thanks, Amit Garg Erik Hatcher wrote: Amit, If you use the lucene query parser, you only get a q parameter. All the other parameters, such as qf and bq, are specific to the dismax query parser. If you want to use the lucene query parser for wildcard capability, you have to manually build the query across multiple fields and boosts. If you use the dismax parser, there is no wildcard query capability. These are the limitations of what the query parsers currently built into Solr. As for the URL throwing a null pointer exception - please send the relevant details (what URL was it? What was the complete stack trace? What version of Solr?) Erik On Mar 3, 2009, at 5:21 AM, dabboo wrote: Hi, I tried this url but it threw nullpointer exception. Also, I am having underscores in the field name like ProductUrl_s etc. I also debug the query which gets formed with q.alt, it doesnt calculate the scores of the documents and hence doesnt support field boosting. Please suggest me as how I can achieve the field boosting with this q.alt parameter. Thanks, Amit Garg dabboo wrote: Hi, Is there any way, we can implement field boosting with q.alt parameter query. I would appreciate if somebody can suggest if there is any workaround for the same. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-with-q.alt-parameter-Query-tp22304491p22305790.html Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://www.nabble.com/Field-Boosting-with-q.alt-parameter-Query-tp22304491p22324761.html Sent from the Solr - User mailing list archive at Nabble.com.
Search with Date field
Hi, Date search is not happening in solr. I am giving the field name and date value as the request but it is not returning any value. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Search-with-Date-field-tp22324779p22324779.html Sent from the Solr - User mailing list archive at Nabble.com.
Difference between q and q.alt parameter query
Hi, Can somebody please tell me as what is the actual difference between q.alt q parameter queries. I am trying to do the wildcard search with q query parameter, which is supported by q.alt parameter. Please let me know how it is treating the query with wildcard in case of q.alt parameter. thanks, Amit Garg -- View this message in context: http://www.nabble.com/Difference-between-q-and-q.alt-parameter-query-tp22286561p22286561.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Difference between q and q.alt parameter query
Thanks for the information. Where do we defined the deftype parameter. dabboo wrote: Hi, Can somebody please tell me as what is the actual difference between q.alt q parameter queries. I am trying to do the wildcard search with q query parameter, which is supported by q.alt parameter. Please let me know how it is treating the query with wildcard in case of q.alt parameter. thanks, Amit Garg -- View this message in context: http://www.nabble.com/Difference-between-q-and-q.alt-parameter-query-tp22286561p22289501.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Difference between q and q.alt parameter query
Thanks for the information. I gave it in my url as the request parameter like http://localhost:8080/apache-solr-1.3.0/CORE_WWW.BLUEHEN.COM/select/?q=da*version=2.2start=0rows=10indent=onqt=dismaxrequestdefType=lucene But still results are the same. It is not displaying any records. Please suggest. Thanks, Amit dabboo wrote: Thanks for the information. Where do we defined the deftype parameter. dabboo wrote: Hi, Can somebody please tell me as what is the actual difference between q.alt q parameter queries. I am trying to do the wildcard search with q query parameter, which is supported by q.alt parameter. Please let me know how it is treating the query with wildcard in case of q.alt parameter. thanks, Amit Garg -- View this message in context: http://www.nabble.com/Difference-between-q-and-q.alt-parameter-query-tp22286561p22289979.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Difference between q and q.alt parameter query
=org.apache.solr.handler.component.DebugComponent double name=time16.0/double /lst /lst /lst /lst /response Also, even if works, would I be able to achieve the field boosting with q query parameter. Thanks, Amit Garg Erik Hatcher wrote: On Mar 2, 2009, at 10:15 AM, dabboo wrote: Thanks for the information. I gave it in my url as the request parameter like http://localhost:8080/apache-solr-1.3.0/CORE_WWW.BLUEHEN.COM/select/?q=da*version=2.2start=0rows=10indent=onqt=dismaxrequestdefType=lucene But still results are the same. It is not displaying any records. Please suggest. How is your dismaxrequest request handler defined? For example, if you have an invariant defType set there, then setting defType on the request would be ignored. Also, what do you get for a parsed query when setting debugQuery=true? Erik -- View this message in context: http://www.nabble.com/Difference-between-q-and-q.alt-parameter-query-tp22286561p22302203.html Sent from the Solr - User mailing list archive at Nabble.com.
How to use spell checker
Hi, I am trying to implement the spell check feature in solr with lucene. for e.g. if any record contains elephants and user enters elepents, even then also, it should return the results with the correct spelling i.e. elephants. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/How-to-use-spell-checker-tp22303127p22303127.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Search schema using q Query
Hi Hoss, Thanks a lot for the information. Here is what I am trying to achieve. 1. I am trying to customize the search with q query parameter, so that it can support wildcard and field boosting. I customize QueryParser and created the wildcard query in the same way as it does for non wildcard. But even with this changed query, the results are not showing up. I figured out as how it is doing the field boosting with the scores. But what I want to know is how it is fetching the records from the indexes based on the query. Please suggest how I should go forward. Thanks, Amit Garg hossman wrote: : One first step is to use debugQuery=true as an additional parameter to your : search request. That'll return debug info in the response, which includes a : couple of views of the parsed query. the query mentioned in the original post appears to come from debugQuery=true using hte dismax parser. : This query is correct and returns the result also. I am looking for the : class file, where the actual searching is taking place. I want to see as how : it is interpreting the query and how it is returning the result. that's kind of a vague question ... the QParser generates the query, the QueryComponent executes it ... using the SOlrIndexSearcher, which delegates to a Lucene IndexSearcher, which delegates back to the Query to generate a Scorer to iterate over matches. : I am trying to customize the searching logic for our specific needs. instead of asking which class file interprets the query, perhaps you should tell us what your specific goal is. what kinds of customizations do you want to make? http://people.apache.org/~hossman/#xyproblem XY Problem Your question appears to be an XY Problem ... that is: you are dealing with X, you are assuming Y will help you, and you are asking about Y without giving more details about the X so that we can understand the full issue. Perhaps the best solution doesn't involve Y at all? See Also: http://www.perlmonks.org/index.pl?node_id=542341 -Hoss -- View this message in context: http://www.nabble.com/Search-schema-using-q-Query-tp22218801p22281876.html Sent from the Solr - User mailing list archive at Nabble.com.
Search wildcards field boosting using Q query
Hi, I am trying to do the wildcard search using the q query parameter with dismax request. Wildcard search works fine with q.alt parameter but field boosting doesnt work with q.alt parameter. I customized the QueryParser class and now the query which is getting formed for wildcard is exactly the same as without wildcard. Below is the debug query result for both queries. Without Wildcard Query ?xml version=1.0 encoding=UTF-8 ? - response - lst name=responseHeader int name=status0/int int name=QTime31/int - lst name=params str name=rows10/str str name=start0/str str name=indenton/str str name=qtest/str str name=qtdismaxrequest/str str name=debugQuerytrue/str str name=version2.2/str /lst /lst - result name=response numFound=2 start=0 maxScore=5.906053E-4 - doc float name=score5.906053E-4/float str name=IndexId_s987654321/str str name=IndexId_str_s987654321/str str name=productURL_stestData/str str name=productURL_str_stestData/str /doc - doc float name=score5.906053E-7/float str name=IndexId_s123456789/str str name=IndexId_str_s123456789/str str name=prdMainTitle_stestData/str str name=prdMainTitle_str_stestData/str /doc /result - lst name=debug str name=rawquerystringtest/str str name=querystringtest/str str name=parsedquery+DisjunctionMaxQuery((programJacketImage_program_s:test | courseCodeSeq_course_s:test | authorLastName_product_s:test | Index_Type_s:test | prdMainTitle_s:test^10.0 | discCode_course_s:test | sourceGroupName_course_s:test | indexType_course_s:test | prdMainTitle_product_s:test | isbn10_product_s:test | displayName_course_s:test | groupNm_program_s:test | discipline_product_s:test | courseJacketImage_course_s:test | imprint_product_s:test | introText_program_s:test | productType_product_s:test | isbn13_product_s:test | copyrightYear_product_s:test | prdPubDate_product_s:test | programType_program_s:test | editor_product_s:test | courseType_course_s:test | productURL_s:test^1.0 | courseId_course_s:test | categoryIds_product_s:test | indexType_program_s:test | strapline_product_s:test | subCompany_course_s:test | aluminator_product_s:test | readBy_product_s:test | subject_product_s:test | edition_product_s:test | programId_program_s:test)~0.01) () all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 MultiPhraseQuery(all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0) MultiPhraseQuery(all:(product product url product url s) (url url s) s^1.0)/str str name=parsedquery_toString+(programJacketImage_program_s:test | courseCodeSeq_course_s:test | authorLastName_product_s:test | Index_Type_s:test | prdMainTitle_s:test^10.0 | discCode_course_s:test | sourceGroupName_course_s:test | indexType_course_s:test | prdMainTitle_product_s:test | isbn10_product_s:test | displayName_course_s:test | groupNm_program_s:test | discipline_product_s:test | courseJacketImage_course_s:test | imprint_product_s:test | introText_program_s:test | productType_product_s:test | isbn13_product_s:test | copyrightYear_product_s:test | prdPubDate_product_s:test | programType_program_s:test | editor_product_s:test | courseType_course_s:test | productURL_s:test^1.0 | courseId_course_s:test | categoryIds_product_s:test | indexType_program_s:test | strapline_product_s:test | subCompany_course_s:test | aluminator_product_s:test | readBy_product_s:test | subject_product_s:test | edition_product_s:test | programId_program_s:test)~0.01 () all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 all:(prd prd main prd main titl prd main titl s) (main main titl main titl s) (titl titl s) s^10.0 all:(product product url product url s) (url url s) s^1.0/str - lst name=explain str name=9876543215.906053E-4 = (MATCH) sum of: 5.906053E-4 = (MATCH) max plus 0.01 times others of: 5.906053E-4 = (MATCH) weight(productURL_s:test^1.0 in 1), product of: 5.906053E-4 = queryWeight(productURL_s:test^1.0), product of: 1.0 = boost 1.0 = idf(docFreq=1, numDocs=2) 5.906053E-8 = queryNorm 1.0 = (MATCH) fieldWeight(productURL_s:test in 1), product of: 1.0 = tf(termFreq(productURL_s:test)=1) 1.0 = idf(docFreq=1, numDocs=2) 1.0 = fieldNorm(field=productURL_s, doc=1)/str str name=1234567895.906053E-7 = (MATCH) sum of: 5.906053E-7 = (MATCH) max plus 0.01 times others of: 5.906053E-7 = (MATCH) weight(prdMainTitle_s:test^10.0 in 0), product of: 5.906053E-7 = queryWeight(prdMainTitle_s:test^10.0), product of: 10.0 = boost 1.0 = idf(docFreq=1, numDocs=2) 5.906053E-8 = queryNorm 1.0 = (MATCH) fieldWeight(prdMainTitle_s:test in 0), product of: 1.0 = tf(termFreq(prdMainTitle_s:test)=1) 1.0 = idf(docFreq=1, numDocs=2) 1.0 = fieldNorm(field=prdMainTitle_s, doc=0)/str /lst str name=QParserDismaxQParser/str null name=altquerystring / - arr name=boost_queries strenglish^90
Field Boosting with q.alt parameter
Hi, I am using q.alt parameter for passing the query. But with this q.alt parameter, it doesnt read the QF parameter from solrConfig file. It reads BQ parameter but not the QF. Hence the field boosting is not working with q.alt parameter. Please help how I can achieve that. Thanks in advance. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-with-q.alt-parameter-tp22201072p22201072.html Sent from the Solr - User mailing list archive at Nabble.com.
org.apache.lucene.analysis.tokenattributes package
Hi, I am trying to override getFieldQuery method of QueryParser class, which uses 2 classed i.e. PositionIncrementAttribute TokenAttribute of org.apache.lucene.analysis.tokenattributes package. I\ I am not able to find out this package. Please help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/org.apache.lucene.analysis.tokenattributes-package-tp22217615p22217615.html Sent from the Solr - User mailing list archive at Nabble.com.
Search schema using q Query
Hi, I am trying to search the schema with the q query parameter. Query which gets form is: +(programJacketImage_program_s:test | courseCodeSeq_course_s:test | authorLastName_product_s:test | Index_Type_s:test | prdMainTitle_s:test^10.0 | discCode_course_s:test | sourceGroupName_course_s:test | indexType_course_s:test | prdMainTitle_product_s:test | isbn10_product_s:test | displayName_course_s:test | groupNm_program_s:test | discipline_product_s:test | courseJacketImage_course_s:test | imprint_product_s:test | introText_program_s:test | productType_product_s:test | isbn13_product_s:test | copyrightYear_product_s:test | prdPubDate_product_s:test | programType_program_s:test | editor_product_s:test | courseType_course_s:test | productURL_s:test^1.0 | courseId_course_s:test | categoryIds_product_s:test | indexType_program_s:test | strapline_product_s:test | subCompany_course_s:test | aluminator_product_s:test | readBy_product_s:test | subject_product_s:test | edition_product_s:test | programId_program_s:test)~0.01 () all:english^90.0 all:hindi^123.0 all:glorious^2000.0 all:highlight^1.0E7 all:math^100.0 all:ab^12.0 all:erer^4545.0 This query is correct and returns the result also. I am looking for the class file, where the actual searching is taking place. I want to see as how it is interpreting the query and how it is returning the result. I am trying to customize the searching logic for our specific needs. Please help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Search-schema-using-q-Query-tp22218801p22218801.html Sent from the Solr - User mailing list archive at Nabble.com.
Field Boosting with Alt Query
Hi, I am trying to achieve field boosting with alt query. I am giving wildcard in the query and it is working fine and field boosting is working with normal q query. I want to achieve both with q query. I am able to do wildcard search with q query but now I am not getting the field boosting happening. Please suggest. thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-Code-tp22118997p22179260.html Sent from the Solr - User mailing list archive at Nabble.com.
Wildcard search with q query
Hi, I am trying to perform wildcard search using q query. e.g. If I give tes* as the query, it works fine and returns the results as expected. But if I give *tes*, then it throws an exception saying that we cant have wildcards in front of any string. Please suggest. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcard-search-with-q-query-tp22179548p22179548.html Sent from the Solr - User mailing list archive at Nabble.com.
Field Boosting with wildcard
Hi, I am trying to achieve the field boosting in wild card search. If I do normal search, then this field boosting works fine but if I use wildcard in the search string, then it field boosting doesnt work. Please suggest. thanks, Amit garg -- View this message in context: http://www.nabble.com/Field-Boosting-with-wildcard-tp22179564p22179564.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Field Boosting with wildcard
Hi, Thanks for the information. But can we achieve wildcards with q query instead of q.alt parameter. thanks, Amit dabboo wrote: Hi, I am trying to achieve the field boosting in wild card search. If I do normal search, then this field boosting works fine but if I use wildcard in the search string, then it field boosting doesnt work. Please suggest. thanks, Amit garg -- View this message in context: http://www.nabble.com/Field-Boosting-with-wildcard-tp22179564p22180669.html Sent from the Solr - User mailing list archive at Nabble.com.
Wildcards with q query parameter
Hi, can we achieve wildcard search with q query parameter. wildcard search works fine with q.alt parameter but not with q parameter. Also, I am trying to debug the QueryParser class for the same issue, but the control is not going in the right place in the eclipse. Hence, I am not able to debug that class file also. Please help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Wildcards-with-q-query-parameter-tp22196748p22196748.html Sent from the Solr - User mailing list archive at Nabble.com.
Debugging Lucene Code
Hi, I am trying to debug code of QueryParser class and other related files. I have also taken the code of lucene from its SVN, but it is not going to the right control during debug. I wnated to know if I have taken the latest code and if not, from where I can take the code. Thansk, Amit Garg -- View this message in context: http://www.nabble.com/Debugging-Lucene-Code-tp22197796p22197796.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Field Boosting Code
Hi, Thanks for the information, but I am looking for the code,which gets called when user enters the query and search for this. thanks for the help. - Amit Grant Ingersoll-6 wrote: It's in Lucene. See the Field class. Assuming you mean boosting the Field at index time and not boosting the term (text + field name) at query time. On Feb 20, 2009, at 6:26 AM, dabboo wrote: Hi, I was looking into the Solr code and was trying to figure out as where the code for field boosting is written. I am specifically looking for classes, which gets called for that functionality. If somebody knows as where the code is, it will be of great help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-Code-tp22118997p22118997.html Sent from the Solr - User mailing list archive at Nabble.com. -- Grant Ingersoll http://www.lucidimagination.com/ Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using Solr/Lucene: http://www.lucidimagination.com/search -- View this message in context: http://www.nabble.com/Field-Boosting-Code-tp22118997p22155205.html Sent from the Solr - User mailing list archive at Nabble.com.
Field Boosting Code
Hi, I was looking into the Solr code and was trying to figure out as where the code for field boosting is written. I am specifically looking for classes, which gets called for that functionality. If somebody knows as where the code is, it will be of great help. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Field-Boosting-Code-tp22118997p22118997.html Sent from the Solr - User mailing list archive at Nabble.com.
Boosting Code
Hi, Can anyone please tell me where I can find the actual logic/implementation of field boosting in Solr. I am looking for classes. Thanks, Amit Garg -- View this message in context: http://www.nabble.com/Boosting-Code-tp22119017p22119017.html Sent from the Solr - User mailing list archive at Nabble.com.
