Group and Field Collapsing in SOLR More like this
Hi I have two types of profile : Shadow and DO and I am trying to use MLT to bring related recommendation of a userID In the result I get both the types but I want to restrict the results of document through a field (type) I pass it on. Currently grouping and field collapsing does not seem to work. Any other way to achieve it Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Group-and-Field-Collapsing-in-SOLR-More-like-this-tp4101032.html Sent from the Solr - User mailing list archive at Nabble.com.
ConcurrentModificationException - SolrCmdDistributor
Hi, I am trying to implement a multi-threaded version of DIH (SOLR 4) and am able to successfully run this with a single SOLR node. Getting ConcurrentModificationException at SolrCmdDistributor.java:223 when doing it with more than one node. Has anyone faced this issue? Please let me know. Thanks, Balaji -- :: Daring ideas are like chessmen moved forward; they may be beaten, but they may start a winning game. - Johann Wolfgang von Goethe ::
SOLR Query Intersection
Hi , I am trying to Compare three independent queries,intersection among them and draw an Venn diagram using the Google CHART . By using OR I will be able to get the union of the 3 fields and using AND I will be able to get the intersection among the three , Is it possible to get the union and intersection among the fields in a same query For ex : I have 3 values which is under Multi-valued field browsers Google , Firefox and IE . I just need to find the no.of documents having only google , Firefox etc.. and no.of documents having all the three and an intersection among them like Google IE , Google Firefox Is it possible to do with the Query Intersections or do I need to write separate queries for all the above , If not please suggest how it can be achieved Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-Query-Intersection-tp3818756p3818756.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SOLR Query Intersection
Hi Mikhail, Yes I am trying to get the facets counts for all these and populate the chart , but comparison between the values is what I am wondering Will facets handle all the 3 possible scenarios Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-Query-Intersection-tp3818756p3819111.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SOLR Query Intersection
Hi, I got your point are you suggesting me to run using the *facet.query* param for the various combinations Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-Query-Intersection-tp3818756p3819165.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SOLR Query Intersection
Hi, Thank you guys Erik and Mikhail , You saved my day Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-Query-Intersection-tp3818756p3819571.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Boost Exact matches on Specific Fields
Hi One More Question here , For ex: If so do an search for Agriculture Foods with out Quotes , It is trying to find the ones which have both the words not Splitting and checking for individual results . On removing the QF params it seems to work . Is it a problem with the QF params I am able to see it split and trigger by checking the SOLR Analysis page Thanks Balaji On Thu, Sep 29, 2011 at 6:11 AM, Balaji S mcabal...@gmail.com wrote: Yeah I will change the weight for str_category and make it higher . I converted it to lowercase because we cannot expect users to type them in the correct case Thanks Balaji On Thu, Sep 29, 2011 at 3:52 AM, Way Cool way1.wayc...@gmail.com wrote: I will give str_category more weight than ts_category because we want str_category to win if they have exact matches ( you converted to lowercase). On Mon, Sep 26, 2011 at 10:23 PM, Balaji S mcabal...@gmail.com wrote: Hi You mean to say copy the String field to a Text field or the reverse . This is the approach I am currently following Step 1: Created a FieldType fieldType name=string_lower class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / /analyzer /fieldType Step 2 : field name=str_category type=string_lower indexed=true stored=true/ Step 3 : copyField source=ts_category dest=str_category/ And in the SOLR Query planning to q=hospitalsqf=body^4.0 title^5.0 ts_category^10.0 str_category^8.0 The One Question I have here is All the above mentioned fields will have Hospital present in them , will the above approach work to get the exact match on the top and bring Hospitalization below in the results Thanks Balaji On Tue, Sep 27, 2011 at 9:38 AM, Way Cool way1.wayc...@gmail.com wrote: If I were you, probably I will try defining two fields: 1. ts_category as a string type 2. ts_category1 as a text_en type Make sure copy ts_category to ts_category1. You can use the following as qf in your dismax: qf=body^4.0 title^5.0 ts_category^10.0 ts_category1^5.0 or something like that. YH http://thetechietutorials.blogspot.com/ On Mon, Sep 26, 2011 at 2:06 PM, balaji mcabal...@gmail.com wrote: Hi all I am new to SOLR and have a doubt on Boosting the Exact Terms to the top on a Particular field For ex : I have a text field names ts_category and I want to give more boost to this field rather than other fields, SO in my Query I pass the following in the QF params qf=body^4.0 title^5.0 ts_category^21.0 and also sort on SCORE desc When I do a search against Hospitals . I get Hospitalization Management , Hospital Equipment Supplies on Top rather than the exact matches of Hospitals So It would be great , If I could be helped over here Thanks Balaji Thanks in Advance Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Boost-Exact-matches-on-Specific-Fields-tp3370513p3370513.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Boost Exact matches on Specific Fields
Yeah I will change the weight for str_category and make it higher . I converted it to lowercase because we cannot expect users to type them in the correct case Thanks Balaji On Thu, Sep 29, 2011 at 3:52 AM, Way Cool way1.wayc...@gmail.com wrote: I will give str_category more weight than ts_category because we want str_category to win if they have exact matches ( you converted to lowercase). On Mon, Sep 26, 2011 at 10:23 PM, Balaji S mcabal...@gmail.com wrote: Hi You mean to say copy the String field to a Text field or the reverse . This is the approach I am currently following Step 1: Created a FieldType fieldType name=string_lower class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / /analyzer /fieldType Step 2 : field name=str_category type=string_lower indexed=true stored=true/ Step 3 : copyField source=ts_category dest=str_category/ And in the SOLR Query planning to q=hospitalsqf=body^4.0 title^5.0 ts_category^10.0 str_category^8.0 The One Question I have here is All the above mentioned fields will have Hospital present in them , will the above approach work to get the exact match on the top and bring Hospitalization below in the results Thanks Balaji On Tue, Sep 27, 2011 at 9:38 AM, Way Cool way1.wayc...@gmail.com wrote: If I were you, probably I will try defining two fields: 1. ts_category as a string type 2. ts_category1 as a text_en type Make sure copy ts_category to ts_category1. You can use the following as qf in your dismax: qf=body^4.0 title^5.0 ts_category^10.0 ts_category1^5.0 or something like that. YH http://thetechietutorials.blogspot.com/ On Mon, Sep 26, 2011 at 2:06 PM, balaji mcabal...@gmail.com wrote: Hi all I am new to SOLR and have a doubt on Boosting the Exact Terms to the top on a Particular field For ex : I have a text field names ts_category and I want to give more boost to this field rather than other fields, SO in my Query I pass the following in the QF params qf=body^4.0 title^5.0 ts_category^21.0 and also sort on SCORE desc When I do a search against Hospitals . I get Hospitalization Management , Hospital Equipment Supplies on Top rather than the exact matches of Hospitals So It would be great , If I could be helped over here Thanks Balaji Thanks in Advance Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Boost-Exact-matches-on-Specific-Fields-tp3370513p3370513.html Sent from the Solr - User mailing list archive at Nabble.com.
Boost Exact matches on Specific Fields
Hi all I am new to SOLR and have a doubt on Boosting the Exact Terms to the top on a Particular field For ex : I have a text field names ts_category and I want to give more boost to this field rather than other fields, SO in my Query I pass the following in the QF params qf=body^4.0 title^5.0 ts_category^21.0 and also sort on SCORE desc When I do a search against Hospitals . I get Hospitalization Management , Hospital Equipment Supplies on Top rather than the exact matches of Hospitals So It would be great , If I could be helped over here Thanks Balaji Thanks in Advance Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Boost-Exact-matches-on-Specific-Fields-tp3370513p3370513.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Boost Exact matches on Specific Fields
Hi You mean to say copy the String field to a Text field or the reverse . This is the approach I am currently following Step 1: Created a FieldType fieldType name=string_lower class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / /analyzer /fieldType Step 2 : field name=str_category type=string_lower indexed=true stored=true/ Step 3 : copyField source=ts_category dest=str_category/ And in the SOLR Query planning to q=hospitalsqf=body^4.0 title^5.0 ts_category^10.0 str_category^8.0 The One Question I have here is All the above mentioned fields will have Hospital present in them , will the above approach work to get the exact match on the top and bring Hospitalization below in the results Thanks Balaji On Tue, Sep 27, 2011 at 9:38 AM, Way Cool way1.wayc...@gmail.com wrote: If I were you, probably I will try defining two fields: 1. ts_category as a string type 2. ts_category1 as a text_en type Make sure copy ts_category to ts_category1. You can use the following as qf in your dismax: qf=body^4.0 title^5.0 ts_category^10.0 ts_category1^5.0 or something like that. YH http://thetechietutorials.blogspot.com/ On Mon, Sep 26, 2011 at 2:06 PM, balaji mcabal...@gmail.com wrote: Hi all I am new to SOLR and have a doubt on Boosting the Exact Terms to the top on a Particular field For ex : I have a text field names ts_category and I want to give more boost to this field rather than other fields, SO in my Query I pass the following in the QF params qf=body^4.0 title^5.0 ts_category^21.0 and also sort on SCORE desc When I do a search against Hospitals . I get Hospitalization Management , Hospital Equipment Supplies on Top rather than the exact matches of Hospitals So It would be great , If I could be helped over here Thanks Balaji Thanks in Advance Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Boost-Exact-matches-on-Specific-Fields-tp3370513p3370513.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Synonyms Not Working when using SRC DEST
So, if instead of: allergy test = Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons You specified allergy test = allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons I followed the above approach allergy test = allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons and it works as expected , Thanks for making it more clear Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3316691.html Sent from the Solr - User mailing list archive at Nabble.com.
Synonyms Not Working when using SRC DEST
Hi all The Question might sound stupid . I have a large synonym file and have created the synonyms something like below *allergy test = Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons * I have also added the synonym to get indexed during index time like below fieldType name=text class=solr.TextField positionIncrementGap=100 analyzer type=index charFilter class=solr.MappingCharFilterFactory mapping=mapping-ISOLatin1Accent.txt/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true expand=true/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt enablePositionIncrements=true/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=1 catenateNumbers=1 catenateAll=0 splitOnCaseChange=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.SnowballPorterFilterFactory language=English protected=protwords.txt/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer analyzer type=query charFilter class=solr.MappingCharFilterFactory mapping=mapping-ISOLatin1Accent.txt/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.StopFilterFactory ignoreCase=true words=stopwords.txt enablePositionIncrements=true/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=0 catenateNumbers=0 catenateAll=0 splitOnCaseChange=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.SnowballPorterFilterFactory language=English protected=protwords.txt/ filter class=solr.RemoveDuplicatesTokenFilterFactory/ /analyzer /fieldType But when I do a search for allergy , I get 0 results when I go to solr/admin/analysis.jsp and I could see the corresponding synonym show up http://lucene.472066.n3.nabble.com/file/n3313862/Screenshot-1.png So I couldn't find where is the problem when i change the synonym file to a comma separated I am able to see the results It would be great if you can help me out with this Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3313862.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Synonyms Not Working when using SRC DEST
Hi Chris The Terms Doctors , Doctors-Medical are all present in my Document body, title fields etc.. but Allergy Test is not . So what I am doing in synonym file is if a user searches for allergy test bring me results that match Doctors etc.. i.e Explicit mappings match any token sequence on the LHS of = and replace with all alternatives on the RHS. So when I do a search allergy test it should map with doctors and should bring me results but it is not mapping . Is there any way I make it work Hope it clarifies Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3314222.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Synonyms Not Working when using SRC DEST
It won't work given your current schema. To get the desired results, you would need to expand your synonyms at both index AND query time. Right now your schema seems to specify it only at index time. I have a very huge schema spanning up to 10K lines , if I use query time it will be huge hit for me because one term will be mapped to multiple terms . similar in the case of allergy I doesn't want to go with comma separated as it will give some erroneous results and more over allergy and doctors are not equivalent terms to be used in comma So, as the other respondent indicated, currently you replace allergy with the other list when indexing, and since allergy is not replaced during query, it gets no hits. I replace allergy during the index with doctors , So it shouldn't be part of the document ? Thanks Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Synonyms-Not-Working-when-using-SRC-DEST-tp3313862p3315287.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How to display results across multiple pages when grouping is enabled by default
I got the matching groups value with $grouping.value.matches . Apart from this $page.results_found is the only parameter for which I can get the value(Default value is 10). Suggest me some way to get the values of $page.current_page_number and $page.page_count. So that I can write my own macro definition for grouping pagination under VM_global_library.vm. Thanks in advance. __ If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/How-to-display-results-across-multiple-pages-when-grouping-is-enabled-by-default-tp3300292p3308558.html This email was sent by Balaji N.S. (via Nabble)
Re: How to display results across multiple pages when grouping is enabled by default
When I specify only 3 no of rows(rows=3) I just get only 3 results. This
problem is not with the no of docs, but with grouping of docs.
Well in velocity script browse.vm there is a code that is related to
pagination.
#if($response.response.get('grouped'))
#else
#link_to_previous_page(previous)
$page.results_found results found.
Page $page.current_page_number of $page.page_count
#link_to_next_page(next)
#end
This code signifies that if the response is a grouped nothin is done. But if
the results are not grouped the link to next page are specified.
I tried pasting this part of code in IF block but the page.count returned
is zero and link to next page is missing.
Plz help me in this regard.
__
If you reply to this email, your message will be added to the discussion below:
http://lucene.472066.n3.nabble.com/How-to-display-results-across-multiple-pages-when-grouping-is-enabled-by-default-tp3300292p3306685.html
This email was sent by Balaji N.S. (via Nabble)
Re: Solritas issue in opening files
Hi To open files from local system use file protocol . (file:///followed by absolute path) If you are running the application in jboss instead of jetty you can deploy the input files as a separate war which is exploded and then avoid using file protocol. File protocol is erroneous. It is not supported by reputed browser like Firefox. __ If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solritas-issue-in-opening-files-tp3300836p3300867.html This email was sent by Balaji N.S. (via Nabble) To receive all replies by email, subscribe to this discussion: http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=subscribe_by_codenode=3300836code=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3JnfDMzMDA4MzZ8MTIyNjQ0MTk0Mg==
Re: Solritas issue in opening files
Hi To open files from local system use file protocol . (file:///followed by absolute path) If you are running the application in jboss instead of jetty you can deploy the input files as a separate war which is exploded and then avoid using file protocol. File protocol is erroneous. It is not supported by reputed browser like Firefox. __ If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solritas-issue-in-opening-files-tp3300836p3300872.html This email was sent by Balaji N.S. (via Nabble) To receive all replies by email, subscribe to this discussion: http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=subscribe_by_codenode=3300836code=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3JnfDMzMDA4MzZ8MTIyNjQ0MTk0Mg==
How to display results across multiple pages when grouping is enabled by default
Solr 3.3 is what I use and I have configured grouping of results by default. I have some 30-40 sample documents in my index. I use Solritas UI . When I search I don't get the results across pages. Even when I specify an empty query the results that are returned are just for the first page. What file in the velocity script should I change to achieve this . Can you please help me out. __ If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/How-to-display-results-across-multiple-pages-when-grouping-is-enabled-by-default-tp3300292p3300292.html This email was sent by Balaji N.S. (via Nabble) To receive all replies by email, subscribe to this discussion: http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=subscribe_by_codenode=3300292code=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3JnfDMzMDAyOTJ8MTIyNjQ0MTk0Mg==
