RE: Solr - Multi Term highlighting issue
Hi Robert, Thanks for your help. This looks much closer to my issue(may be not). Unfortunately, I can't switch to solr version 3.1 yet. I hope to revisit and update this post when I do. Thanks thanks & regards, Rajesh Ramana Enterprise Applications, Turner Broadcasting System, Inc. 404.878.7474 -Original Message- From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] Sent: Sunday, April 24, 2011 1:58 AM To: solr-user@lucene.apache.org Cc: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue I think I am using ver 1.4, I 'll try to review the link you provided later today. Rajesh Ramana On Apr 24, 2011, at 12:52 AM, "Robert Muir" wrote: > On Sat, Apr 23, 2011 at 11:36 PM, Ramanathapuram, Rajesh > wrote: >> What is really weird is if I search for srchterm1 and srchterm2 >> separately, the results come up fine. If I search for multiple terms, >> this issue seems to happen when the terms are separated by html tags >> and special characters like ') / \' etc... >> > > What version of Solr are you using? Because you are saying the issue > only happens when terms involve special characters, its possible it > could be this bug: https://issues.apache.org/jira/browse/LUCENE-2874, > with the overlapping terms being created by the WordDelimiterFilter. > > This is fixed in 3.1.
Re: Solr - Multi Term highlighting issue
I think I am using ver 1.4, I 'll try to review the link you provided later today. Rajesh Ramana On Apr 24, 2011, at 12:52 AM, "Robert Muir" wrote: > On Sat, Apr 23, 2011 at 11:36 PM, Ramanathapuram, Rajesh > wrote: >> What is really weird is if I search for srchterm1 and srchterm2 >> separately, the results come up fine. If I search for multiple terms, >> this issue seems to happen when the terms are separated by html tags and >> special characters like ') / \' etc... >> > > What version of Solr are you using? Because you are saying the issue > only happens when terms involve special characters, its possible it > could be this bug: https://issues.apache.org/jira/browse/LUCENE-2874, > with the overlapping terms being created by the WordDelimiterFilter. > > This is fixed in 3.1.
Re: Solr - Multi Term highlighting issue
On Sat, Apr 23, 2011 at 11:36 PM, Ramanathapuram, Rajesh wrote: > What is really weird is if I search for srchterm1 and srchterm2 > separately, the results come up fine. If I search for multiple terms, > this issue seems to happen when the terms are separated by html tags and > special characters like ') / \' etc... > What version of Solr are you using? Because you are saying the issue only happens when terms involve special characters, its possible it could be this bug: https://issues.apache.org/jira/browse/LUCENE-2874, with the overlapping terms being created by the WordDelimiterFilter. This is fixed in 3.1.
RE: Solr - Multi Term highlighting issue
Hi Koji,
Thanks for taking time to look into this issue, I really appreciate your
efforts.
I am wondering the problem might be a document format issue(just my
guess).
What is really weird is if I search for srchterm1 and srchterm2
separately, the results come up fine. If I search for multiple terms,
this issue seems to happen when the terms are separated by html tags and
special characters like ') / \' etc...
I am fairly new to SOLR, still trying to understand, how things work. My
guess is somewhere or somehow a whitespace is missed, and the highlight
regex based fragmentor is messing things up.
Here it is (for review) from solrconfig.xml, if you can think of
anything obvious
100
70
0.5
[-\w ,/\n\"']{20,200}
I will try to open a JIRA issue in the next couple of weeks, when my
schedule slows down.
Once again, thanks much for your help.
thanks & regards,
Rajesh Ramana
-Original Message-
From: Koji Sekiguchi [mailto:k...@r.email.ne.jp]
Sent: Saturday, April 23, 2011 11:07 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr - Multi Term highlighting issue
Thank you for sending the definitions. I thought you defined n-gram
based field for story and slug, but your definitions looks fine for me.
I don't understand why you got such strange snippets.
I think you can open a jira issue for this problem (sorry I cannot take
it at this moment) with a test case that reproduces the problem would be
much helpful.
Koji
(11/04/24 11:50), Ramanathapuram, Rajesh wrote:
> Hi Koji,
>
> My apologies for misunderstanding the question ...
>
> here is Fields ...
>
>
>
>required="true" />
>
>
>
>
> />
>
>
>stored="true" />
>stored="true" />
>stored="true" />
>stored="false" />
>
>stored="true" />
>stored="false" sortMissingFirst="true" />
>
>
>indexed="false"/>
>
>
>
>/>
> multiValued="true"/>
>stored="true" />
>stored="true" />
>/>
>stored="true" />
>stored="true" />
>
> multiValued="true"/>
>
> default="NOW" multiValued="false"/>
>
> stored="true" multiValued="true"/>
>
> storyid
>
>
> And here is Types ...
>
>
>sortMissingLast="true" omitNorms="true"/>
>
>sortMissingLast="true" omitNorms="true"/>
>
>
>
> omitNorms="true" positionIncrementGap="0"/>
> precisionStep="0" omitNorms="true" positionIncrementGap="0"/>
> omitNorms="true" positionIncrementGap="0"/>
> precisionStep="0" omitNorms="true" positionIncrementGap="0"/>
>
> omitNorms="true" positionIncrementGap="0"/>
> precisionStep="8" omitNorms="true" positionIncrementGap="0"/>
> omitNorms="true" positionIncrementGap="0"/>
> precisionStep="8" omitNorms="true" positionIncrementGap="0"/>
>
> precisionStep="0" positionIncrementGap="0"/>
>
> precisionStep="6" positionIncrementGap="0"/>
>
>
>
>
>
> omitNorms="true"/>
> sortMissingLast="true" omitNorms="true"/>
>
> sortMissingLast="true" omitNorms="true"/>
> sortMissingLast="true" omitNorms="true"/>
> sortMissingLast="true" omitNorms="true"/>
> sortMissingLast="true" omitNorms="true"/>
>
> />
>
>
> positionIncrementGap="100">
>
>
>
>
>
> positionIncrementGap="100">
>
>
> words="stopwords.txt" enablePositionIncrements="false" />
> generateWordParts="1" generateNumberParts="1" catenateWords="1"
> catenateNumbers="1" catenateAll="0" splitOnCaseChange="1"/>
>
>
>
Re: Solr - Multi Term highlighting issue
Thank you for sending the definitions. I thought you defined n-gram based field for story and slug, but your definitions looks fine for me. I don't understand why you got such strange snippets. I think you can open a jira issue for this problem (sorry I cannot take it at this moment) with a test case that reproduces the problem would be much helpful. Koji (11/04/24 11:50), Ramanathapuram, Rajesh wrote: Hi Koji, My apologies for misunderstanding the question ... here is Fields ... storyid And here is Types ... thanks& regards, Rajesh Ramana -Original Message- From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] Sent: Saturday, April 23, 2011 9:51 PM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Hi Rajesh, My question was how story and slug fields are defined in schema.xml. In other words, please show us your and for those fields. Koji -- http://www.rondhuit.com/en/ (11/04/24 10:18), Ramanathapuram, Rajesh wrote: I don't have hl.fl defined in my schema.xml, I am passing it in as my query parameters story, slug The elongated parameters is sent like this... 'hl' => 'on', 'hl.fragsize' => $fragsize, 'hl.maxAnalyzedChars' => $fragsize, 'hl.fl' => 'slug,story', 'hl.simple.pre' => '', 'hl.simple.post' => '', Here is my query params in response - - 0 26 - 10 on story, slug standard on 10 2.2 true * 0 mec us chile standard true storyid=" X" Please let me know. thanks& regards, Rajesh Ramana -Original Message----- From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] Sent: Friday, April 22, 2011 8:38 PM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue How are your hl.fl fields defined in schema.xml? Koji -- http://www.rondhuit.com/en/ (11/04/23 1:23), Ramanathapuram, Rajesh wrote: Does anybody has other suggestions? thanks®ards, Rajesh Ramana Enterprise Applications, Turner Broadcasting System, Inc. 404.878.7474 -Original Message- From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] Sent: Wednesday, April 20, 2011 2:51 PM To: solr-user@lucene.apache.org Subject: RE: Solr - Multi Term highlighting issue Thanks Erick. I tried your suggestion, the issue still exists. http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2 &q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standa rd&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=100 000&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeCo ntiguous=false - 10 on false ... Corboba. (MEC)CHILE/FOREST FIRES ... thanks®ards, Rajesh Ramana -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 20, 2011 11:59 AM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20,
RE: Solr - Multi Term highlighting issue
Hi Koji, My apologies for misunderstanding the question ... here is Fields ... storyid And here is Types ... thanks & regards, Rajesh Ramana -Original Message- From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] Sent: Saturday, April 23, 2011 9:51 PM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Hi Rajesh, My question was how story and slug fields are defined in schema.xml. In other words, please show us your and for those fields. Koji -- http://www.rondhuit.com/en/ (11/04/24 10:18), Ramanathapuram, Rajesh wrote: > I don't have hl.fl defined in my schema.xml, I am passing it in as my > query parameters > > story, slug > > The elongated parameters is sent like this... > 'hl' => 'on', > 'hl.fragsize' => $fragsize, > 'hl.maxAnalyzedChars' => $fragsize, > 'hl.fl' => 'slug,story', > 'hl.simple.pre' => '', > 'hl.simple.post' => '', > > Here is my query params in response > > - > - > 0 > 26 > - >10 > >on >story, slug >standard >on >10 >2.2 >true >* >0 >mec us chile >standard >true >storyid=" X" > > > > Please let me know. > > thanks& regards, > Rajesh Ramana > > > -Original Message- > From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] > Sent: Friday, April 22, 2011 8:38 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr - Multi Term highlighting issue > > How are your hl.fl fields defined in schema.xml? > > Koji > -- > http://www.rondhuit.com/en/ > > (11/04/23 1:23), Ramanathapuram, Rajesh wrote: >> Does anybody has other suggestions? >> >> thanks& regards, >> Rajesh Ramana >> Enterprise Applications, Turner Broadcasting System, Inc. >> 404.878.7474 >> >> >> -Original Message- >> From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] >> Sent: Wednesday, April 20, 2011 2:51 PM >> To: solr-user@lucene.apache.org >> Subject: RE: Solr - Multi Term highlighting issue >> >> Thanks Erick. >> >> I tried your suggestion, the issue still exists. >> >> http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2 >> &q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standa >> rd&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=100 >> 000&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeCo >> ntiguous=false >> >> - >> 10 >> >> on >> false >> >> >> ... Corboba. (MEC)CHILE/FOREST FIRES ... >> >> >> thanks& regards, >> Rajesh Ramana >> >> >> -Original Message- >> From: Erick Erickson [mailto:erickerick...@gmail.com] >> Sent: Wednesday, April 20, 2011 11:59 AM >> To: solr-user@lucene.apache.org >> Subject: Re: Solr - Multi Term highlighting issue >> >> Does your configuration have "hl.mergeContiguous" set to true by any > chance? And what happens if you explicitly set this to &qu
Re: Solr - Multi Term highlighting issue
Hi Rajesh, My question was how story and slug fields are defined in schema.xml. In other words, please show us your and for those fields. Koji -- http://www.rondhuit.com/en/ (11/04/24 10:18), Ramanathapuram, Rajesh wrote: I don't have hl.fl defined in my schema.xml, I am passing it in as my query parameters story, slug The elongated parameters is sent like this... 'hl' => 'on', 'hl.fragsize' => $fragsize, 'hl.maxAnalyzedChars' => $fragsize, 'hl.fl' => 'slug,story', 'hl.simple.pre' => '', 'hl.simple.post' => '', Here is my query params in response - - 0 26 - 10 on story, slug standard on 10 2.2 true * 0 mec us chile standard true storyid=" X" Please let me know. thanks& regards, Rajesh Ramana -Original Message- From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] Sent: Friday, April 22, 2011 8:38 PM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue How are your hl.fl fields defined in schema.xml? Koji -- http://www.rondhuit.com/en/ (11/04/23 1:23), Ramanathapuram, Rajesh wrote: Does anybody has other suggestions? thanks& regards, Rajesh Ramana Enterprise Applications, Turner Broadcasting System, Inc. 404.878.7474 -Original Message- From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] Sent: Wednesday, April 20, 2011 2:51 PM To: solr-user@lucene.apache.org Subject: RE: Solr - Multi Term highlighting issue Thanks Erick. I tried your suggestion, the issue still exists. http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2 &q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standa rd&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=100 000&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeCo ntiguous=false - 10 on false ... Corboba. (MEC)CHILE/FOREST FIRES ... thanks& regards, Rajesh Ramana -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 20, 2011 11:59 AM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: Hello, I am dealing with a highlighting issue in SOLR, I will try to explain the issue. When I search for a single term in solr, it wraps tag around the words I want to highlight, all works well. But if I search multiple term, for most part highlighting works good and then for some of the terms, the highlight return multiple terms in a sing tag ... srchtrm1) srchtrm2 I expect solr to return highlight terms like...srchtrm1)... srchtrm2 When I search for 'US mec chile', here is how my result appears ... Corboba. (MEC)CHILE/FOREST FIRES: We had ... withUS andChile ..., (MEC)US This is what I was expecting it to be ... Corboba. (MEC)CHILE/FOREST FIRES: We had ... withUS andChile ..., (MEC)US Here is my query params - - 0 26 - 10 on story, slug standard on 10 2.2 true * 0 mec us chile standard true storyid=" X" Here are some other links I found in the forum, but no real conclusion http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr _ hi ghlighting_question#78163c42a67cb533 I am going to try this patch, which also had no conclusive results https://issues.apache.org/jira/browse/SOLR-1394 Has anyone come across this issue? Any suggestions on how to fix this issue is much appreciated. thanks& regards, Rajesh Ramana
RE: Solr - Multi Term highlighting issue
Also, I found this in SolrConfig.xml ...
dismax
explicit
0.01
text^0.5 features^1.0 name^1.2 sku^1.5 id^10.0 manu^1.1 cat^1.4
text^0.2 features^1.1 name^1.5 manu^1.4 manu_exact^1.9
popularity^0.5 recip(price,1,1000,1000)^0.3
id,name,price,score
2<-1 5<-2 6<90%
100
*:*
text features name
0
name
regex
And also this
100
70
0.5
[-\w ,/\n\"']{20,200}
Hope this sheds some light on identifying this issue.
thanks & regards,
Rajesh Ramana
-Original Message-
From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com]
Sent: Saturday, April 23, 2011 9:18 PM
To: solr-user@lucene.apache.org
Subject: RE: Solr - Multi Term highlighting issue
I don't have hl.fl defined in my schema.xml, I am passing it in as my
query parameters
story, slug
The elongated parameters is sent like this...
'hl' => 'on',
'hl.fragsize' => $fragsize,
'hl.maxAnalyzedChars' => $fragsize,
'hl.fl' => 'slug,story',
'hl.simple.pre' => '',
'hl.simple.post' => '',
Here is my query params in response
-
-
0
26
-
10
on
story, slug
standard
on
10
2.2
true
*
0
mec us chile
standard
true
storyid=" X"
Please let me know.
thanks & regards,
Rajesh Ramana
-----Original Message-
From: Koji Sekiguchi [mailto:k...@r.email.ne.jp]
Sent: Friday, April 22, 2011 8:38 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr - Multi Term highlighting issue
How are your hl.fl fields defined in schema.xml?
Koji
--
http://www.rondhuit.com/en/
(11/04/23 1:23), Ramanathapuram, Rajesh wrote:
> Does anybody has other suggestions?
>
> thanks& regards,
> Rajesh Ramana
> Enterprise Applications, Turner Broadcasting System, Inc.
> 404.878.7474
>
>
> -Original Message-
> From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com]
> Sent: Wednesday, April 20, 2011 2:51 PM
> To: solr-user@lucene.apache.org
> Subject: RE: Solr - Multi Term highlighting issue
>
> Thanks Erick.
>
> I tried your suggestion, the issue still exists.
>
> http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2
> &q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standa
> rd&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=100
> 000&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeCo
> ntiguous=false
>
> -
>100000
>
> on
> false
>
>
> ... Corboba. (MEC)CHILE/FOREST FIRES ...
>
>
> thanks& regards,
> Rajesh Ramana
>
>
> -Original Message-
> From: Erick Erickson [mailto:erickerick...@gmail.com]
> Sent: Wednesday, April 20, 2011 11:59 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Solr - Multi Term highlighting issue
>
> Does your configuration have "hl.mergeContiguous" set to true by any
chance? And what happens if you explicitly set this to "false" on your
query?
>
> Best
> Erick
>
> On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram,
Rajesh wrote:
>> Hello,
>>
>> I am dealing with a highlighting issue in SOLR, I will try to explain
>> the issue.
>>
>> When I search for a single term in solr, it wraps tag around the
>> words I want to highlight, all works well.
>> But if I search multiple term, for most part highlighting works good
>> and then for some of the terms, the highlight return multiple terms
in
>> a sing tag ...
>> srchtrm1) srchtrm2 I expect solr to return
>> highlight terms like...srchtrm1)...
>> srchtrm2
>>
>> When I search for 'US mec chile', here is how my result appears
>> ... Corboba. (MEC)CHILE/FOREST FIRES:
>> We had ... withUS andChile ...,
>> (MEC)US
>>
>> This is what I was expecting it to be
>> ... Corboba.
>> (MEC)CHILE/FOREST
>> FIRES: We had ... withUS andChile ...,
>> (MEC)US
>>
>> Here is my query params
>> -
>> -
>> 0
>> 26
>> -
>> 10
>>
>> on
>> story, slug
>> standard
>> on
>> 10
>> 2.2
>> true
>> *
>> 0
>> mec us chile
>> standard
>> true
>> storyid=" X"
>>
>>
>>
>> Here are some other links I found in the forum, but no real
>> conclusion
>>
>> http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr
>> _
>> hi
>> ghlighting_question#78163c42a67cb533
>>
>> I am going to try this patch, which also had no conclusive results
>>https://issues.apache.org/jira/browse/SOLR-1394
>>
>> Has anyone come across this issue?
>> Any suggestions on how to fix this issue is much appreciated.
>>
>>
>> thanks& regards,
>> Rajesh Ramana
>>
>
RE: Solr - Multi Term highlighting issue
I don't have hl.fl defined in my schema.xml, I am passing it in as my query parameters story, slug The elongated parameters is sent like this... 'hl' => 'on', 'hl.fragsize' => $fragsize, 'hl.maxAnalyzedChars' => $fragsize, 'hl.fl' => 'slug,story', 'hl.simple.pre' => '', 'hl.simple.post' => '', Here is my query params in response - - 0 26 - 10 on story, slug standard on 10 2.2 true * 0 mec us chile standard true storyid=" X" Please let me know. thanks & regards, Rajesh Ramana -Original Message- From: Koji Sekiguchi [mailto:k...@r.email.ne.jp] Sent: Friday, April 22, 2011 8:38 PM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue How are your hl.fl fields defined in schema.xml? Koji -- http://www.rondhuit.com/en/ (11/04/23 1:23), Ramanathapuram, Rajesh wrote: > Does anybody has other suggestions? > > thanks& regards, > Rajesh Ramana > Enterprise Applications, Turner Broadcasting System, Inc. > 404.878.7474 > > > -Original Message----- > From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] > Sent: Wednesday, April 20, 2011 2:51 PM > To: solr-user@lucene.apache.org > Subject: RE: Solr - Multi Term highlighting issue > > Thanks Erick. > > I tried your suggestion, the issue still exists. > > http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2 > &q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standa > rd&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=100 > 000&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeCo > ntiguous=false > > - >10 > > on > false .... > > > ... Corboba. (MEC)CHILE/FOREST FIRES ... > > > thanks& regards, > Rajesh Ramana > > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Wednesday, April 20, 2011 11:59 AM > To: solr-user@lucene.apache.org > Subject: Re: Solr - Multi Term highlighting issue > > Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? > > Best > Erick > > On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: >> Hello, >> >> I am dealing with a highlighting issue in SOLR, I will try to explain >> the issue. >> >> When I search for a single term in solr, it wraps tag around the >> words I want to highlight, all works well. >> But if I search multiple term, for most part highlighting works good >> and then for some of the terms, the highlight return multiple terms in >> a sing tag ... >> srchtrm1) srchtrm2 I expect solr to return >> highlight terms like...srchtrm1)... >> srchtrm2 >> >> When I search for 'US mec chile', here is how my result appears >> ... Corboba. (MEC)CHILE/FOREST FIRES: >> We had ... withUS andChile ..., >> (MEC)US >> >> This is what I was expecting it to be >> ... Corboba. >> (MEC)CHILE/FOREST >> FIRES: We had ... withUS andChile ..., >> (MEC)US >> >> Here is my query params >> - >> - >> 0 >> 26 >> - >> 10 >> >> on >> story, slug >> standard >> on >> 10 >> 2.2 >> true >> * >> 0 >> mec us chile >> standard >> true >> storyid=" X" >> >> >> >> Here are some other links I found in the forum, but no real >> conclusion >> >> http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr >> _ >> hi >> ghlighting_question#78163c42a67cb533 >> >> I am going to try this patch, which also had no conclusive results >>https://issues.apache.org/jira/browse/SOLR-1394 >> >> Has anyone come across this issue? >> Any suggestions on how to fix this issue is much appreciated. >> >> >> thanks& regards, >> Rajesh Ramana >> >
Re: Solr - Multi Term highlighting issue
How are your hl.fl fields defined in schema.xml? Koji -- http://www.rondhuit.com/en/ (11/04/23 1:23), Ramanathapuram, Rajesh wrote: Does anybody has other suggestions? thanks& regards, Rajesh Ramana Enterprise Applications, Turner Broadcasting System, Inc. 404.878.7474 -Original Message- From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] Sent: Wednesday, April 20, 2011 2:51 PM To: solr-user@lucene.apache.org Subject: RE: Solr - Multi Term highlighting issue Thanks Erick. I tried your suggestion, the issue still exists. http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2&q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standard&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=10&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeContiguous=false - 10 on false ... Corboba. (MEC)CHILE/FOREST FIRES ... thanks& regards, Rajesh Ramana -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 20, 2011 11:59 AM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: Hello, I am dealing with a highlighting issue in SOLR, I will try to explain the issue. When I search for a single term in solr, it wraps tag around the words I want to highlight, all works well. But if I search multiple term, for most part highlighting works good and then for some of the terms, the highlight return multiple terms in a sing tag ... srchtrm1) srchtrm2 I expect solr to return highlight terms like...srchtrm1)... srchtrm2 When I search for 'US mec chile', here is how my result appears ... Corboba. (MEC)CHILE/FOREST FIRES: We had ... withUS andChile ..., (MEC)US This is what I was expecting it to be ... Corboba. (MEC)CHILE/FOREST FIRES: We had ... withUS andChile ..., (MEC)US Here is my query params - - 0 26 - 10 on story, slug standard on 10 2.2 true * 0 mec us chile standard true storyid=" X" Here are some other links I found in the forum, but no real conclusion http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr_ hi ghlighting_question#78163c42a67cb533 I am going to try this patch, which also had no conclusive results https://issues.apache.org/jira/browse/SOLR-1394 Has anyone come across this issue? Any suggestions on how to fix this issue is much appreciated. thanks& regards, Rajesh Ramana
RE: Solr - Multi Term highlighting issue
Does anybody has other suggestions? thanks & regards, Rajesh Ramana Enterprise Applications, Turner Broadcasting System, Inc. 404.878.7474 -Original Message- From: Ramanathapuram, Rajesh [mailto:rajesh.ramanathapu...@turner.com] Sent: Wednesday, April 20, 2011 2:51 PM To: solr-user@lucene.apache.org Subject: RE: Solr - Multi Term highlighting issue Thanks Erick. I tried your suggestion, the issue still exists. http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2&q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standard&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=10&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeContiguous=false - 10 on false ... Corboba. (MEC)CHILE/FOREST FIRES ... thanks & regards, Rajesh Ramana -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 20, 2011 11:59 AM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: > Hello, > > I am dealing with a highlighting issue in SOLR, I will try to explain > the issue. > > When I search for a single term in solr, it wraps tag around the > words I want to highlight, all works well. > But if I search multiple term, for most part highlighting works good > and then for some of the terms, the highlight return multiple terms in > a sing tag ... > srchtrm1) srchtrm2 I expect solr to return > highlight terms like ... srchtrm1) ... > srchtrm2 > > When I search for 'US mec chile', here is how my result appears > ... Corboba. (MEC)CHILE/FOREST FIRES: > We had ... with US and Chile ..., > (MEC)US > > This is what I was expecting it to be > ... Corboba. (MEC)CHILE/FOREST > FIRES: We had ... with US and Chile ..., > (MEC)US > > Here is my query params > - > - > 0 > 26 > - > 10 > > on > story, slug > standard > on > 10 > 2.2 > true > * > 0 > mec us chile > standard > true > storyid=" X" > > > > Here are some other links I found in the forum, but no real conclusion > > http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr_ > hi > ghlighting_question#78163c42a67cb533 > > I am going to try this patch, which also had no conclusive results > https://issues.apache.org/jira/browse/SOLR-1394 > > Has anyone come across this issue? > Any suggestions on how to fix this issue is much appreciated. > > > thanks & regards, > Rajesh Ramana >
RE: Solr - Multi Term highlighting issue
Thanks Erick. I tried your suggestion, the issue still exists. http://localhost:8983/searchsolr/mainCore/select?indent=on&version=2.2&q=mec+us+chile&fq=storyid%3DXXX%22&start=0&rows=10&fl=*&qt=standard&wt=standard&explainOther=&hl=on&hl.fl=story%2C+slug&hl.fragsize=10&hl.highlightMultiTerm=true&hl.usePhraseHighlighter=true&hl.mergeContiguous=false - 10 on false ... Corboba. (MEC)CHILE/FOREST FIRES ... thanks & regards, Rajesh Ramana -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, April 20, 2011 11:59 AM To: solr-user@lucene.apache.org Subject: Re: Solr - Multi Term highlighting issue Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: > Hello, > > I am dealing with a highlighting issue in SOLR, I will try to explain > the issue. > > When I search for a single term in solr, it wraps tag around the > words I want to highlight, all works well. > But if I search multiple term, for most part highlighting works good > and then for some of the terms, the highlight return multiple terms in > a sing tag ... > srchtrm1) srchtrm2 I expect solr to return > highlight terms like ... srchtrm1) ... > srchtrm2 > > When I search for 'US mec chile', here is how my result appears > ... Corboba. (MEC)CHILE/FOREST FIRES: > We had ... with US and Chile ..., > (MEC)US > > This is what I was expecting it to be > ... Corboba. (MEC)CHILE/FOREST > FIRES: We had ... with US and Chile ..., > (MEC)US > > Here is my query params > - > - > 0 > 26 > - > 10 > > on > story, slug > standard > on > 10 > 2.2 > true > * > 0 > mec us chile > standard > true > storyid=" X" > > > > Here are some other links I found in the forum, but no real conclusion > > http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr_ > hi > ghlighting_question#78163c42a67cb533 > > I am going to try this patch, which also had no conclusive results > https://issues.apache.org/jira/browse/SOLR-1394 > > Has anyone come across this issue? > Any suggestions on how to fix this issue is much appreciated. > > > thanks & regards, > Rajesh Ramana >
Re: Solr - Multi Term highlighting issue
Does your configuration have "hl.mergeContiguous" set to true by any chance? And what happens if you explicitly set this to "false" on your query? Best Erick On Wed, Apr 20, 2011 at 9:43 AM, Ramanathapuram, Rajesh wrote: > Hello, > > I am dealing with a highlighting issue in SOLR, I will try to explain > the issue. > > When I search for a single term in solr, it wraps tag around the > words I want to highlight, all works well. > But if I search multiple term, for most part highlighting works good and > then for some of the terms, > the highlight return multiple terms in a sing tag ... > srchtrm1) srchtrm2 > I expect solr to return highlight terms like ... srchtrm1) > ... srchtrm2 > > When I search for 'US mec chile', here is how my result appears > ... Corboba. (MEC)CHILE/FOREST FIRES: We > had ... with US and Chile ..., > (MEC)US > > This is what I was expecting it to be > ... Corboba. (MEC)CHILE/FOREST > FIRES: We had ... with US and Chile ..., > (MEC)US > > Here is my query params > - > - > 0 > 26 > - > 10 > > on > story, slug > standard > on > 10 > 2.2 > true > * > 0 > mec us chile > standard > true > storyid=" X" > > > > Here are some other links I found in the forum, but no real conclusion > > http://www.lucidimagination.com/search/document/ac64e4f0abb6e4fc/solr_hi > ghlighting_question#78163c42a67cb533 > > I am going to try this patch, which also had no conclusive results > https://issues.apache.org/jira/browse/SOLR-1394 > > Has anyone come across this issue? > Any suggestions on how to fix this issue is much appreciated. > > > thanks & regards, > Rajesh Ramana >
