Solr proximity search highlighting issue

[Nirav Shah]

Hello Dev Team,

I found some problem in highlighting module. Not all the search terms are 
getting highlighted.

Sample query: q={!complexphrase+inOrder=true}"pos1 (pos2 OR pos3)"~30&hl=true
Indexed text: "pos1 pos2 pos3 pos4"

please find attached response xml screen shot from solr.

You can see that only two terms are highlighted like, "pos1 
pos2 pos3 pos4"

The scenario is same in Solr source code since long time (I have checked in 
Solr version 4 to version 7). The scenario is when term positions are in-order 
in document and query both.

Please let me know your view on this.

Thank you,
Amit



pos1 pos2 pos3 pos4

Re: FW: Solr proximity search highlighting issue

[Charlie Hull]

I may be wrong here, but the problem may be that the match was on your 
terms pos1 and pos2 (you don't need the pos3 term to match, due to the 
OR operator) and thus that's what's been highlighted.


There's a hl.q parameter that lets you supply a different query for 
highlighting to the one you're using for searching, perhaps that could 
have a different and more forgiving pattern that made sure all your 
terms were highlighted?


Also, the XML didn't come through as this list strips attachments.

Best

Charlie

On 31/03/2020 19:27, Anil Shingala wrote:


Hello Dev Team,

I found some problem in highlighting module. Not all the search terms 
are getting highlighted.


Sample query: q={!complexphrase+inOrder=true}"pos1 (pos2 OR 
pos3)"~30&hl=true


Indexed text: "pos1 pos2 pos3 pos4"

please find attached response xml screen shot from solr.

You can see that only two terms are highlighted like, "pos1 
pos2 pos3 pos4"


The scenario is same in Solr source code since long time (I have 
checked in Solr version 4 to version 7). The scenario is when term 
positions are in-order in document and query both.


Please let me know your view on this.

Regards,

Anil Shingala

*Knovos*
10521 Rosehaven Street, Suite 300 | Fairfax, VA 22030 (USA)
Office +1 703.226.1505

Main +1 703.226.1500 | +1 877.227.5457

/ashing...@knovos.com/ 
/_|_//www.knovos.com/ 



Washington DC | New York | London | Paris | Gandhinagar | Tokyo

/Knovos was formerly also known as Capital Novus or Capital Legal 
Solutions. The information contained in this email message may be 
confidential or legally privileged. If you are not the intended 
recipient, please advise the sender by replying to this email and by 
immediately deleting all copies of this message and any attachments. 
Knovos, LLC is not authorized to practice law./




--
Charlie Hull
OpenSource Connections, previously Flax

tel/fax: +44 (0)8700 118334
mobile:  +44 (0)7767 825828
web: www.o19s.com

FW: Solr proximity search highlighting issue

[Anil Shingala]

Hello Dev Team,

I found some problem in highlighting module. Not all the search terms are 
getting highlighted.

Sample query: q={!complexphrase+inOrder=true}"pos1 (pos2 OR pos3)"~30&hl=true
Indexed text: "pos1 pos2 pos3 pos4"

please find attached response xml screen shot from solr.

You can see that only two terms are highlighted like, "pos1 
pos2 pos3 pos4"

The scenario is same in Solr source code since long time (I have checked in 
Solr version 4 to version 7). The scenario is when term positions are in-order 
in document and query both.

Please let me know your view on this.

Regards,
Anil Shingala
Knovos
10521 Rosehaven Street, Suite 300 | Fairfax, VA 22030 (USA)
Office +1 703.226.1505
Main +1 703.226.1500 | +1 877.227.5457
ashing...@knovos.com | 
www.knovos.com

Washington DC | New York | London | Paris | Gandhinagar | Tokyo

Knovos was formerly also known as Capital Novus or Capital Legal Solutions. The 
information contained in this email message may be confidential or legally 
privileged. If you are not the intended recipient, please advise the sender by 
replying to this email and by immediately deleting all copies of this message 
and any attachments. Knovos, LLC is not authorized to practice law.



pos1 pos2 pos3 pos4

Re: Highlighting issue with PlainTextEntityProcessor.

[meghana]

Hi Erik.. Thanks for your reply.

And yes data was on index. but i found the problem , the problem was not of
PlainTextEntityProcessor. highlighting was returning in multivalued field
and in non-multivalued field there was less highlight. so i thought problem
may be in PlainTextEntityProcessor. 

But the actual problem was my Search field is very big... i increased
hl.MaxAnalyzedChar length... and it get working. 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Highlighting-issue-with-PlainTextEntityProcessor-tp3650004p3653708.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Highlighting issue with PlainTextEntityProcessor.

[Erick Erickson]

Well, are you sure that the data is *in* the index? Did you change
maxFieldLength in solrconfig.xml?

First, I'd be sure that the data is in the stored field to highlight.

Best
Erick

Out of curiosity, why did you have to change from multValued?



On Wed, Jan 11, 2012 at 3:29 AM, meghana  wrote:
> Hi all,
>
> My Solr Configuration had one multi-valued field which is imported using
> XPathEntityProcess and TemplateTransformer . Then we had  to convert it to
> non-multivlaued field, We did that using PlainTextEntityProcessor and Script
> Transformer.
>
> Search on my old configuration was working fine ,  it returns me documents
> with proper highlighting. After changing multi-valued to non-multivalued
> field, on search i get less highlighting for few documents than older one.
>
> e.g i search with search Term 'cat' ,
>
> in old configuration i get one result as below
> 
> 
> Is that a cat?
> Is that a real cat?
> Oh, my God, it's a German cat?!
> I won't rub this cat
> Drop the cat or I rip
> Without cats?
> Forget the cat, rommy.
> You steal cats?
> 
>
>
> in new configuration i get it as below
> 
> 
> Is that a cat?
> Is that a real cat?
> Oh, my God, it's a German cat?!
> I won't rub this cat
> Drop the cat or I rip
> 
>
> aslo for few documents , i get record but with 0 highlighting.
> Do anybody have idea on this??
> Thanks
> Meghana
>
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/Highlighting-issue-with-PlainTextEntityProcessor-tp3650004p3650004.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Highlighting issue with PlainTextEntityProcessor.

[meghana]

Hi all,

My Solr Configuration had one multi-valued field which is imported using
XPathEntityProcess and TemplateTransformer . Then we had  to convert it to
non-multivlaued field, We did that using PlainTextEntityProcessor and Script
Transformer. 

Search on my old configuration was working fine ,  it returns me documents
with proper highlighting. After changing multi-valued to non-multivalued
field, on search i get less highlighting for few documents than older one. 

e.g i search with search Term 'cat' , 

in old configuration i get one result as below


Is that a cat?
Is that a real cat?
Oh, my God, it's a German cat?!
I won't rub this cat
Drop the cat or I rip
Without cats?
Forget the cat, rommy.
You steal cats?



in new configuration i get it as below


Is that a cat?
Is that a real cat?
Oh, my God, it's a German cat?!
I won't rub this cat
Drop the cat or I rip


aslo for few documents , i get record but with 0 highlighting.
Do anybody have idea on this??
Thanks
Meghana


--
View this message in context: 
http://lucene.472066.n3.nabble.com/Highlighting-issue-with-PlainTextEntityProcessor-tp3650004p3650004.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr 1.4 highlighting issue

[Dmitry Kan]

Hi Mike,

Actually, the example I gave is the document in this case. So there was no
"ships", only "drilling".

Dmitry

On Wed, Sep 14, 2011 at 1:59 PM, Michael Sokolov wrote:

> The highlighter gives you snippets of text surrounding words (terms) drawn
> from the query.  The whole document should satisfy the query (ie it probably
> has ships/s somewhere else in it), but each snippet won't generally have all
> the terms.
>
> -Mike
>
>
> On 9/14/2011 2:54 AM, Dmitry Kan wrote:
>
>> Hello list,
>>
>> Not sure how many of you are still using solr 1.4 in production, but here
>> is
>> an issue with highlighting, that we've noticed:
>>
>> The query is:
>>
>> (drill AND ships) OR rigs
>>
>>
>> Excerpt from the highlighting list:
>>
>> 
>> 
>> Within the fleet of 27 floatingrigs  (semisubmersibles and
>> drillships) are 21 deepwaterdrilling
>> 
>> 
>> 
>>
>>
>>
>> Why did solr highlight "drilling" even though there is no "ships" in the
>> text?
>>
>> *
>> *--
>> Regards,
>>
>> Dmitry Kan
>>
>>
>


-- 
Regards,

Dmitry Kan