Did the analyzer for this field remove some tokens?

Sent from my iPhone

> On 9. Aug 2023, at 16:43, 承諾一輩子 <502565...@qq.com.invalid> wrote:
> 
> Dear colleague:
> &nbsp; &nbsp;I am a drive development engineer works in ZTE corporation from 
> China.
> &nbsp; &nbsp;Recently in learning lucene source code.There is a question that 
> puzzled me for a long time, as follows:
> &nbsp; &nbsp;How to understand the approximate handing mechanism for field 
> length "dl" in the BM25Scorer class? For example, "keywords" field has 78 
> tokens. I think its field_length(dl) is 78, but lucene handled as 
> 76(approximate) as described in function explainTF(Explaination freq, long 
> norm).
> &nbsp; &nbsp;Thank you very much for your reading and look forward to your 
> answer!
> 
> 
> Koo&nbsp;
> Drive development engineer

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to