Re: Difference in fieldLengh and avgFieldLength in Solr 6.6 vs Solr 7.1

[Alessandro Benedetti]

Shoot in the dark, I have not double checked in details but :

With Solr 7.x
"Index-time boosts have been removed from Lucene, and are no longer
available from Solr. If any boosts are provided, they will be ignored by the
indexing chain. As a replacement, index-time scoring factors should be
indexed in a separate field and combined with the query score using a
function query. See the section Function Queries for more information."

Are you using index time boost by any chance ?
If I remember correctly the Norms stored in the segment were affected by the
field length and index time boost.

Cheers



-
---
Alessandro Benedetti
Search Consultant, R Software Engineer, Director
Sease Ltd. - www.sease.io
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Difference in fieldLengh and avgFieldLength in Solr 6.6 vs Solr 7.1

[rupali pol]

Hi all,

We are doing upgrade from Solr 6.6 to Solr 7.1, we are seeing lot of
differneces in raking and scores of Solr 6.6 and Solr7.1 results.

The major differences we observed are in fieldLengh and avgFieldLength
parameters which are calculated per field, per document, per search term.

*Calculation of tfNorm in Solr 7.1.0 -*
tfNorm, computed as (freq * (k1 + 1)) / (freq + k1 * (1 - b + b *
fieldLength / avgFieldLength)) from:
fieldLength *53272.0* 4087877% 4087877%
avgFieldLength *7284.33100* 558970% 558970%
termFreq=10.0 10.0 767% 767%
parameter k1 1.2 92% 92%
parameter b 0.75000 58% 58%

*Calculation of tfNorm for same in Solr 6.6.0 -*
tfNorm, computed as (freq * (k1 + 1)) / (freq + k1 * (1 - b + b *
fieldLength / avgFieldLength)) from:
fieldLength *65536.0* 5480182% 5480182%
avgFieldLength *7284.83060* 609164% 609164%
termFreq=10.0 10.0 836% 836%
parameter k1 1.2 100% 100%
parameter b 0.75000 63% 63%


Can someone please elaborate on what differences are brought in Solr7.1 for
the fieldLength calculation?

Thanks in advance.

Best,
Rups