[
https://issues.apache.org/jira/browse/SOLR-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925596#comment-13925596
]
Markus Jelsma commented on SOLR-1632:
-------------------------------------
Hi Vitaly, are you sure it still works? I tried your and few older patches
again but docCounts are no longer the sum of the cluster size. The GET_STATS
query is executed though.
Two node test cluster:
{code}
384841 [qtp1175813699-17] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={distrib=false&debug=track&wt=javabin&requestPurpose=GET_TERM_STATS&version=2&rows=10&debugQuery=false&shard.url=http://127.0.1.1:8983/solr/collection1/&NOW=1394444039677&rid=-collection1-1394444039677-12&shards.purpose=2&q=wiki&isShard=true}
status=0 QTime=1
384848 [qtp1175813699-17] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={distrib=false&debug=track&wt=javabin&requestPurpose=GET_TOP_IDS,GET_STATS,GET_TERMS,GET_MLT_RESULTS,SET_TERM_STATS&version=2&rows=10&org.apache.solr.stats.colStats=content_nl,121630,115956,16436279,11372267&org.apache.solr.stats.terms=content_nl:wiki&NOW=1394444039677&shard.url=http://127.0.1.1:8983/solr/collection1/&debugQuery=false&fl=id,score&shards.purpose=5636&rid=-collection1-1394444039677-12&start=0&q=wiki&org.apache.solr.stats.termStats=content_nl:wiki,284,645&isShard=true&fsv=true}
hits=138 status=0 QTime=1
384863 [qtp1175813699-17] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={ids=http://nl.wikipedia.org/wiki/Overleg_sjabloon:Infobox_film,http://nl.wikipedia.org/wiki/Overleg_sjabloon:Navigatie_Bijbel,http://nl.wikipedia.org/wiki/Overleg_help:Gebruik_van_sjablonen,http://nl.wikipedia.org/wiki/Overleg_sjabloon:Citeer_boek,http://nl.wikipedia.org/wiki/Overleg_sjabloon:Wikt&distrib=false&debug=track&wt=javabin&requestPurpose=GET_FIELDS,GET_DEBUG&version=2&rows=10&debugQuery=true&shard.url=http://127.0.1.1:8983/solr/collection1/&NOW=1394444039677&rid=-collection1-1394444039677-12&shards.purpose=320&q=wiki&isShard=true}
status=0 QTime=7
384870 [qtp1175813699-13] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select params={debugQuery=true&q=wiki}
rid=-collection1-1394444039677-12 hits=284 status=0 QTime=33
{code}
{code}
380242 [qtp1175813699-16] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={distrib=false&debug=track&wt=javabin&requestPurpose=GET_TERM_STATS&version=2&rows=10&debugQuery=false&shard.url=http://127.0.1.1:7574/solr/collection1/&NOW=1394444039677&rid=-collection1-1394444039677-12&shards.purpose=2&q=wiki&isShard=true}
status=0 QTime=0
380249 [qtp1175813699-16] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={distrib=false&debug=track&wt=javabin&requestPurpose=GET_TOP_IDS,GET_STATS,GET_TERMS,GET_MLT_RESULTS,SET_TERM_STATS&version=2&rows=10&org.apache.solr.stats.colStats=content_nl,121630,115956,16436279,11372267&org.apache.solr.stats.terms=content_nl:wiki&NOW=1394444039677&shard.url=http://127.0.1.1:7574/solr/collection1/&debugQuery=false&fl=id,score&shards.purpose=5636&rid=-collection1-1394444039677-12&start=0&q=wiki&org.apache.solr.stats.termStats=content_nl:wiki,284,645&isShard=true&fsv=true}
hits=146 status=0 QTime=2
380263 [qtp1175813699-16] INFO org.apache.solr.core.SolrCore – [collection1]
webapp=/solr path=/select
params={ids=http://nl.wikipedia.org/wiki/Overleg_sjabloon:Navigatie,http://nl.wikipedia.org/wiki/Overleg_help:Waarom_staat_mijn_bestand_op_de_beoordelingslijst,http://nl.wikipedia.org/wiki/Overleg_help:Wikipediachat,http://nl.wikipedia.org/wiki/Overleg_sjabloon:Coördinaten,http://nl.wikipedia.org/wiki/Overleg_sjabloon:Sjabdoc/doc&distrib=false&debug=track&wt=javabin&requestPurpose=GET_FIELDS,GET_DEBUG&version=2&rows=10&debugQuery=true&shard.url=http://127.0.1.1:7574/solr/collection1/&NOW=1394444039677&rid=-collection1-1394444039677-12&shards.purpose=320&q=wiki&isShard=true}
status=0 QTime=6
{code}
But i get these scores:
{code}
12.8123455 = (MATCH) weight(content_nl:wiki in 18636) [], result of:
12.8123455 = score(doc=18636,freq=33.0 = termFreq=33.0
), product of:
6.0355678 = idf(docFreq=138, docCount=57897)
2.122807 = tfNorm, computed from:
33.0 = termFreq=33.0
1.2 = parameter k1
0.0 = parameter b (norms omitted for field)
{code}
{code}
12.558066 = (MATCH) weight(content_nl:wiki in 60634) [], result of:
12.558066 = score(doc=60634,freq=25.0 = termFreq=25.0
), product of:
5.982207 = idf(docFreq=146, docCount=58059)
2.0992365 = tfNorm, computed from:
25.0 = termFreq=25.0
1.2 = parameter k1
0.0 = parameter b (norms omitted for field)
{code}
Did it work for you?
> Distributed IDF
> ---------------
>
> Key: SOLR-1632
> URL: https://issues.apache.org/jira/browse/SOLR-1632
> Project: Solr
> Issue Type: New Feature
> Components: search
> Affects Versions: 1.5
> Reporter: Andrzej Bialecki
> Assignee: Mark Miller
> Fix For: 4.7, 5.0
>
> Attachments: 3x_SOLR-1632_doesntwork.patch, SOLR-1632.patch,
> SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch,
> SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch,
> SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch, distrib-2.patch,
> distrib.patch
>
>
> Distributed IDF is a valuable enhancement for distributed search across
> non-uniform shards. This issue tracks the proposed implementation of an API
> to support this functionality in Solr.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
