[
https://issues.apache.org/jira/browse/SOLR-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184843#comment-15184843
]
Alessandro Benedetti edited comment on SOLR-8542 at 3/8/16 12:36 PM:
---------------------------------------------------------------------
A couple of questions, for some specific use case :
1) Grouping
How does the plugin behave for grouping ? Let's assume we have 1000 docs in 5
groups, even if we return only 1 doc per group, i assume the plugin will :
1) first re-score the top K >>x ( so re-scoring 1000 docs )
2) group the results
3) return the 5 groups ( each one for example with top document)
Or will be possible to re-rank only the top document per group ? ( so only the
5 top documents )
According to the re-rank official solr documentation :
"Combining Ranking Queries With Other Solr Features
The "rq" parameter and the re-ranking feature in general works well with other
Solr features. For example, it can be used in conjunction with the collapse
parser to re-rank the group heads after they've been collapsed. It also
preserves the order of documents elevated by the elevation component. And it
even has it's own custom explain so you can see how the re-ranking scores were
derived when looking at debug information."
Can we assume this would happen with the LTR plugin as well ?
2) Join - Parent Search
Let's assume we return parents based on a query on the children .
Just wondering how to combine the block join query parser to the LTR re-rank,
to re-rank only the parents ( without re-scoring the children) .
Also in this case, according to the re-rank documentation, it seems to be
compatible, is the plugin going to work with that as well ?
I will take a look on my own on these topics, but any thought would be much
appreciated :)
was (Author: alessandro.benedetti):
A couple of questions, for some specific use case :
1) Grouping
How does the plugin behave for grouping ? Let's assume we have 1000 docs in 5
groups, even if we return only 1 doc per group, i assume the plugin will :
1) first re-score the top K >>x ( so re-scoring 1000 docs )
2) group the results
3) return the 5 groups ( each one for example with top document)
Or will be possible to re-rank only the top document per group ? ( so only the
5 top documents )
2) Join - Parent Search
Let's assume we return parents based on a query on the children .
Just wondering how to combine the block join query parser to the LTR re-rank,
to re-rank only the parents ( without re-scoring the children) .
I will take a look on my own on these topics, but any thought would be much
appreciated :)
> Integrate Learning to Rank into Solr
> ------------------------------------
>
> Key: SOLR-8542
> URL: https://issues.apache.org/jira/browse/SOLR-8542
> Project: Solr
> Issue Type: New Feature
> Reporter: Joshua Pantony
> Assignee: Christine Poerschke
> Priority: Minor
> Attachments: README.md, README.md, SOLR-8542-branch_5x.patch,
> SOLR-8542-trunk.patch
>
>
> This is a ticket to integrate learning to rank machine learning models into
> Solr. Solr Learning to Rank (LTR) provides a way for you to extract features
> directly inside Solr for use in training a machine learned model. You can
> then deploy that model to Solr and use it to rerank your top X search
> results. This concept was previously presented by the authors at Lucene/Solr
> Revolution 2015 (
> http://www.slideshare.net/lucidworks/learning-to-rank-in-solr-presented-by-michael-nilsson-diego-ceccarelli-bloomberg-lp
> ).
> The attached code was jointly worked on by Joshua Pantony, Michael Nilsson,
> David Grohmann and Diego Ceccarelli.
> Any chance this could make it into a 5x release? We've also attached
> documentation as a github MD file, but are happy to convert to a desired
> format.
> h3. Test the plugin with solr/example/techproducts in 6 steps
> Solr provides some simple example of indices. In order to test the plugin
> with
> the techproducts example please follow these steps
> h4. 1. compile solr and the examples
> cd solr
> ant dist
> ant example
> h4. 2. run the example
> ./bin/solr -e techproducts
> h4. 3. stop it and install the plugin:
>
> ./bin/solr stop
> mkdir example/techproducts/solr/techproducts/lib
> cp build/contrib/ltr/lucene-ltr-6.0.0-SNAPSHOT.jar
> example/techproducts/solr/techproducts/lib/
> cp contrib/ltr/example/solrconfig.xml
> example/techproducts/solr/techproducts/conf/
> h4. 4. run the example again
>
> ./bin/solr -e techproducts
> h4. 5. index some features and a model
> curl -XPUT 'http://localhost:8983/solr/techproducts/schema/fstore'
> --data-binary "@./contrib/ltr/example/techproducts-features.json" -H
> 'Content-type:application/json'
> curl -XPUT 'http://localhost:8983/solr/techproducts/schema/mstore'
> --data-binary "@./contrib/ltr/example/techproducts-model.json" -H
> 'Content-type:application/json'
> h4. 6. have fun !
> *access to the default feature store*
> http://localhost:8983/solr/techproducts/schema/fstore/_DEFAULT_
> *access to the model store*
> http://localhost:8983/solr/techproducts/schema/mstore
> *perform a query using the model, and retrieve the features*
> http://localhost:8983/solr/techproducts/query?indent=on&q=test&wt=json&rq={!ltr%20model=svm%20reRankDocs=25%20efi.query=%27test%27}&fl=*,[features],price,score,name&fv=true
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
