> I'm planning to do some information retrieval experiments > with Solr. > I'd like to compare different IR methods. I have a test > collection > with topics and judgements available. I'm considering using > Solr (and > not Lemur/Indri etc.) for the tests, because Solr supports > several > nice methods out-of-the-box, e.g. n-grams. > > Finally, I plan to evaluate the different methods and their > results > with trec_eval or similar program. What I need is a > program, which > puts Solr results in a suitable format for trec_eval. I > think I can > get the Solr search results in that format quite easily by > using the > solr-php-client library. > > Have any of you run "TREC-style" IR experiments with Solr > and what are > your experiences with that? Do you have any suggestion for > that kind > of tests with Solr?
There some existing implementations in Lucene http://lucene.apache.org/java/3_0_2/api/contrib-benchmark/org/apache/lucene/benchmark/quality/trec/package-summary.html