Regarding ORP and TREC and the nasty comments that somebody dropped onto Otis blog, the OSHUMED collection is, I believe easily available without difficulties or payment (I don't know about redistribution).
This collection is smallish, but can be used in a variety of interesting ways for ad-hoc or routing evaluations. For instance, the TREC-9 OSHUMED routing task can be recast as a retrieval task by using category text as a query. On Mon, May 18, 2009 at 8:28 PM, Otis Gospodnetic < otis_gospodne...@yahoo.com> wrote: > > Been thinking about ORP on and off all day today... and Mark brought up the > benchmark contrib. Shouldn't we publish Lucene results for that somewhere > on the site? > >
