On Fri, May 22, 2009 at 3:37 PM, DM Smith <dmsmith...@gmail.com> wrote:
> So, what is it that they use that leads to such unfavorable results? I think it's simply that they take each search engine, get it to index their collection in the most obvious way, perhaps having read a tutorial somewhere, and test that. I'm guessing they don't spend much time tuning any of the search engines for what they are testing. So those with the best defaults make the best impression. First impressions count :) So eg they don't turn off CFS, don't increase IW's RAM buffer, don't turn off scoring when sorting by field, fail to omitTFAP when testing "pure boolean" searching, etc. These tunings are well known to all of us, but to 95% of Lucene users, including your casual reviewer, they aren't. I expect non-reviewers do the same, when they want try out different search engines. I think it's the vast minority of people who actually come out to java-user to ask for help, and I bet most "potential new users" never discover the tuning tips on the wiki. (And: I fully agree, said reviewer and said new user *should* to do their homework and tune each engine to their fullest; likewise, readers of such reviews *should* scrutinize whether the testing was fair; yet typically they don't). Mike --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org
