Does there exist a documentation about nutch's ranking algorithm (apart from the code)? I
would like to analyze it and to suggest improvements. I think it is very important to
understand the ranking in detail to guarantee unbiased results. And, as you write on
nutch's homepage, some of your parameters are guessed. Perhaps a detailed mathematical
analysis can help here.
The ranking is done with Lucene, whose basic ranking framework is documented in:
http://jakarta.apache.org/lucene/docs/api/org/apache/lucene/search/Similarity.html
http://jakarta.apache.org/lucene/docs/api/org/apache/lucene/search/DefaultSimilarity.html
The particulars of Nutch's implementation are not yet documented outside of the code. The code in question is:
http://cvs.sourceforge.net/viewcvs.py/nutch/nutch/src/java/net/nutch/indexer/NutchSimilarity.java?view=markup
http://cvs.sourceforge.net/viewcvs.py/nutch/nutch/src/java/net/nutch/indexer/IndexSegment.java?rev=1.14&view=auto
http://cvs.sourceforge.net/viewcvs.py/nutch/nutch/src/java/net/nutch/searcher/QueryTranslator.java?rev=1.3&view=auto
A good way to start might be to look at a scoring implementation, such as:
http://kodiak.cs.cornell.edu:8080/explain.jsp?idx=0&id=1275&query=computer%20science
http://www.mozdex.com/explain.jsp?idx=0&id=3064977&query=search+engine
Note that these last URLs will probably break when these indexes are next updated.
I hope this helps. If you have more detailed questions, do not hesitate to email this list.
Cheers,
Doug
------------------------------------------------------- This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
