I am curious; there are a lot more dynamic sites out there with some intereting links. What are some of the more interesting public sites that you have crawled.
For example; I have been crawling reddit.com and digg.com recently and have gotten back some interesting search results. I thought crawling wikipedia and having an searchable index of words and keyphrases. ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
