On Wed, 2008-10-22 at 07:50 -0400, John Martyniak wrote: > Are the main differences between Nutch and Solr, that Solr doesn't > have a spider. So in order to use it you would have to spider the web > your self, or with some other tool?
You can use Apache Droids as spider (for small and medium size needs). If you want to crawl the whole web within a cluster the nutch is the right choice. However Ryan (from solr) is ATM working on an enhanced version of the solr droid that we currently have and it looks very promising. Droids has just entered the incubator but the code is getting in shape pretty quick. Till we have finish the move to the incubator you can have a look at http://people.apache.org/~thorsten/droids/ and https://svn.apache.org/repos/asf/labs/droids/trunk Like mentioned before we ATM refactoring the code (not in trunk but in a branch) however we will merge this soon back into trunk. salu2 -- Thorsten Scherler thorsten.at.apache.org Open Source Java consulting, training and solutions
