I'm using the latest checkout (http://svn.apache.org/repos/asf/lucene/nutch/trunk rev 400163) with Java 1.5.
I've been trying to follow the tutorial for whole web crawling which is found at http://lucene.apache.org/nutch/tutorial8.html#Whole-web+Crawling For the most part, I get through the tutorial just fine, although I did have to look at the latest command line options for the invertlinks and index commands to make it work. Now if I want to update my index, I do: generate, fetch, updatedb, invertlinks, index. But I can't run the index command a second time because it complains that the indexes directory already exists. How am I suppose to update the index? Also, in other tutorials I see a dedup command. What is this used for and when should I use it? Thank you so much for your help. --Jacob ------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid0709&bid&3057&dat1642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
