Unfortunately you have to start over. We started breaking our crawls into 100K to 500K runs because of this.
Dennis Abdelhakim Diab wrote: > Hi all: > What can I do if I were crawling a big list of sites and suddenly the > crawler stopped for any problem ? > must I return the whole process or I can continue from the point I > stopped at ? > > Thanks in advance ....... ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
