Dennis
Abdelhakim Diab wrote:
Hi all:What can I do if I were crawling a big list of sites and suddenly the crawler stopped for any problem ? must I return the whole process or I can continue from the point I stopped at ?Thanks in advance .......
Unfortunately you have to start over. We started breaking our crawls
into 100K to 500K runs because of this.
