Basically I'd like to know the effects of restarting the cycle, generating,
fetching, etc. when previously the cycle did not complete through to the end
of updating the crawldb.

AFAIK, you can not restart a crawl i.e. the last fetch cycle is gone.
But you can restart
the last fetch cycle So if you have fetched 5 rounds and then you got
stuck on 6th. Just redo the
6th.

The way I would solve the problem is to have smaller fetch list. so
you fetch x thousand page
per cycle. This way you will loose less time if crawl fails. You can
achieve that using the "generate" command and "Top N" parameters.

Regards

Reply via email to