Yes you would need to run parsing after fetching and before updatedb.
John Mendenhall wrote:
On Fri, 25 Jan 2008, Dennis Kubes wrote:
Is the recommendation to run fetcher in parsing mode?
If so, when should the parse be done? After the updatedb?
Before the indexing?
You would run the parsing after the fetch process. But this way the
fetch would complete the download and if the parsing failed you would
still have the page content and be able to try again without refetching.
To clarify, run the parsing after the fetch process
and before the updatedb process, correct?
Thanks!
JohnM
