Hi I'm not sure this applies to you because i don't know what you mean by > `running crawler`; never run the fetcher for longer than an hour orso. >
Thank you for the reply. I have seen fetcher run for more time like 3-5 hours and more. I think based on both of your suggestions, i will try to see if i can switch my database and not to use the crawl class but use the crawl script. I will start a new script and try to see if it makes any changes in the performance. Thank you, Kiran. -- Kiran Chitturi

