Hi there, how can i avoid the following error:-shouldFetch rejected 'http://www.page.com/shop', fetchTime=1356347311285, curTime=1353755337755
I want my crawler to crawl the complete page without setting up schedulers at all. Every crawl process should crawl every page again without having setup wait intervals.
Any solution?

