Matthew Holt wrote:
Just fyi,.. both of the sites I am trying to crawl are under the same domain. The sub-domains just differ. Works for one, the other it o nly appears to fetch 6 or so pages then doesn't fetch anymore. Do you need any more information to solve the problem? I've tried everything and havent' had any luck.. Thanks.
What does your crawl-urlfilter.txt look like? Stefan
