Hi, You can dump the crawldb with readdb -dump to a file and inspect the state for each url.
Cheers, Ps. please start a separate thread for new subjects On Sunday 15 May 2011 17:03:08 jeffersonzhou wrote: > Hi, > > I notice that some urls can be unfetched after a crawl job. How can I get > all the unfetched urls, evaluate them and if possible put them into the > fetch list again? > > Thanks -- Markus Jelsma - CTO - Openindex http://www.linkedin.com/in/markus17 050-8536620 / 06-50258350
