Hi, I understand that your crawl is still in progress. Each iteration of the fetch cycle returns those URLs that were 'generate'd in the previous fetch cycle. Obviously, as the crawl tends towards the end, the fetched URLs will increase and implicitly the unfetched URLs will decrease.
This is perfectly normal behavior. Request you to revert at the end of the crawl Regards. Neelesh Rathore wrote: > > hello every one, > > I had trying to do crawling on one url , and my crawling is still in > progress , but when i had tryed to see the statstics by crawl readdb i got > that the ratio of db-fetched and db-unfeched is very large. > i found total urls around 20000 but the fatched urls are only 1600 . > > please suggest me what to do. > > Thanks > > Neelesh > > > > -- View this message in context: http://www.nabble.com/nutch-crawl---strange-results-tf3388987.html#a9433123 Sent from the Nutch - User mailing list archive at Nabble.com. ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
