Hello All,

   There is a site that has total 5 URLS.


   - When this site is crawled with input param for depth 3 , all 5 sites
   are crawled in one shot.

   - And when it is crawled with  params : depth 1 topN 5  TWO times,  for
   this first time only one URL is crawled and second time rest 4 are crawled.

   - And when params: depth 1 topN 3  - after 3 times it crawled all the 5
   sites.

Didn't understand what does these 2 parameters mean. Can anyone brief or
redirect to url that explains this? Below are the list of url and readdb
stats.

*stats:*
Statistics for CrawlDb: crawl/crawldb
TOTAL urls: 5
status 2 (db_fetched): 5
CrawlDb statistics: done

*URLS : *
http://liveforyou.blogspot.in/
http://liveforyou.blogspot.in/2012/12/blogging.html
http://liveforyou.blogspot.in/2011/09/test.html
http://liveforyou.blogspot.in/2012_12_01_archive.html
http://liveforyou.blogspot.in/2011_09_01_archive.html

Reply via email to