hi, crawl my sites with a script. i have a text file with name 'sites.txt',my script read urls from sites.txt, first i add a url-for example url1 - in sites.txt to crawl, and nutch crawl this site well. next i delete url1 from sites.txt and add another url -for example url2-. nutch fetch older url -url1- and crawl it. it dosn't crawl url2. nutch :1.3 topN:10 depth:4 help me.
-- View this message in context: http://lucene.472066.n3.nabble.com/crawl-sites-in-nutch-1-3-tp3492962p3492962.html Sent from the Nutch - User mailing list archive at Nabble.com.
