Hello, I have this situation. There are over 160 urls in my seed. I started my crawling one week ago. Now I have crawled a lot of pages in my storage but I can seen in my Solr index some urls from seed are not crawled at all (this urls do not have some restrictions from robots.txt file) or only in very small number. Is it possible to say to Nutch to specialize or preffer some urls?
-- View this message in context: http://lucene.472066.n3.nabble.com/Preffered-urls-to-fetch-tp4092361.html Sent from the Nutch - User mailing list archive at Nabble.com.
