i crawl a site with nutch 1.4. but nutch dosen't crawl all links in this site. the language of this site is not English. for example nutch dosen't crawl this link:
http://www.irna.ir/News/30786427/سوء-استفاده-از-نام-كمیته-امداد-برای-جمع-آوری-رای-در-مناطق-محروم/سياسي/ what can i solve this problem? what config i should do? -- View this message in context: http://lucene.472066.n3.nabble.com/error-in-crawl-all-link-in-no-English-language-sites-tp3702014p3702014.html Sent from the Nutch - User mailing list archive at Nabble.com.
