Hi, For crawling multiple sites, I am wondering if I can configure separate crawl-urlfilter.txt for each site? It seems to me Nutch has just one urlfilter file to configure, even if for multiple sites.
Please help. Thanks, Jian
Hi, For crawling multiple sites, I am wondering if I can configure separate crawl-urlfilter.txt for each site? It seems to me Nutch has just one urlfilter file to configure, even if for multiple sites.
Please help. Thanks, Jian