Hi, after some investigation i got the problem. I had db.ignore.external.links set to true, this is why fetcher isn't following the redirection from domain.com to www.domain.com.
Rafael. On 16/Nov/ 2011, at 20:17 , Rafael Pappert wrote: > Hello List, > > is it possible to follow http 301 redirects immediately? > > I tried to set http.redirect.max to 3 but the page is > still not indexed. readdb is still showing 1 page is > unfetched / db_redir_perm. And I can't find the > redirection target in the crawldb. > > How does nutch handle redirects? > > Thanks in advance, > Rafael. > > > >
