Hello List, is it possible to follow http 301 redirects immediately?
I tried to set http.redirect.max to 3 but the page is still not indexed. readdb is still showing 1 page is unfetched / db_redir_perm. And I can't find the redirection target in the crawldb. How does nutch handle redirects? Thanks in advance, Rafael.
