[ 
https://issues.apache.org/jira/browse/NUTCH-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446515#comment-13446515
 ] 

Ferdy Galema commented on NUTCH-1448:
-------------------------------------

Yes it does show up as an outlink.

About your issue 1461: That is a duplicate indeed. It fixes the problem when it 
already is corrupt, but this issue is for preventing it from happening in the 
first place. I think 1461 should be closed in favor to this one. (But it is a 
nice workaround for present corrupt databases).
                
> Redirected urls should be handled more cleanly (more like an outlink url)
> -------------------------------------------------------------------------
>
>                 Key: NUTCH-1448
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1448
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Ferdy Galema
>             Fix For: 2.1
>
>         Attachments: nutch-1448.txt
>
>
> This is specifically for Nutch2.x. Handling a redirects url like an outlink 
> is much more cleaner because this makes it more simple to trace how new urls 
> are added to the webpage database. Instant fetching of redirects won't work, 
> but this is a small price to pay. (Note that this currently does not work at 
> all, because the http.max.redirect property has no effect). Will be attaching 
> a patch in the upcoming days.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to