Yogendra Kumar Soni created NUTCH-2134:
------------------------------------------

             Summary: Redirection and cookie handling using protocol  plugins
                 Key: NUTCH-2134
                 URL: https://issues.apache.org/jira/browse/NUTCH-2134
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher, plugin
    Affects Versions: 1.11
            Reporter: Yogendra Kumar Soni
            Priority: Minor


fetcher thread is handling redirection logic and it is failing where 
redirection 301 takes to some other domain and get authentication cookies from 
there and again redirects to same url with cookies (even if domain is in 
urlfilter). HttpClient 4.5 uses automatic redirection handling with cookies, 
which is working well. In place of handling redirects in fetcherThread we can 
enable user to use HTTPclients 4.5 redirection handling. In other words  enable 
redirection handling logic selection of fetcher or plugin.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to