[
https://issues.apache.org/jira/browse/NUTCH-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated NUTCH-1518:
----------------------------------------
Fix Version/s: 2.2
> session cookies support
> -----------------------
>
> Key: NUTCH-1518
> URL: https://issues.apache.org/jira/browse/NUTCH-1518
> Project: Nutch
> Issue Type: New Feature
> Components: fetcher
> Affects Versions: 2.1
> Reporter: David Michael Gang
> Fix For: 2.2
>
>
> There are internet sites, which in order to get crawled have to store cookies.
> For example for a fake internet site
> www.blala.com in order to fetch we have to send first
> www.blala.com?username=x&password=y
> and then the browser stores a sesssion cookie.
> Afterwards i can fetch all pages of the domain www.blala.com/a/b/c.html
> I want a feature where we define in a file domains of urls and the url how to
> make logins.
> When nutch will see such a site and fetch the page it will login before.
> The jira https://issues.apache.org/jira/browse/NUTCH-827
> is very similar to what i need.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira