David Michael Gang created NUTCH-1518:
-----------------------------------------
Summary: session cookies support
Key: NUTCH-1518
URL: https://issues.apache.org/jira/browse/NUTCH-1518
Project: Nutch
Issue Type: New Feature
Components: fetcher
Affects Versions: 2.1
Reporter: David Michael Gang
There are internet sites, which in order to get crawled have to store cookies.
For example for a fake internet site
www.blala.com in order to fetch we have to send first
www.blala.com?username=x&password=y
and then the browser stores a sesssion cookie.
Afterwards i can fetch all pages of the domain www.blala.com/a/b/c.html
I want a feature where we define in a file domains of urls and the url how to
make logins.
When nutch will see such a site and fetch the page it will login before.
The jira https://issues.apache.org/jira/browse/NUTCH-827
is very similar to what i need.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
