Hi,

Hm, that LGPL license is not going to fly with Nutch's move to ASF,
unfortunately. :(.  Perhaps there is an equivalent HTTP cookie lib with
an ASL-compatible license that you could use?

Otis


--- Chirag Chaman <[EMAIL PROTECTED]> wrote:

> Reposting -- SourceForge did not like the zip attachment and returned
> the
> mail. 
> Source available at following url:
> http://mxinteractive.com/nutch/nutch-cookie.zip 
> 
> -----Original Message-----
> 
> Folks:
> 
> Attached is the latest version of protocol-http with modifications
> made to
> support Cookies. This uses JCookie (Open Source/GNU LGPL).
> 
> The module as packaged only keeps cookies for a session. Persistence
> support
> is there but is commented out as it was a big performance drag. 
> While
> crawling we saw a fair number of sites that would throw an error if
> cookies
> were not accepted, and thus this enhancement.
> 
> Persistence makes things work better -- some sites set cookies via a
> gateway
> page, and only if set lets you browse the site -- therefore if one
> thread
> sets the cookie other threads can return it back to the site. Another
> advantage of persistence is that sites the grant username/password
> access
> via cookies can now be indexed. As this was not a top priority for
> us, we
> decided to remove this for faster performance.  Moving the code from
> the
> plugin to somewhere higher within Nutch should improve performance.
> Please
> feel free to modify/improve and share it back with the nutch
> community.
> 
> Please test and evaluate before introducing to a live environment.
> 
> Regards,
> CC
> 
> --------------------------------------------
> Filangy, Inc.
> Interested in Improving Search? Join our Team!
> http://filangy.com/jointheteam.jsp   
> 
> 
> 
> 
> 
> -------------------------------------------------------
> This SF.Net email is sponsored by: IntelliVIEW -- Interactive
> Reporting
> Tool for open source databases. Create drag-&-drop reports. Save time
> by over 75%! Publish reports on the web. Export to DOC, XLS, RTF,
> etc.
> Download a FREE copy at http://www.intelliview.com/go/osdn_nl
> _______________________________________________
> Nutch-developers mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/nutch-developers
> 



-------------------------------------------------------
This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting
Tool for open source databases. Create drag-&-drop reports. Save time
by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc.
Download a FREE copy at http://www.intelliview.com/go/osdn_nl
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to