[
https://issues.apache.org/jira/browse/NUTCH-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647388#comment-14647388
]
Tanguy Moal commented on NUTCH-2072:
------------------------------------
I provided a dumb fix there: https://github.com/apache/nutch/pull/48 .
I couldn't find any test regarding handling of HTTP compression and
{{http.content.limit}} parameter, and setting those seems tedious. Feel free to
guide me if we want to make that part more robust.
> Deflate encoding support is broken when http.content.limit is set to -1
> -----------------------------------------------------------------------
>
> Key: NUTCH-2072
> URL: https://issues.apache.org/jira/browse/NUTCH-2072
> Project: Nutch
> Issue Type: Bug
> Components: plugin, protocol
> Reporter: Tanguy Moal
> Priority: Minor
>
> The method {{DeflateUtils.inflateBestEffort(byte[] in, int sizeLimit)}} is
> not designed to have sizeLimit set to a negative value.
> The fix can be simply to mimic what's done with gzip encoding : if
> {{getMaxContent() < 0}} then use {{Integer.MAX_VALUE}} for the {{sizeLimit}}
> argument.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
