[
https://issues.apache.org/jira/browse/NUTCH-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018023#comment-17018023
]
Sebastian Nagel commented on NUTCH-2733:
----------------------------------------
Successfully tested in a global breadth-first crawl of 200 million pages. No
issues, observed. Although in the "breadth" brotli is less used than expected
(only few percents of pages encoded using brotli).
> protocol-okhttp: add support for Brotli compression (Content-Encoding)
> ----------------------------------------------------------------------
>
> Key: NUTCH-2733
> URL: https://issues.apache.org/jira/browse/NUTCH-2733
> Project: Nutch
> Issue Type: Improvement
> Components: plugin, protocol
> Affects Versions: 1.15
> Reporter: Sebastian Nagel
> Priority: Major
> Labels: easytask, help-wanted, needs-test
> Fix For: 1.17
>
>
> [Okhttp 4.1.0|https://square.github.io/okhttp/changelog/#version-410] adds
> support for Brotli compression. We might upgrade the okhttp dependency to
> enable support for the "brotli" Content-Encoding.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
