[
https://issues.apache.org/jira/browse/NUTCH-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18045307#comment-18045307
]
ASF GitHub Bot commented on NUTCH-3139:
---------------------------------------
sebastian-nagel opened a new pull request, #877:
URL: https://github.com/apache/nutch/pull/877
- upgrade to OkHttp 5.3.2
- enable support for zstd content-encoding
Meta sites already support zstd content-encoding:
```
$> $NUTCH_HOME/bin/nutch parsechecker https://www.llama.com/faq/
...
_request_ = GET /faq/ HTTP/2
...
Accept-Encoding: zstd, br, gzip
...
_response.headers_ = HTTP/2 200
vary: Accept-Encoding
content-encoding: zstd
...
```
(with `http.useHttp2`, `store.http.request` and `store.http.headers` set to
true)
> protocol-okhttp: add support for zstd content-encoding
> ------------------------------------------------------
>
> Key: NUTCH-3139
> URL: https://issues.apache.org/jira/browse/NUTCH-3139
> Project: Nutch
> Issue Type: Improvement
> Components: dependency, plugin, protocol
> Affects Versions: 1.22
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.22
>
>
> OkHttp supports zstd
> [content-encoding|https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Content-Encoding]
> since version
> [5.2.0|https://square.github.io/okhttp/changelogs/changelog/#version-520].
> - upgrade OkHttp to the latest version (5.3.2)
> - enable support for zstd content-encoding
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
