[
https://issues.apache.org/jira/browse/NUTCH-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581899#comment-17581899
]
Hudson commented on NUTCH-2930:
-------------------------------
SUCCESS: Integrated in Jenkins build Nutch ยป Nutch-trunk #84 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/84/])
NUTCH-2930 Protocol-okhttp: implement IP filter (#736) (github:
[https://github.com/apache/nutch/commit/7e969eaec1ab8e9e21667faf6cf1881fb10cfb31])
* (edit)
src/plugin/protocol-okhttp/src/test/org/apache/nutch/protocol/okhttp/TestProtocolOkHttp.java
* (edit) src/test/org/apache/nutch/protocol/AbstractHttpProtocolPluginTest.java
* (edit) conf/nutch-default.xml
* (add)
src/plugin/protocol-okhttp/src/java/org/apache/nutch/protocol/okhttp/IPFilterRules.java
* (edit)
src/plugin/protocol-okhttp/src/java/org/apache/nutch/protocol/okhttp/OkHttp.java
* (edit)
src/plugin/protocol-okhttp/src/test/org/apache/nutch/protocol/okhttp/TestBadServerResponses.java
* (add)
src/plugin/protocol-okhttp/src/java/org/apache/nutch/protocol/okhttp/CIDR.java
* (add)
src/plugin/protocol-okhttp/src/test/org/apache/nutch/protocol/okhttp/TestIPAddressFiltering.java
> Protocol-okhttp: implement IP filter
> ------------------------------------
>
> Key: NUTCH-2930
> URL: https://issues.apache.org/jira/browse/NUTCH-2930
> Project: Nutch
> Issue Type: Improvement
> Components: plugin, protocol, security
> Affects Versions: 1.18
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.19
>
>
> In order to avoid information leakage to a public search index or web
> archive, it should be possible to configure Nutch in a way that no content is
> fetched from localhost, loop-back addresses, private address spaces.
> NUTCH-2527 adds the configuration snippets to exclude URLs pointing to
> private addresses.
> However, filtering URLs isn't enough because a DNS entry of an arbitrary host
> name may point to a private IP address. Blocking must happen on the protocol
> level because the IP address is only know in the protocol implementation.
> I'll add an implementation for protocol-okhttp.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
