[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017515#comment-16017515
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel commented on issue #186: NUTCH-2376 Improve configurability of 
HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186#issuecomment-302729477
 
 
   No problem, it's easily overseen.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Assignee: Sebastian Nagel
>Priority: Minor
> Fix For: 2.4, 1.14
>
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017496#comment-16017496
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

lewismc commented on issue #186: NUTCH-2376 Improve configurability of HTTP 
Accept* header fields
URL: https://github.com/apache/nutch/pull/186#issuecomment-302726629
 
 
   Sorry Seb
   
   On Fri, May 19, 2017 at 3:50 AM Sebastian Nagel 
   wrote:
   
   > Merged #186 .
   >
   > —
   > You are receiving this because you modified the open/close state.
   >
   >
   > Reply to this email directly, view it on GitHub
   > , or mute the
   > thread
   > 

   > .
   >
   -- 
   
   *Lewis*
   Dr. Lewis J. McGibbney Ph.D, B.Sc
   Director, MCMA Associates
   Phone: +1(626)498-3090
   Skype: lewis.john.mcgibbney
   Email: lewis.mcgibb...@gmail.com
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Assignee: Sebastian Nagel
>Priority: Minor
> Fix For: 2.4, 1.14
>
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017309#comment-16017309
 ] 

Hudson commented on NUTCH-2376:
---

SUCCESS: Integrated in Jenkins build Nutch-trunk #3429 (See 
[https://builds.apache.org/job/Nutch-trunk/3429/])
NUTCH-2376 Improve configurability of HTTP Accept* header fields - (snagel: 
[https://github.com/apache/nutch/commit/af9d7a3e68002860fcc178e21b869d2f79c27dee])
* (edit) 
src/plugin/lib-http/src/java/org/apache/nutch/protocol/http/api/HttpBase.java
* (edit) 
src/plugin/protocol-httpclient/src/java/org/apache/nutch/protocol/httpclient/Http.java
* (edit) 
src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/HttpResponse.java
* (edit) conf/nutch-default.xml


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Assignee: Sebastian Nagel
>Priority: Minor
> Fix For: 2.4, 1.14
>
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017229#comment-16017229
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel closed pull request #186: NUTCH-2376 Improve configurability of 
HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017166#comment-16017166
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel closed pull request #187: NUTCH-2376 Improve configurability of 
HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/187
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017126#comment-16017126
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel commented on issue #186: NUTCH-2376 Improve configurability of 
HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186#issuecomment-302656143
 
 
   This one is for 1.x, #187 is for 2.x.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017121#comment-16017121
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel opened a new pull request #186: NUTCH-2376 Improve 
configurability of HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186
 
 
   - Accept, Accept-Language and Accept-Charset are configured and used the
 same way for both protocol-http and protocol-httpclient
   - a space as value will unset these header fields (not sent in request)
 I've tried to overwrite the default by an empty value but that's not 
possible with the Hadoop configuration mechanism. Of course, one could 
configure instead `*` as "Accept-Language" or "Accept-Charset" (resp. `*/*` as 
"Accept" content type) but that will unnecessarily blow up the HTTP requests.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-19 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017123#comment-16017123
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel commented on issue #186: NUTCH-2376 Improve configurability of 
HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186#issuecomment-302656143
 
 
   This one is for 1.x, #187 is for 2.x.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016949#comment-16016949
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

lewismc commented on issue #186: NUTCH-2376 Improve configurability of HTTP 
Accept* header fields
URL: https://github.com/apache/nutch/pull/186#issuecomment-302618052
 
 
   Duplicate PR @sebastian-nagel, please reopen if this is the case
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016947#comment-16016947
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

lewismc commented on issue #187: NUTCH-2376 Improve configurability of HTTP 
Accept* header fields
URL: https://github.com/apache/nutch/pull/187#issuecomment-302617984
 
 
   +1
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-05-18 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16016950#comment-16016950
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

lewismc closed pull request #186: NUTCH-2376 Improve configurability of HTTP 
Accept* header fields
URL: https://github.com/apache/nutch/pull/186
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-04-20 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976653#comment-15976653
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel opened a new pull request #187: NUTCH-2376 Improve 
configurability of HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/187
 
 
   - Accept, Accept-Language and Accept-Charset are configured and used the
 same way for both protocol-http and protocol-httpclient
   - a space as value will unset these header fields (not sent in request)
 I've tried to overwrite the default by an empty value but that's not 
possible with the Hadoop configuration mechanism. Of course, one could 
configure instead `*` as "Accept-Language" or "Accept-Charset" (resp. `*/*` as 
"Accept" content type) but that will unnecessarily blow up the HTTP requests.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (NUTCH-2376) Improve configurability of HTTP Accept* header fields

2017-04-20 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976632#comment-15976632
 ] 

ASF GitHub Bot commented on NUTCH-2376:
---

sebastian-nagel opened a new pull request #186: NUTCH-2376 Improve 
configurability of HTTP Accept* header fields
URL: https://github.com/apache/nutch/pull/186
 
 
   - Accept, Accept-Language and Accept-Charset are configured and used the
 same way for both protocol-http and protocol-httpclient
   - a space as value will unset these header fields (not sent in request)
 I've tried to overwrite the default by an empty value but that's not 
possible with the Hadoop configuration mechanism. Of course, one could 
configure instead `*` as "Accept-Language" or "Accept-Charset" (resp. `*/*` as 
"Accept" content type) but that will unnecessarily blow up the HTTP requests.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Improve configurability of HTTP Accept* header fields
> -
>
> Key: NUTCH-2376
> URL: https://issues.apache.org/jira/browse/NUTCH-2376
> Project: Nutch
>  Issue Type: Improvement
>  Components: protocol
>Affects Versions: 2.3.1, 1.13
>Reporter: Sebastian Nagel
>Priority: Minor
>
> There should be no differences between protocol-http and protocol-httpclient 
> whether the HTTP header fields {{Accept}}, {{Accept-Language}} and 
> {{Accept-Charset}} are configurable. The configured values should be used for 
> both plugins. In addition,
> - it should be possible to unset the default values (overwrite with empty 
> value) so that no HTTP header field is sent
> - default values should be contained in nutch-default.xml
> Note: {{Accept-Encoding}} should not be configurable as the protocol plugins 
> must support the accepted compression codecs which may not be the case e.g. 
> for Brotli.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)