[
https://issues.apache.org/jira/browse/NUTCH-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17725436#comment-17725436
]
ASF GitHub Bot commented on NUTCH-2992:
---------------------------------------
sebastian-nagel merged PR #762:
URL: https://github.com/apache/nutch/pull/762
> Fetcher: always block fetch queues when exceptions threshold is reached
> -----------------------------------------------------------------------
>
> Key: NUTCH-2992
> URL: https://issues.apache.org/jira/browse/NUTCH-2992
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 1.19
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.20
>
>
> When the exception threshold of a fetch queue is reached (defined by
> {{fetcher.max.exceptions.per.queue}}, NUTCH-769), the queue must be blocked,
> even if it is empty at this time. Otherwise, if the queue feeder is still
> alive, new items may be added to the queue later on. See
> [FetchItemQueues.java, line
> 306|https://github.com/apache/nutch/blob/215993bc6fbc58c050251410d5a7b02e601d99b3/src/java/org/apache/nutch/fetcher/FetchItemQueues.java#L306]
> for the reason and NUTCH-2947 for a similar bug.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
