Sebastian Nagel created NUTCH-2992:
--------------------------------------
Summary: Fetcher: always block fetch queues when exceptions
threshold is reached
Key: NUTCH-2992
URL: https://issues.apache.org/jira/browse/NUTCH-2992
Project: Nutch
Issue Type: Bug
Components: fetcher
Affects Versions: 1.19
Reporter: Sebastian Nagel
Fix For: 1.20
When the exception threshold of a fetch queue is reached (defined by
{{fetcher.max.exceptions.per.queue}}, NUTCH-769), the queue must be blocked,
even if it is empty at this time. Otherwise, if the queue feeder is still
alive, new items may be added to the queue later on. See [FetchItemQueues.java,
line
306|https://github.com/apache/nutch/blob/215993bc6fbc58c050251410d5a7b02e601d99b3/src/java/org/apache/nutch/fetcher/FetchItemQueues.java#L306]
for the reason and NUTCH-2947 for a similar bug.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
