This is an automated email from the ASF dual-hosted git repository.
snagel pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/nutch.git.
from 142a026 Merge pull request #495 from
sebastian-nagel/NUTCH-2672-build-docs-use-https
new 8e5837f NUTCH-2767 Fetcher to stop filling queues skipped due to
repeated exception - each queue checks whether max. exceptions are reached when
adding a new fetch item - if yes, the item is not added to the queue - for
proper counting and logging the queuing status is reported to QueueFeeder
new 7840cb6 NUTCH-2767 Fetcher to stop filling queues skipped due to
repeated exception - use array to count queuing status
new 35dcd42 NUTCH-2767 Fetcher to stop filling queues skipped due to
repeated exception - keep queues above exception threshold to ensure that no
more items are added to these queues - reuse iterator over queues to avoid
that those queues have to be first skipped during each scan over queues
new 6dd0a7f NUTCH-2767 Fetcher to stop filling queues skipped due to
repeated exception - keep blocked queues (having reached max. exceptions) in a
separate set so that - queue numbers are correct and - blocked queues are
not searched for items to be fetched - show number of blocked queues in task
status
new ac4f2f4 Merge pull request #497 from
sebastian-nagel/NUTCH-2767-queue-feeder-above-exceptions-threshold
The 3019 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/nutch/fetcher/FetchItemQueue.java | 2 -
.../org/apache/nutch/fetcher/FetchItemQueues.java | 51 ++++++++++++++++++----
src/java/org/apache/nutch/fetcher/Fetcher.java | 9 +++-
src/java/org/apache/nutch/fetcher/QueueFeeder.java | 20 ++++++---
4 files changed, 64 insertions(+), 18 deletions(-)
