[ 
https://issues.apache.org/jira/browse/NUTCH-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Nioche updated NUTCH-770:
--------------------------------

    Attachment: NUTCH-770.patch

> Timebomb for Fetcher
> --------------------
>
>                 Key: NUTCH-770
>                 URL: https://issues.apache.org/jira/browse/NUTCH-770
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Julien Nioche
>         Attachments: NUTCH-770.patch
>
>
> This patch provides the Fetcher with a timebomb mechanism. By default the 
> timebomb is not activated; it can be set using the parameter 
> fetcher.timebomb.mins. The number of minutes is relative to the start of the 
> Fetch job. When the number of minutes is reached, the QueueFeeder skips all 
> remaining entries then all active queues are purged. This allows to keep the 
> Fetch step under comtrol and works well in combination with NUTCH-769

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to