[
https://issues.apache.org/jira/browse/NUTCH-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma closed NUTCH-866.
-------------------------------
Bulk close of resolved issues:
http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira
> STOP Nutch without breaking the crawled data
> --------------------------------------------
>
> Key: NUTCH-866
> URL: https://issues.apache.org/jira/browse/NUTCH-866
> Project: Nutch
> Issue Type: New Feature
> Reporter: Pham Tuan Minh
> Fix For: 2.0
>
>
> How we can stop running nutch instance in local mode and in reducer mode
> without breaking the crawled data?
> For example, you push a list of site that take a long time to complete crawl;
> then you want to stop nutch instance suddenly ...
> - For local mode, I suggest as below
> We create a stop.txt file in specific directory, then for a piece of time,
> nutch instance will check whether this file existed or not; if existed, nutch
> instance will stop itself normally
> - For reducer mode, may we use zookeper to keep state of each instance?
> Any other suggestion?
> Thanks,
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
