[
https://issues.apache.org/jira/browse/NUTCH-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on NUTCH-1905 started by Chris A. Mattmann.
------------------------------------------------
> Nutch index tool should be resilient to segments that don't have crawl_* data
> -----------------------------------------------------------------------------
>
> Key: NUTCH-1905
> URL: https://issues.apache.org/jira/browse/NUTCH-1905
> Project: Nutch
> Issue Type: Bug
> Components: indexer
> Reporter: Chris A. Mattmann
> Assignee: Chris A. Mattmann
> Fix For: 1.10
>
>
> When running the ./bin/nutch index command with the -dir
> <path/to/segment/dir> I noticed that if you have a segment directory that
> doesn't include crawl_* or parse_* data, that the indexer fails (correctly).
> However, the indexer should be more resilient in those cases - we can add a
> simple check to see if those dirs are present in the segment, and proceed if
> they are, otherwise, ignore that segment and print a message (and go to the
> other segments).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
