[jira] [Commented] (NUTCH-1671) indexchecker to add digest field

[lufeng (JIRA)]

    [ 
https://issues.apache.org/jira/browse/NUTCH-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13830530#comment-13830530
 ] 

lufeng commented on NUTCH-1671:
-------------------------------

yes, this field can be used by indexing filters.  +1
another question is that should we add check code after parse content like this

{code:java}
ParseResult parseResult = new ParseUtil(conf).parse(content); 

if (parseResult == null) {
      LOG.error("Problem with parse - check log");
      return (-1);
    }

{code}

> indexchecker to add digest field
> --------------------------------
>
>                 Key: NUTCH-1671
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1671
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.7, 2.2.1
>            Reporter: Sebastian Nagel
>            Priority: Trivial
>             Fix For: 2.3, 1.8
>
>         Attachments: NUTCH-1671-2x.patch, NUTCH-1671-trunk.patch
>
>
> IndexingFiltersChecker does not add field "digest" as done by 
> IndexerMapReduce. Digest/signature could be also used by indexing filters 
> which then may fail.



--
This message was sent by Atlassian JIRA
(v6.1#6144)