[ https://issues.apache.org/jira/browse/NUTCH-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127123#comment-16127123 ]
Hudson commented on NUTCH-2408: ------------------------------- SUCCESS: Integrated in Jenkins build Nutch-trunk #3448 (See [https://builds.apache.org/job/Nutch-trunk/3448/]) NUTCH-2408 CrawlDb: allow update from unparsed segments (snagel: [https://github.com/apache/nutch/commit/a7d0ac2724e1c16f8071a5d734f092d1bc03cac1]) * (edit) src/java/org/apache/nutch/crawl/CrawlDb.java > CrawlDb: allow update from unparsed segments > -------------------------------------------- > > Key: NUTCH-2408 > URL: https://issues.apache.org/jira/browse/NUTCH-2408 > Project: Nutch > Issue Type: Improvement > Components: crawldb > Affects Versions: 1.13 > Reporter: Sebastian Nagel > Priority: Minor > Fix For: 1.14 > > > The command updatedb (class o.a.n.crawl.CrawlDb) does not allow to update the > CrawlDb with fetch status only (from segment subdirectory crawl_fetch) > without also reading crawl_parse (which contains outlinks but also scores, > signatures and meta data). > A workflow which does not require parsing of documents (e.g., because raw > HTML content is exported to WARC files) is then unable to update the CrawlDb > to store the fetch status. -- This message was sent by Atlassian JIRA (v6.4.14#64029)