[
https://issues.apache.org/jira/browse/NUTCH-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090639#comment-17090639
]
ASF GitHub Bot commented on NUTCH-1194:
---------------------------------------
sebastian-nagel opened a new pull request #514:
URL: https://github.com/apache/nutch/pull/514
- release CrawlDb lock after select step, in case, generated items are not
marked in CrawlDb (generate.update.crawldb is false)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Generator: CrawlDB lock should be released earlier
> --------------------------------------------------
>
> Key: NUTCH-1194
> URL: https://issues.apache.org/jira/browse/NUTCH-1194
> Project: Nutch
> Issue Type: Improvement
> Components: generator
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.17
>
>
> Lock on the CrawlDB is released when everything is finished. But when
> generating many segments, the lock remains in place while it's not neccessary
> anymore. If GENERATE_UPDATE_DB is false we can release the lock immediately
> after the selector has finished.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
