[
https://issues.apache.org/jira/browse/NUTCH-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556853#comment-17556853
]
Hudson commented on NUTCH-2951:
-------------------------------
SUCCESS: Integrated in Jenkins build Nutch » Nutch-trunk #77 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/77/])
NUTCH-2951 Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching
forever (snagel:
[https://github.com/apache/nutch/commit/5b970ff22a4c8a644cde2e62d1117f18dc11eef4])
* (edit) src/java/org/apache/nutch/crawl/Generator.java
> Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY awaits fetching forever
> ----------------------------------------------------------------------------
>
> Key: NUTCH-2951
> URL: https://issues.apache.org/jira/browse/NUTCH-2951
> Project: Nutch
> Issue Type: Bug
> Components: generator
> Affects Versions: 1.16, 1.17, 1.18
> Reporter: Lapadula Alessandro
> Assignee: Sebastian Nagel
> Priority: Minor
> Fix For: 1.19
>
>
> When a crawl datum contains a WRITABLE_GENERATE_TIME_KEY metadata it will
> wait forever.
>
> {code:java}
> LongWritable oldGenTime = (LongWritable) crawlDatum.getMetaData()
> .get(Nutch.WRITABLE_GENERATE_TIME_KEY);
> if (oldGenTime != null) { // awaiting fetch & update
> if (oldGenTime.get() + genDelay > curTime) // still wait for
> // update
> context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1);
> return;
> }{code}
> The line
> {code:java}
> context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1); {code}
> has been introduced in version 1.16 without adding the brackets.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
