Lapadula Alessandro created NUTCH-2951:
------------------------------------------
Summary: Crawl datum with metadata WRITABLE_GENERATE_TIME_KEY
awaits fetching forever
Key: NUTCH-2951
URL: https://issues.apache.org/jira/browse/NUTCH-2951
Project: Nutch
Issue Type: Bug
Components: generator
Affects Versions: 1.18, 1.17, 1.16
Reporter: Lapadula Alessandro
When a crawl datum contains a WRITABLE_GENERATE_TIME_KEY metadata it will wait
forever.
{code:java}
LongWritable oldGenTime = (LongWritable) crawlDatum.getMetaData()
.get(Nutch.WRITABLE_GENERATE_TIME_KEY);
if (oldGenTime != null) { // awaiting fetch & update
if (oldGenTime.get() + genDelay > curTime) // still wait for
// update
context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1);
return;
}{code}
The line
{code:java}
context.getCounter("Generator", "WAIT_FOR_UPDATE").increment(1); {code}
has been introduced in version 1.16 without adding the brackets.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
