I found a issue in shouldFetch() of AbstractFetchSchedule class.  (Nutch 2.1) 

Here even when (fetchTime - curTime > maxInterval * 1000L), the method
returns false with the below return statement. 

"return fetchTime <= curTime" 

The fetchTime is not reset within the if block, and hence the method returns
false (The javadoc of this method says "It will also check that fetchTime is
not too remote, in which case it lowers the interval and returns true.) 

Whether this method need fix? (resetting fetchTime to curTime when interval
> maxinterval)  Any chance of this fix leading to strange generate and fetch
behavior? 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Issue-in-generating-URLs-for-re-fetching-once-db-fetch-interval-max-elapses-tp4079039.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Reply via email to