[
https://issues.apache.org/jira/browse/NUTCH-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604614#comment-13604614
]
lufeng commented on NUTCH-1533:
-------------------------------
Hi Lewis
I'm sorry, I did not make it clear, perhaps in my opinion, The prevFetchTime
and prevModifiedTime are used together. Either set to 0L when
CrawlStatus.STATUS_RETRY and CrawlStatus.STATUS_GONE which both set
prevFetchTime and prevModifiedTime to 0L, or set to a value when
CrawlStatus.NOTMODIFIED which set prevFetchTime and prevModifiedTime.
yes, you are right, the both method should set prevModifiedTime to it. i will
modified the patch later.
Thanks Lewis.
> Implement getPrevModifiedTime(), setPrevModifiedTime(), getBatchId() and
> setBatchId() accessors in o.a.n.storage.WebPage
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: NUTCH-1533
> URL: https://issues.apache.org/jira/browse/NUTCH-1533
> Project: Nutch
> Issue Type: Bug
> Components: storage
> Affects Versions: 2.1
> Reporter: Lewis John McGibbney
> Priority: Minor
> Fix For: 2.2
>
> Attachments: NUTCH-1533.patch, NUTCH-1533v2.patch
>
>
> NUTCH-1532 needs to obtain a batchId to add to NutchDocument prior to
> indexing. This is currently not available as we do not store the information
> in the WebPage. Additionally, we do not store the other ModifiedTime's but
> incorrectly set them in o.a.n.crawl.FetchSchedule#setFetchSchedule.
> All the above accessors should be implemented.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
