Re: how web crawler crawls contents after the first crawling

[Karl Wright]

Hi Shigeki,

The web connector creates a checksum for all content.  The checksum has to
match exactly for the content to be reindexed.  Of course, computing the
checksum means that the content must be refetched in any case.

Karl