Can someone confirm this:
Uou start a crawldb from a list of urls and you generate a fetch list,
which is akin to seeding your crawldb. When you fetch it just fetches
those seed urls.
When you do your next round of generate/fetch/update, The fetch list
will have the links found while parsing
Richard Braman wrote:
Can someone confirm this:
Uou start a crawldb from a list of urls and you generate a fetch list,
which is akin to seeding your crawldb. When you fetch it just fetches
those seed urls.
When you do your next round of generate/fetch/update, The fetch list
will have the
Richard Braman wrote:
Can someone confirm this:
Uou start a crawldb from a list of urls and you generate a fetch list,
which is akin to seeding your crawldb. When you fetch it just fetches
those seed urls.
When you do your next round of generate/fetch/update, The fetch list
will have the