Cool, cool. Thanks!
On 4/19/07, Gal Nitzan <[EMAIL PROTECTED]> wrote:
As it is right now... You answered the question yourself :-) ...
Separate db's and the whole ceremony...
> -----Original Message-----
> From: Briggs [mailto:[EMAIL PROTECTED]
> Sent: Thursday, April 19, 2007 10:02 PM
> To: [email protected]
> Subject: Nutch and Crawl Frequency
>
> Nutch 0.9
>
> Anyone know if it is possible to be more granular regarding crawl
> frequency? Meaning, that I would like some sites to be crawled more
> often then others. Like, a news site should be crawled every day, but
> your average business website should be crawled every 30 days. So, is
> it possible to specify a crawl frequency for specific urls, or is it
> only global for within the crawl db? I suppose I could have several
> crawldbs or something like that, and deal with it.. but, just curious.
>
> Thanks
> --
> "Conscious decisions by conscious minds are what make reality real"
--
"Conscious decisions by concious minds are what make reality real"
