As it is right now... You answered the question yourself :-) ... Separate db's and the whole ceremony...
> -----Original Message----- > From: Briggs [mailto:[EMAIL PROTECTED] > Sent: Thursday, April 19, 2007 10:02 PM > To: [EMAIL PROTECTED] > Subject: Nutch and Crawl Frequency > > Nutch 0.9 > > Anyone know if it is possible to be more granular regarding crawl > frequency? Meaning, that I would like some sites to be crawled more > often then others. Like, a news site should be crawled every day, but > your average business website should be crawled every 30 days. So, is > it possible to specify a crawl frequency for specific urls, or is it > only global for within the crawl db? I suppose I could have several > crawldbs or something like that, and deal with it.. but, just curious. > > Thanks > -- > "Conscious decisions by conscious minds are what make reality real" ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
