This is not possible with the supplied fetch schedulers so you need a customized scheduler. In Jira there's an open issue for support for different intervals depending on MIME-type, it is very similar to what you ask. It extends AdaptiveFetchSchedule and allows for setting different increment and decrement rates per MIME.
> hi all, > i want to recrawl siltes with an short interval and file system with long > interval. > it means sites have a crawl period different from file system crawl period. > how can i do that? > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/how-do-recrawl-sites-and-filesystems-tp > 3364532p3364532.html Sent from the Nutch - User mailing list archive at > Nabble.com.
