Re: Adaptive fetch

2006-04-04 Thread D . Saravanaraj
Hi, Is the patch for Adaptive Refetch has been released? Considering intranet and using nutch for indexing large static HTML pages, i hope this feature plays a crucial role. Please update me on this. Thanks, D.Saravanaraj On 3/31/06, Andrzej Bialecki [EMAIL PROTECTED] wrote: Raghavendra

Re: Adaptive fetch

2006-03-31 Thread Andrzej Bialecki
Raghavendra Prabhu wrote: Hi Andrzej Can you put in the latest version of the diff for the adaptive fetch? Because we seem to have problem patching agains the latest release. This should help us test it. The patch is probably out of sync, there have been many (trivial) changes in the

Re: Adaptive fetch

2006-03-31 Thread Raghavendra Prabhu
I believe we had a recent mail with problem of redirection also (with this patch applied..) And as you said more people testing the patch would be better. Considering that this has the highest votes for add-on features, it is a critical one i guess. Rgds Prabhu On 3/31/06, Andrzej Bialecki

Re: Adaptive fetch

2006-03-31 Thread Andrzej Bialecki
Raghavendra Prabhu wrote: I believe we had a recent mail with problem of redirection also (with this patch applied..) And as you said more people testing the patch would be better. Considering that this has the highest votes for add-on features, it is a critical one i guess. Ok, I'll

Re: adaptive fetch

2006-03-28 Thread Andrzej Bialecki
Raghavendra Prabhu wrote: Hi Andrzej After applying the patch, i seemed to find some strange behaviour The fetch list for each URL was getting created inspite of the fact that db.default.fetch.interval had not been reached You probably forgot to change the interval from days to seconds.

Re: Adaptive fetch schedule

2006-03-22 Thread Andrzej Bialecki
(Moved to the proper list) Raghavendra Prabhu wrote: Hi Does the inlink value problem solve the OPIC problem which was there. That is on a recrawl, the page would have a higher score. Does this fix that problem? No, it doesn't. But it prevents your linkDB from growing indefinitely, which

Re: Adaptive fetch

2006-02-28 Thread Raghavendra Prabhu
Point noted Andrzej We will experiment with the schedules and let you know how it worked out.Itis flexible right now i guess. Thanks Rgds Prabhu On 2/28/06, Andrzej Bialecki [EMAIL PROTECTED] wrote: Raghavendra Prabhu wrote: Maybe we can add a function which will do this so that people