Hi Yasin,
> * where is Webpage modifiedDate set? and how is it set ?
It's definitely set by one of {Adaptive,Default}FetchSchedule,
called by DbUpdateReducer.reduce().
> * can anyone please tell me about sync_delta? how does sync_delta work?
It is best explained in AdaptiveFetchSchedule.java itself.
But be aware: it's buggy, see NUTCH-1564. It would be nice to
see the bug reproducible in a unit test. Validation of patch
then comes for free.
There is also NUTCH-1502 which will also cover fetch schedulers
to some extend. But it's on a higher, complementary level,
testing update reduce function including scheduler implementations.
I hope to get a working patch ready soon, prelimary tests can be
found in NUTCH-1245.
Sebastian
On 09/30/2013 10:13 AM, Yasin Kılınç wrote:
> Ok. Feng,
>
> Before write to Test for Adaptive Fetch Schedule,
>
> * where is Webpage modifiedDate set? and how is it set ?
> * can anyone please tell me about sync_delta? how does sync_delta work?
>
>
> Thanks.
>
>
>
> On 29-09-2013 16:56, feng lu wrote:
>> On Fri, Sep 27, 2013 at 8:36 PM, Yasin Kılınç <[email protected]>wrote:
>>
>>> Adaptive Fetch Schedule
>>
>> Hi Yasin
>>
>> currently there are no Test Case for Adaptive Fetch Schedule class, I only
>> find one main method in AdaptiveFetchSchedule class at Nutch 1.x.
>>
>> very welcome to write test case for AdaptiveFetchSchedule if you want to
>> and I will very happy to do check for you. you can open an issue in Jira.
>>
>>
>>
>>
>
