[
https://issues.apache.org/jira/browse/NUTCH-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419123#comment-13419123
]
Markus Jelsma commented on NUTCH-1388:
--------------------------------------
That would not make injecting flexible. We cannot rely on default only,
changing config for for one inject is cumbersome.
{code}
http://host/page_a
http://host/page_b nutch.fetchInterval=60
http://host/page_c nutch.fixedFetchInterval=3600
http://host/page_d nutch.fixedFetchInterval=600
http://host/page_eIf there's another clever way to do this with a single inject
and with an adaptive scheduler i happy to work on it.
{code}
The above makes perfectly sense if a user relies on all defaults for page_a and
page_e. It also makes sense to fix page_c and page_d to a custom interval at
the same time. And start with a low interval for page_b but let it change over
time by an adaptive scheduler. We have to differentiate between a default
interval and an interval that will never change.
If there's another clever way to do this with a single inject and with an
adaptive scheduler i happy to work on it.
Thanks
> Optionally maintain custom fetch interval despite AdaptiveFetchSchedule
> -----------------------------------------------------------------------
>
> Key: NUTCH-1388
> URL: https://issues.apache.org/jira/browse/NUTCH-1388
> Project: Nutch
> Issue Type: Improvement
> Components: injector
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.6
>
> Attachments: NUTCH-1388-1.6-1.patch, NUTCH-1388-1.6-2.patch
>
>
> During injection a custom fetch interval can be configured but it is not
> maintained with an AdaptiveFetchSchedule enabled.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
