This is an automated email from the ASF dual-hosted git repository. markus pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/nutch.git
The following commit(s) were added to refs/heads/master by this push: new 4642c30c2 NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler 4642c30c2 is described below commit 4642c30c2aeb2a1fa2436541bd4af877d0aad86a Author: Markus Jelsma <mar...@apache.org> AuthorDate: Wed Mar 13 12:58:05 2024 +0000 NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler --- conf/adaptive-host-specific-intervals.txt.template | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/conf/adaptive-host-specific-intervals.txt.template b/conf/adaptive-host-specific-intervals.txt.template new file mode 100644 index 000000000..4aa7920d3 --- /dev/null +++ b/conf/adaptive-host-specific-intervals.txt.template @@ -0,0 +1,14 @@ +# This file defines a mapping that associates specific min. and max. refetching time intervals +# to a host, that deviate from the default settings of the AdaptiveFetchSchedule class. +# +# Format: <hostname> <min_interval> <max_interval>. +# +# The two values will be parsed as float and should be STRICTLY between +# db.fetch.schedule.adaptive.min_interval and db.fetch.schedule.adaptive.max_interval. +# +# To use default values, write "default" or "0". +# The default min. is 60 (1 min) and default max. is 31536000 (1 year). +# +www.apache.org default 1728000 +www.example.org 1296000 0 +nutch.apache.org 864000 2160000