This is an automated email from the ASF dual-hosted git repository.
snagel pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/nutch.git.
from e33aaa1 NUTCH-2811 : Setup Github workflows for prs (#543)
new f24ccab [NUTCH-2801] RobotsRulesParser command-line checker to use
http.robots.agents as fall-back - if no agent names are given as command-line
arguments use values of http.agent.name and http.robots.agents as agent names
to be checked - update command-line help
new 6801ac7 [NUTCH-2801] RobotsRulesParser command-line checker to use
http.robots.agents as fall-back - clarify comment regarding bypassing the
confidence check for a non-empty http.agent.name
new 2f5a8ad Merge pull request #537 from
sebastian-nagel/NUTCH-2801-robots-checker
The 3111 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/nutch/protocol/RobotRulesParser.java | 42 ++++++++++++++--------
1 file changed, 28 insertions(+), 14 deletions(-)
