sebastian-nagel opened a new pull request, #766: URL: https://github.com/apache/nutch/pull/766
Note: because NUTCH-2996 requires the upgrade to crawler-commons 1.4, all changes of NUTCH-2995 are included. Only bc5326d contains the changes for NUTCH-2996. - split and lowercase agent names (if multiple) at configuration time and pass as collection to SimpleRobotRulesParser - update RobotRulesParser command-line help - update unit tests to use new API -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
