This is an automated email from the ASF dual-hosted git repository.
snagel pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/nutch.git.
from f443f1b Merge pull request #395 from
sebastian-nagel/NUTCH-2655-solr-schema-7x
add 54f156c NUTCH-2630 Fetcher to log skipped records by robots.txt -
change required log level to INFO (default) for messages reporting skipped
URLs because of robots.txt rules (disallow or crawl delay larger than
fetcher.max.crawl.delay)
new 8151237 Merge pull request #387 from
sebastian-nagel/NUTCH-2630-fetcher-log-robotstxt-denied
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
src/java/org/apache/nutch/fetcher/FetcherThread.java | 6 ++----
1 file changed, 2 insertions(+), 4 deletions(-)
