Repository: nutch
Updated Branches:
refs/heads/master d37b7ce13 -> 3fca1a590
Allow Fetcher to optionally store robots.txt content (if property
fetcher.store.robotstxt == true).
Improved RobotRulesParser command-line tool.
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit:
Ignore robots.txt when parsing segment, refactored storing of robots.txt in
FetcherThread
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/264eea01
Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/264eea01
Diff:
NUTCH-2300 Fetcher to optionally save robots.txt
Merge branch 'SaveRobotsTxt' of https://github.com/sebastian-nagel/nutch, this
closes #141
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/3fca1a59
Tree:
simplified code: use diamond operator
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/f3af9a54
Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/f3af9a54
Diff: http://git-wip-us.apache.org/repos/asf/nutch/diff/f3af9a54
Repository: nutch
Updated Branches:
refs/heads/2.x 5c3a38128 -> 22683a1df
NUTCH-2302 RAMConfManager Could Be Constructed With Custom Configuration
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/fd722c89
Tree:
Merge branch '2.x' of https://git-wip-us.apache.org/repos/asf/nutch into 2.x
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/22683a1d
Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/22683a1d
Diff:
Repository: nutch
Updated Branches:
refs/heads/2.x b7f3fce42 -> 5c3a38128
Fix for NUTCH-2305 generate.min.score doesn't work, contributed by Kiyonari
Harigae
Project: http://git-wip-us.apache.org/repos/asf/nutch/repo
Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/5c3a3812
Tree: