[1/5] nutch git commit: Allow Fetcher to optionally store robots.txt content (if property fetcher.store.robotstxt == true). Improved RobotRulesParser command-line tool.

2016-08-22 Thread snagel
Repository: nutch Updated Branches: refs/heads/master d37b7ce13 -> 3fca1a590 Allow Fetcher to optionally store robots.txt content (if property fetcher.store.robotstxt == true). Improved RobotRulesParser command-line tool. Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit:

[2/5] nutch git commit: Ignore robots.txt when parsing segment, refactored storing of robots.txt in FetcherThread

2016-08-22 Thread snagel
Ignore robots.txt when parsing segment, refactored storing of robots.txt in FetcherThread Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/264eea01 Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/264eea01 Diff:

[5/5] nutch git commit: NUTCH-2300 Fetcher to optionally save robots.txt Merge branch 'SaveRobotsTxt' of https://github.com/sebastian-nagel/nutch, this closes #141

2016-08-22 Thread snagel
NUTCH-2300 Fetcher to optionally save robots.txt Merge branch 'SaveRobotsTxt' of https://github.com/sebastian-nagel/nutch, this closes #141 Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/3fca1a59 Tree:

[4/5] nutch git commit: simplified code: use diamond operator

2016-08-22 Thread snagel
simplified code: use diamond operator Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/f3af9a54 Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/f3af9a54 Diff: http://git-wip-us.apache.org/repos/asf/nutch/diff/f3af9a54

[1/2] nutch git commit: NUTCH-2302 RAMConfManager Could Be Constructed With Custom Configuration

2016-08-22 Thread lewismc
Repository: nutch Updated Branches: refs/heads/2.x 5c3a38128 -> 22683a1df NUTCH-2302 RAMConfManager Could Be Constructed With Custom Configuration Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/fd722c89 Tree:

[2/2] nutch git commit: Merge branch '2.x' of https://git-wip-us.apache.org/repos/asf/nutch into 2.x

2016-08-22 Thread lewismc
Merge branch '2.x' of https://git-wip-us.apache.org/repos/asf/nutch into 2.x Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/22683a1d Tree: http://git-wip-us.apache.org/repos/asf/nutch/tree/22683a1d Diff:

nutch git commit: Fix for NUTCH-2305 generate.min.score doesn't work, contributed by Kiyonari Harigae

2016-08-22 Thread snagel
Repository: nutch Updated Branches: refs/heads/2.x b7f3fce42 -> 5c3a38128 Fix for NUTCH-2305 generate.min.score doesn't work, contributed by Kiyonari Harigae Project: http://git-wip-us.apache.org/repos/asf/nutch/repo Commit: http://git-wip-us.apache.org/repos/asf/nutch/commit/5c3a3812 Tree: