Chris A. Mattmann created NUTCH-1526:
----------------------------------------
Summary: Create SegmentContentDumperTool for easily extracting out
file contents from SegmentDirs
Key: NUTCH-1526
URL: https://issues.apache.org/jira/browse/NUTCH-1526
Project: Nutch
Issue Type: Bug
Reporter: Chris A. Mattmann
It only took me <N> years, but I finally got around to it. This patch will
deliver a SegmentContentDumper tool per the description here:
http://s.apache.org/kv
And per the interface here:
{noformat}
./bin/nutch org.apache.nutch.tools.SegmentContentDumper [options]
-segmentRootDir full file path to the root segment directory, e.g.,
crawl/segments
-regexUrlPattern a regex URL pattern to select URL keys to dump from the
content DB in each segment
-outputDir The output directory to write file names to.
-metadata --key=value where key is a Content Metadata key and value is a
value to check.
{noformat}
If the URL and its content metadata have a matching key,value pair, dump it.
Allow for regex matching on the value.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
