[
https://issues.apache.org/jira/browse/NUTCH-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13568087#comment-13568087
]
Lewis John McGibbney commented on NUTCH-1526:
---------------------------------------------
@Chris, your memory is better than most. The thread you've quoted above was
most certainly filtered out from my memory.
The review board issue for reference
https://reviews.apache.org/r/9119/
> Create SegmentContentDumperTool for easily extracting out file contents from
> SegmentDirs
> ----------------------------------------------------------------------------------------
>
> Key: NUTCH-1526
> URL: https://issues.apache.org/jira/browse/NUTCH-1526
> Project: Nutch
> Issue Type: Bug
> Reporter: Chris A. Mattmann
> Labels: content, dumper, nutch, tools
>
> It only took me 1.2 years, but I finally got around to it. This patch will
> deliver a SegmentContentDumper tool per the description here:
> http://s.apache.org/kv
> And per the interface here:
> {noformat}
> ./bin/nutch org.apache.nutch.tools.SegmentContentDumper [options]
> -segmentRootDir full file path to the root segment directory, e.g.,
> crawl/segments
> -regexUrlPattern a regex URL pattern to select URL keys to dump from the
> content DB in each segment
> -outputDir The output directory to write file names to.
> -metadata --key=value where key is a Content Metadata key and value is a
> value to check.
> {noformat}
> If the URL and its content metadata have a matching key,value pair, dump it.
> Allow for regex matching on the value.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
