[
https://issues.apache.org/jira/browse/NUTCH-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953793#comment-16953793
]
Sebastian Nagel commented on NUTCH-1559:
----------------------------------------
Proof (using
[testMetatags.html|https://github.com/apache/nutch/blob/master/src/plugin/parse-metatags/sample/testMetatags.html])
on recent master that parse-html is also affected:
{noformat}
> bin/nutch indexchecker \
-Dmetatags.names='*' \
-Dindex.parse.md='metatag.keywords' \
-Dplugin.includes='protocol-http|parse-(html|metatags)|index-(metadata)'
.../testMetatags.html
...
metatag.keywords : This is a test of keywords
metatag.keywords : This is a test of keywords
{noformat}
> parse-metatags duplicates extracted metatags
> --------------------------------------------
>
> Key: NUTCH-1559
> URL: https://issues.apache.org/jira/browse/NUTCH-1559
> Project: Nutch
> Issue Type: Bug
> Components: parser
> Affects Versions: 1.6
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Minor
> Fix For: 1.17
>
> Attachments: NUTCH-1559-1.x.patch
>
>
> If the plugin parse-metatags is used in combination with parse-tika, the
> extracted metatags (the pairs <name, value>) are duplicated.
> The metatags are found twice in parse.getData().getParseMeta() and in
> metaTags.getGeneralTags(). Is this necessary? Maybe we should fix parse-tika
> in this point?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
