[
https://issues.apache.org/jira/browse/NUTCH-961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025286#comment-13025286
]
Gabriele Kahlout commented on NUTCH-961:
----------------------------------------
@Markus - Thank you.
Watch out for [1] in parse-plugins.xml. .html pages may indeed by xhtml. You
can safely delete alla parse-html mimeType associations, as long as you have
[2] (and you want to use parse-tika instead of parse-html ).
[1]
<mimeType name="application/xhtml+xml">
<plugin id="parse-html" />
</mimeType>
[2]
<!-- by default if the mimeType is set to *, or
if it can't be determined, use parse-tika -->
<mimeType name="*">
<plugin id="parse-tika" />
</mimeType>
> Expose Tika's boilerpipe support
> --------------------------------
>
> Key: NUTCH-961
> URL: https://issues.apache.org/jira/browse/NUTCH-961
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Reporter: Markus Jelsma
> Fix For: 2.0
>
> Attachments: BoilerpipeExtractorRepository.java,
> NUTCH-961-1.3-tikaparser.patch
>
>
> Tika 0.8 comes with the Boilerpipe content handler which can be used to
> extract boilerplate content from HTML pages. We should see how we can expose
> Boilerplate in the Nutch cofiguration.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
