[
https://issues.apache.org/jira/browse/NUTCH-961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789735#comment-13789735
]
Markus Jelsma commented on NUTCH-961:
-------------------------------------
Hi Otis - there are no significant improvements between the 1.1.0 and 1.2.0 of
Boilerpipe, at least not when it comes to better extraction. I am very sure
that when the demo was using 1.2.0, we got identical results with 1.2.0 as
well, but still poor in cases not suitable such as overviews, blocks etc. I am
also very sure that the current 1.2.0 is nowadays different than what the demo
returns, it is not identical anymore, and improved quite a lot.
We don't use it BP anymore but i'm happy to commit whenever 1.2.0 is in maven
or part of Tika if it gets donated to the ASF. We need to get NUTCH-1233 in as
well then.
> Expose Tika's boilerpipe support
> --------------------------------
>
> Key: NUTCH-961
> URL: https://issues.apache.org/jira/browse/NUTCH-961
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 2.3, 1.8
>
> Attachments: BoilerpipeExtractorRepository.java,
> NUTCH-961-1.3-3.patch, NUTCH-961-1.3-tikaparser1.patch,
> NUTCH-961-1.3-tikaparser.patch, NUTCH-961-1.4-dombuilder-1.patch,
> NUTCH-961-1.5-1.patch, NUTCH-961-1.8-1.patch, NUTCH-961-2.1-v1.patch,
> NUTCH-961-2.1-v2.patch, NUTCH-961v2.patch
>
>
> Tika 0.8 comes with the Boilerpipe content handler which can be used to
> extract boilerplate content from HTML pages. We should see how we can expose
> Boilerplate in the Nutch cofiguration.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
