[
https://issues.apache.org/jira/browse/NUTCH-961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13617739#comment-13617739
]
Miles Rowland commented on NUTCH-961:
-------------------------------------
Roland, thanks for porting to 2.1. I'm having an issue where nutch is only
successfully parsing the first fetched url, and all other urls fail to parse
with a warning "unable to successfully parse content [website] of type [x]". If
I run parseChecker on that url the parse runs successfully using
tika/boilerplate, so it seems to be an issue that only occurs when trying to
run the second parse or more in a batch job.
I'm running Nutch 2.1 with MySQL. The problem occurs with both bp1.1.0 and
1.2.0.
> Expose Tika's boilerpipe support
> --------------------------------
>
> Key: NUTCH-961
> URL: https://issues.apache.org/jira/browse/NUTCH-961
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.7, 2.2
>
> Attachments: BoilerpipeExtractorRepository.java,
> NUTCH-961-1.3-3.patch, NUTCH-961-1.3-tikaparser1.patch,
> NUTCH-961-1.3-tikaparser.patch, NUTCH-961-1.4-dombuilder-1.patch,
> NUTCH-961-1.5-1.patch, NUTCH-961-2.1-v1.patch, NUTCH-961-2.1-v2.patch,
> NUTCH-961v2.patch
>
>
> Tika 0.8 comes with the Boilerpipe content handler which can be used to
> extract boilerplate content from HTML pages. We should see how we can expose
> Boilerplate in the Nutch cofiguration.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
