Support returning original markup in BoilerpipeContentHandler
-------------------------------------------------------------
Key: TIKA-564
URL: https://issues.apache.org/jira/browse/TIKA-564
Project: Tika
Issue Type: Improvement
Components: parser
Affects Versions: 0.8
Reporter: Ken Krugler
Assignee: Ken Krugler
Priority: Minor
Fix For: 0.9
Currently the BoilerpipeContentHandler emits all non-boilerplate text (as
defined by Boilerpipe) as a series of <p>xxx</p> text blocks, without any
markup.
But if you need to find URLs in these blocks, or section headers, then the
original markup has to be preserved.
Unfortunately Boilerpipe currently assumes that you have the ability to replay
the input stream, and parse it a second time to match up text with what's been
extracted (e.g. see HTMLHighlighter), but with Tika that's not easy to do - the
interface is a ContentHandler, so you don't have the original inputstream to
spool out.
Instead I plan to record the minimum SAX events, and replay those.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.