[
https://issues.apache.org/jira/browse/LUCENE-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074764#comment-14074764
]
Steve Rowe commented on LUCENE-5740:
------------------------------------
Real HTML is more complicated: e.g. <p> within <p> is not allowed (or rather is
parsed as sibling non-closed elements).
Some pertinent discussion here in the javadocs of the Jericho HTML parser:
<http://jericho.htmlparser.net/docs/javadoc/net/htmlparser/jericho/Element.html>.
In particular, the "Single Tag Element" and "Implicitly Terminated Element"
sections, and the link in the latter section in the sentence "See the element
parsing rules for HTML elements with optional end tags for details on which
tags can implicitly terminate a given element."
> Add stripContentOfTags option to HTMLStripCharFilter
> ----------------------------------------------------
>
> Key: LUCENE-5740
> URL: https://issues.apache.org/jira/browse/LUCENE-5740
> Project: Lucene - Core
> Issue Type: New Feature
> Components: modules/analysis
> Reporter: David Smiley
> Assignee: David Smiley
>
> HTMLStripCharFilter should have an option to strip out the sub-content of
> certain elements. It already does this for SCRIPT & STYLE but it should be
> configurable to add more. I don't want certain elements to have their
> contents to be searchable.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
