[
https://issues.apache.org/jira/browse/TIKA-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13668300#comment-13668300
]
David Morana commented on TIKA-1102:
------------------------------------
Good morning,
I saw there was some activity on this. I apologize, because I guess I should
have closed this ticket because later on, I discovered that the Tika errors
were caused by crawling html fragments.
Once I excluded the fragments, all the errors went away.
So, I don't know if we need to add <div> to the list of heuristics...
Please advise...
> Can we add <div> to the list of heuristics for bad html fragments?
> ------------------------------------------------------------------
>
> Key: TIKA-1102
> URL: https://issues.apache.org/jira/browse/TIKA-1102
> Project: Tika
> Issue Type: Improvement
> Components: parser
> Affects Versions: 1.2, 1.3
> Environment: I'm using Solr 4.0 final with tika v1.2 and ManifoldCF
> v1.2dev all on tomcat 7.0.37
> Reporter: David Morana
>
> Good morning,
> Crawling legacy sites with poorly written html fragments causes severe Solr
> Xml parse errors and in turn causes ManifoldCF to abort.
> Can we add <div> to the list of heuristics so the html parser is used instead
> of the xml parser?
> see this ticket for further information:
> [TIKA-1101|https://issues.apache.org/jira/browse/TIKA-1101]
> Thank you,
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
