Hi Jim, > On Jun 28, 2017, at 12:07am, Jim Idle <ji...@proofpoint.com> wrote: > > So right now it looks the HTML parser only sends through script tags if the > hay a src attribute. Is this likely to change or should I use another parser > for HTML? I could submit a patch for this of course.
You can use a custom mapper if you want to alter which tags get passed through. E.g. check out IdentityHtmlMapper in Tika for a mapper that passes through everything. > > Also, does anyone have an opinion if the underlying tag soup stuff is > tolerant of HTML in a similar manner to browsers which will try to render > anything) or is expecting well-formed HTML. I can go look at the Tag Soup > stuff directly of course, but just wondered if anyone has experience of using > Tika to parse HTML. TagSoup (and JSoup and NekoHTML) are all Java libraries that try to fix up broken HTML, with varying degrees of success, depending on the way that HTML is broken. — Ken -------------------------- Ken Krugler +1 530-210-6378 http://www.scaleunlimited.com custom big data solutions & training Hadoop, Cascading, Cassandra & Solr
