[ https://issues.apache.org/jira/browse/TIKA-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520131#comment-16520131 ]
Gerard Bouchar commented on TIKA-2673: -------------------------------------- [This blog post by the whatwg on character encodings|https://blog.whatwg.org/the-road-to-html-5-character-encoding] is an interesting read that explains the gist of the specification and some of the reasons motivating it. [These tests|https://www.w3.org/International/tests/repository/html5/the-input-byte-stream/results-basics] show how well browsers respect the specification. > HtmlEncodingDetector doesn't follow the specification > ----------------------------------------------------- > > Key: TIKA-2673 > URL: https://issues.apache.org/jira/browse/TIKA-2673 > Project: Tika > Issue Type: Bug > Reporter: Gerard Bouchar > Priority: Major > Attachments: HtmlEncodingDetectorTest.java > > > This bug is linked to TIKA-2671, but does not concern metadata, but rather > the bytes-based detection itself. > While reading the specification, I collected a list of sample cases where > HtmlEncodingDetector differs from the specification, and thus fails at > detecting the right charset. > I am attaching the test cases to this issue: -- This message was sent by Atlassian JIRA (v7.6.3#76005)