[jira] [Created] (TIKA-2592) HTML with charset unicode handled as utf-16 instead utf-8

[Andreas Meier (JIRA)]

Andreas Meier created TIKA-2592:
-----------------------------------

             Summary: HTML with charset unicode handled as utf-16 instead utf-8
                 Key: TIKA-2592
                 URL: https://issues.apache.org/jira/browse/TIKA-2592
             Project: Tika
          Issue Type: Bug
    Affects Versions: 1.17, 1.16, 2.0
            Reporter: Andreas Meier
         Attachments: TestCharsetUnicodeHTML.html

HTML files are detected as utf-16 when meta content is set to "unicode".

{code:XML}
<meta http-equiv="Content-Type" content="text/html; charset="unicode">
 {code}
 
Shouldn't the default be utf-8?

The attached sample file is shown correctly in:
Chromium Version 55.0.2883.75
Firefox 50.1.0
IE 11


I am aware that there is no charset "unicode" (available character encodings: 
[http://www.iana.org/assignments/character-sets/character-sets.xhtml|http://www.iana.org/assignments/character-sets/character-sets.xhtml])

Unfortunately there are many wrong encodings used out there.

All unknown encodings should be validated or at least be set to default utf-8.


Regards 

Andreas



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)