[ 
https://issues.apache.org/jira/browse/TIKA-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390252#comment-16390252
 ] 

Hudson commented on TIKA-2592:
------------------------------

SUCCESS: Integrated in Jenkins build tika-branch-1x #5 (See 
[https://builds.apache.org/job/tika-branch-1x/5/])
TIKA-2592 -- ignore charsets not supported by IANA in html meta-headers 
(tallison: 
[https://github.com/apache/tika/commit/164c9286fc0933051e86ce0a209250aa51bee3bf])
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/html/HtmlEncodingDetector.java
* (edit) CHANGES.txt
* (add) 
tika-parsers/src/main/resources/org/apache/tika/parser/html/StandardCharsets_unsupported_by_IANA.txt
* (edit) 
tika-parsers/src/test/java/org/apache/tika/parser/html/HtmlParserTest.java
* (add) 
tika-parsers/src/test/resources/test-documents/testHTML_charset_utf16le.html
* (add) 
tika-parsers/src/test/resources/test-documents/testHTML_charset_utf8.html


> HTML with charset unicode handled as utf-16 instead utf-8
> ---------------------------------------------------------
>
>                 Key: TIKA-2592
>                 URL: https://issues.apache.org/jira/browse/TIKA-2592
>             Project: Tika
>          Issue Type: Improvement
>    Affects Versions: 2.0, 1.16, 1.17
>            Reporter: Andreas Meier
>            Priority: Minor
>             Fix For: 1.18, 2.0.0
>
>         Attachments: IANA Charset names.txt, 
> StandardCharsets_unsupported_by_IANA.txt, TestCharsetUnicodeHTML.html, 
> TestHTMLCharsetArabicCP1256.html, TestHTMLCharsetCP1256.html, 
> fix-for-TIKA2592-contributed-by-Andreas-Meier.patch
>
>
> HTML files are detected as utf-16 when meta content is set to "unicode".
> {code:XML}
> <meta http-equiv="Content-Type" content="text/html; charset="unicode">
>  {code}
>  
> Shouldn't the default be utf-8?
> The attached sample file is shown correctly in:
> Chromium Version 55.0.2883.75
> Firefox 50.1.0
> IE 11
> I am aware that there is no charset "unicode" (available character encodings: 
> [http://www.iana.org/assignments/character-sets/character-sets.xhtml|http://www.iana.org/assignments/character-sets/character-sets.xhtml])
> Unfortunately there are many wrong encodings used out there.
> All unknown encodings should be validated or at least be set to default utf-8.
> Regards 
> Andreas



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to