[jira] [Created] (TIKA-5048) UTF-16/UTF-32 detection: one emoji defeats UTF-16 without a BOM, UTF-32 is reported as UTF-16

[Tim Allison (Jira) via dev]

Tim Allison created TIKA-5048:
---------------------------------

             Summary: UTF-16/UTF-32 detection: one emoji defeats UTF-16 without 
a BOM, UTF-32 is reported as UTF-16
                 Key: TIKA-5048
                 URL: https://issues.apache.org/jira/browse/TIKA-5048
             Project: Tika
          Issue Type: Task
            Reporter: Tim Allison


and a surrogate pair cut at the probe edge vetoes a correct call.

Bot found 3 areas for improvement in utf16. We'll likely fix these as part of a 
larger charset encoding detection fix.

I wanted to document these limitations.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)