[jira] [Commented] (ASTERIXDB-1566) UTF8 got wrong when processing chinese char and beyond

[Jianfeng Jia (JIRA)]

    [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409771#comment-15409771
 ] 

Jianfeng Jia commented on ASTERIXDB-1566:
-----------------------------------------

I'm still in the early stage of the nvestigation. It seems that the "=" didn't 
use the string comparison function. If you need this function urgently, you can 
try the following code to explicitly use the string-equal function: 
{code}
set import-private-functions 'true';
string-equal("的" , "离")
{code}

> UTF8 got wrong when processing chinese char and beyond
> ------------------------------------------------------
>
>                 Key: ASTERIXDB-1566
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1566
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: AsterixDB
>         Environment: MAC and Linux
>            Reporter: Wenhai
>            Assignee: Jianfeng Jia
>            Priority: Critical
>
> If we give chinese characters with the same first byte yet the different rest 
> parts, asterixdb cann't differentiate it. For example, the query
> {noformat}
> "的"="离"
> {noformat}
> should return "false" due to the different code "&#x7684" of “的” and 
> "&#x79BB" of "离".
> The returned value is
> {noformat}
> true
> {noformat}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)