[ 
https://issues.apache.org/jira/browse/CALCITE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714686#comment-17714686
 ] 

Tanner Clary commented on CALCITE-2616:
---------------------------------------

I know this case is a few years old but I was wondering whether there were 
thoughts on switching the default charset from {{ISO-8859-1}} to {{UTF-8}}. 
This could be useful for dialects that support UTF-8 encoding. 

> Can't create Unicode literal by RelBuilder
> ------------------------------------------
>
>                 Key: CALCITE-2616
>                 URL: https://issues.apache.org/jira/browse/CALCITE-2616
>             Project: Calcite
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.17.0
>            Reporter: Anton Haidai
>            Priority: Major
>
> Test in RelBuilderTest to reproduce the issue:
> {code:java}
> @Test public void testScanWithFilterByUnicodeValue() {
>   final RelBuilder builder = RelBuilder.create(config().build());
>   RelNode root =
>       builder.scan("EMP")
>           .filter(
>               builder.call(SqlStdOperatorTable.EQUALS,
>                   builder.field("ENAME"),
>                   builder.literal("Петро ピーター")
>               )
>           )
>           .build();
> }
> {code}
>  Result:
> org.apache.calcite.runtime.CalciteException: Failed to encode 'Петро ピーター' in 
> character set 'ISO-8859-1'
> Possible workaround: create saffron.properties with the following property
> saffron.default.charset=UTF-16LE
> But UTF-8 will not work as a value of this property, see 
> SqlUtil.translateCharacterSetName
> Related code:
>  * SqlUtil.translateCharacterSetName(charsetName)
>  * RelDataTypeFactoryImpl.getDefaultCharset()
>  * SaffronProperties
>  Could it be considered to switch defaults from "ISO-8859-1" to "UTF-8" in 
> SaffronProperties?
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to