[
https://issues.apache.org/jira/browse/IMPALA-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18063598#comment-18063598
]
Zoltán Borók-Nagy commented on IMPALA-12675:
--------------------------------------------
For the validation check we should take a look at
[https://github.com/simdutf/simdutf] (successor of
[https://github.com/lemire/fastvalidate-utf-8)|https://github.com/lemire/fastvalidate-utf-8]
> Set PARQUET_ANNOTATE_STRINGS_UTF8 to true by default
> ----------------------------------------------------
>
> Key: IMPALA-12675
> URL: https://issues.apache.org/jira/browse/IMPALA-12675
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Reporter: Zoltán Borók-Nagy
> Assignee: Dániel Gábor Vankó
> Priority: Blocker
>
> Now that we have the BINARY type for binary data, and also have UTF-8
> support, it makes sense to set PARQUET_ANNOTATE_STRINGS_UTF8 to true by
> default in a new major release
> *We should only resolve this issue if we are ready for a new major release.*
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
