[
https://issues.apache.org/jira/browse/IMPALA-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18094253#comment-18094253
]
Zoltán Borók-Nagy commented on IMPALA-15139:
--------------------------------------------
[~mszjat], please note there was a POC for DELTA_BINARY_PACKED encoding by
[~csringhofer]: [https://gerrit.cloudera.org/#/c/20041/]
This might be useful for decoding the lenghts.
> Add read support for DELTA_LENGTH_BYTE_ARRAY Parquet encoding
> -------------------------------------------------------------
>
> Key: IMPALA-15139
> URL: https://issues.apache.org/jira/browse/IMPALA-15139
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Zoltán Borók-Nagy
> Assignee: Mihaly Szjatinya
> Priority: Critical
>
> Parquet says DELTA_LENGTH_BYTE_ARRAY is preferred over PLAIN encoding for
> byte arrays:
> [https://github.com/apache/parquet-format/blob/master/Encodings.md#DELTALENGTH]
> Latest Trino also switched to this encoding:
> [https://github.com/trinodb/trino/commit/dc304f4a47c1b0d68d39557b6c6bbbd87ebb4743]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
