[
https://issues.apache.org/jira/browse/IMPALA-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18052591#comment-18052591
]
ASF subversion and git services commented on IMPALA-14321:
----------------------------------------------------------
Commit df84e777d6f379012bd0812dad44cf2cd6cc06e7 in impala's branch
refs/heads/master from Daniel Vanko
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=df84e777d ]
IMPALA-14321: Add BINARY partition transform to Iceberg tables
With this change we add support for IDENTITY, TRUNCATE and BUCKET
partition transformation functions with binary parameter to Iceberg
tables.
Flatbuffer schema has changed, because when reading a string,
flatbuffers tries to enforce UTF-8 encoding, which fails for arbitrary
binary data. FbIcebergDataFile's raw_partition_fields is an array of
ubyte arrays from now on.
Testing:
- Added TestBinary() in iceberg-functions-test.cc with truncate width
edge cases
- Extended iceberg-partitioned-insert-*.test files with binary_col
partition tests
- Verified partition pruning works correctly for BINARY predicates
(NumFileMetadataRead metrics)
Generated-by: Github Copilot (Claude Sonnet 4.5)
Change-Id: I5fd1ef382aa064dad55445dea00fbd39caeca1d3
Reviewed-on: http://gerrit.cloudera.org:8080/23783
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add BINARY support to Iceberg partition transform functions
> -----------------------------------------------------------
>
> Key: IMPALA-14321
> URL: https://issues.apache.org/jira/browse/IMPALA-14321
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Dániel Gábor Vankó
> Assignee: Dániel Gábor Vankó
> Priority: Major
> Labels: impala-iceberg
>
> Impala should support Iceberg partition transform functions: IDENTITY,
> TRUNCATE, BUCKET, VOID for BINARY type.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
