[
https://issues.apache.org/jira/browse/IMPALA-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18091259#comment-18091259
]
ASF subversion and git services commented on IMPALA-15067:
----------------------------------------------------------
Commit e5727bb7176294114651785a24fb27f4a6bc47e5 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=e5727bb71 ]
IMPALA-15067: Add VariantValue and basic decoding functions
Adds the backend implementation for decoding VARIANT binary blobs:
- variant-value.h: Defines VariantMetadata (field name dictionary
parser) and VariantValue (value decoder with object/array accessors
and path navigation). Supports all variant physical types defined by
the Parquet Variant spec.
- variant-util.cc/h: Implements VariantToJson() which serializes a
variant (metadata + value blobs) to JSON. Supported types include
null, booleans, int8/16/32/64, float, double, decimal4/8/16,
short/long strings, objects, arrays, TIMESTAMPNTZ (micros), and
TIMESTAMPNTZ_NANOS. BINARY values are base64-encoded. TIMESTAMPTZ,
TIME, and UUID remain unsupported.
- variant-functions-ir.cc/h: Implements the variant_to_json(BINARY,
BINARY)->STRING builtin expression function.
Testing
- Unit tests covering metadata parsing, all primitive types, objects,
arrays, path navigation, and JSON serialization. Includes test cases
extracted from Hive-written and DuckDB Parquet test files for
cross-engine compatibility validation.
Generated-by: Claude Opus 4.8 (Max effort)
Change-Id: I904618570e8c21d099c9a96b496d85e9246483de
Reviewed-on: http://gerrit.cloudera.org:8080/24392
Reviewed-by: Peter Rozsa <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add backend support for VARIANTs
> --------------------------------
>
> Key: IMPALA-15067
> URL: https://issues.apache.org/jira/browse/IMPALA-15067
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg, impala-iceberg-active-backlog
>
> Define VariantValue and utilty functions to convert it to JSON.
> Add unit tests.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
