[
https://issues.apache.org/jira/browse/FLINK-41255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-41255:
-----------------------------------
Labels: pull-request-available (was: )
> Value-format metadata columns are NULL with key.fields and
> value.fields-include=ALL
> -----------------------------------------------------------------------------------
>
> Key: FLINK-41255
> URL: https://issues.apache.org/jira/browse/FLINK-41255
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Reporter: Mate Czagany
> Priority: Major
> Labels: pull-request-available
>
> A {{kafka}} table with {{{}key.fields{}}}, the default
> {{'value.fields-include' = 'ALL'}} and a metadata column from the value
> format (such as {{value.source.timestamp}} from {{{}debezium-json{}}}) gets
> NULL in that column.
> {code:sql}
> CREATE TABLE t (
> id INT,
> src_ts TIMESTAMP_LTZ(3) METADATA FROM 'value.source.timestamp' VIRTUAL
> ) WITH (
> 'connector' = 'kafka',
> 'topic' = 't',
> 'properties.bootstrap.servers' = 'localhost:9092',
> 'scan.startup.mode' = 'earliest-offset',
> 'key.format' = 'json',
> 'key.fields' = 'id',
> 'value.format' = 'debezium-json'
> );
> {code}
> {noformat}
> key: {"id":1}
> value:
> {"before":null,"after":{"id":1},"source":{"ts_ms":1700000000000},"op":"c"}
> {noformat}
> {noformat}
> expected: +I(1, 2023-11-14 22:13:20.000)
> actual: +I(1, NULL)
> {noformat}
> With {{{}'value.fields-include' = 'EXCEPT_KEY'{}}}, or without
> {{{}key.format{}}}/{{{}key.fields{}}}, the row is correct.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)