Hong Liang Teoh created FLINK-36671:
---------------------------------------
Summary: Kinesis Table API for new KDS source does not support
metadata.
Key: FLINK-36671
URL: https://issues.apache.org/jira/browse/FLINK-36671
Project: Flink
Issue Type: Bug
Components: Connectors / Kinesis
Affects Versions: aws-connector-5.0.0
Reporter: Hong Liang Teoh
h2. What
The old Kinesis Table API source `kinesis-legacy` supports defining virtual
columns using table metadata.
For example:
{code:java}
CREATE TABLE KinesisTable (
`user_id` BIGINT,
`arrival_time` TIMESTAMP(3) METADATA FROM 'timestamp' VIRTUAL,
`shard_id` VARCHAR(128) NOT NULL METADATA FROM 'shard-id' VIRTUAL,
`sequence_number` VARCHAR(128) NOT NULL METADATA FROM 'sequence-number'
VIRTUAL
)
WITH (
'connector' = 'kinesis-legacy',
...
){code}
We should support this for the new kinesis connector source too.
h2. Success Criteria
# *kinesis* Table API source supports *VIRTUAL* columns
# automated tests added to validate that the connector supports metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
