Kevin Kwon created FLINK-19517: ---------------------------------- Summary: Support for Confluent Kafka on table creation Key: FLINK-19517 URL: https://issues.apache.org/jira/browse/FLINK-19517 Project: Flink Issue Type: Wish Affects Versions: 1.12.0 Reporter: Kevin Kwon
Currently, table creation from SQL client such as below works well {code:sql} CREATE TABLE kafkaTable ( user_id BIGINT, item_id BIGINT, category_id BIGINT, behavior STRING, ts TIMESTAMP(3) ) WITH ( 'connector' = 'kafka', 'topic' = 'user_behavior', 'properties.bootstrap.servers' = 'localhost:9092', 'properties.group.id' = 'testGroup', 'format' = 'avro', 'scan.startup.mode' = 'earliest-offset' ) {code} Although I would wish for the table creation to support Confluent Kafka configuration as well. For example some think like {code:sql} CREATE TABLE kafkaTable ( user_id BIGINT, item_id BIGINT, category_id BIGINT, behavior STRING, ts TIMESTAMP(3) ) WITH ( 'connector' = 'kafka-confluent', 'topic' = 'user_behavior', 'properties.bootstrap.servers' = 'localhost:9092', 'properties.group.id' = 'testGroup', 'schema-registry' = 'http://schema-registry.com', 'scan.startup.mode' = 'earliest-offset' ) {code} Additionally, it will be better if we can - specify 'parallelism' within WITH clause to support parallel partition processing - specify custom properties within WITH clause specified in [https://docs.confluent.io/5.4.2/installation/configuration/consumer-configs.html] -- This message was sent by Atlassian Jira (v8.3.4#803005)