[jira] [Commented] (FLINK-27436) option `properties.group.id` is not effective in kafka connector for finksql
[
https://issues.apache.org/jira/browse/FLINK-27436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530329#comment-17530329
]
Spongebob commented on FLINK-27436:
---
Hi [~martijnvisser] , When I deploy my flinksql application that contains
multiple insertion sql that are both executed by one statementSet to standalone
cluster,
It did not tigger checkpoints despite some source table already got data input.
> option `properties.group.id` is not effective in kafka connector for finksql
>
>
> Key: FLINK-27436
> URL: https://issues.apache.org/jira/browse/FLINK-27436
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.14.3
>Reporter: Spongebob
>Priority: Major
>
> option `properties.group.id` is not effective in kafka connector for finksql.
> when I run this sql, I can read message from specific topic normaly. But I
> could not
> find the group named `test-group` in kafka server.
> {code:java}
> // ddl like this
> "CREATE TABLE ...
> "WITH ('connector' = 'kafka',
> 'properties.bootstrap.servers' = '...'," +
> "'topic' = '...',"+
> "'scan.startup.mode'='latest-offset'," +
> "'properties.group.id' = 'test-group'," +
> "'format' = 'debezium-json')"; {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
[jira] [Commented] (FLINK-27436) option `properties.group.id` is not effective in kafka connector for finksql
[
https://issues.apache.org/jira/browse/FLINK-27436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529278#comment-17529278
]
Spongebob commented on FLINK-27436:
---
[~martijnvisser] Great I can see it now follow your advise. But the snapshot
would not be made until data input into the connector.
> option `properties.group.id` is not effective in kafka connector for finksql
>
>
> Key: FLINK-27436
> URL: https://issues.apache.org/jira/browse/FLINK-27436
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.14.3
>Reporter: Spongebob
>Priority: Major
>
> option `properties.group.id` is not effective in kafka connector for finksql.
> when I run this sql, I can read message from specific topic normaly. But I
> could not
> find the group named `test-group` in kafka server.
> {code:java}
> // ddl like this
> "CREATE TABLE ...
> "WITH ('connector' = 'kafka',
> 'properties.bootstrap.servers' = '...'," +
> "'topic' = '...',"+
> "'scan.startup.mode'='latest-offset'," +
> "'properties.group.id' = 'test-group'," +
> "'format' = 'debezium-json')"; {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
[jira] [Commented] (FLINK-27436) option `properties.group.id` is not effective in kafka connector for finksql
[
https://issues.apache.org/jira/browse/FLINK-27436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529272#comment-17529272
]
Martijn Visser commented on FLINK-27436:
Could you enable checkpointing and verify again? I believe this is the reason
why you're not seeing it yet
> option `properties.group.id` is not effective in kafka connector for finksql
>
>
> Key: FLINK-27436
> URL: https://issues.apache.org/jira/browse/FLINK-27436
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.14.3
>Reporter: Spongebob
>Priority: Major
>
> option `properties.group.id` is not effective in kafka connector for finksql.
> when I run this sql, I can read message from specific topic normaly. But I
> could not
> find the group named `test-group` in kafka server.
> {code:java}
> // ddl like this
> "CREATE TABLE ...
> "WITH ('connector' = 'kafka',
> 'properties.bootstrap.servers' = '...'," +
> "'topic' = '...',"+
> "'scan.startup.mode'='latest-offset'," +
> "'properties.group.id' = 'test-group'," +
> "'format' = 'debezium-json')"; {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
[jira] [Commented] (FLINK-27436) option `properties.group.id` is not effective in kafka connector for finksql
[
https://issues.apache.org/jira/browse/FLINK-27436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529260#comment-17529260
]
Spongebob commented on FLINK-27436:
---
[~martijnvisser] I had not. By the ways I could see this option was printed by
both KafkaConsumer and AdminClient, but I don't know why it did not effect.
> option `properties.group.id` is not effective in kafka connector for finksql
>
>
> Key: FLINK-27436
> URL: https://issues.apache.org/jira/browse/FLINK-27436
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.14.3
>Reporter: Spongebob
>Priority: Major
>
> option `properties.group.id` is not effective in kafka connector for finksql.
> when I run this sql, I can read message from specific topic normaly. But I
> could not
> find the group named `test-group` in kafka server.
> {code:java}
> // ddl like this
> "CREATE TABLE ...
> "WITH ('connector' = 'kafka',
> 'properties.bootstrap.servers' = '...'," +
> "'topic' = '...',"+
> "'scan.startup.mode'='latest-offset'," +
> "'properties.group.id' = 'test-group'," +
> "'format' = 'debezium-json')"; {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
[jira] [Commented] (FLINK-27436) option `properties.group.id` is not effective in kafka connector for finksql
[
https://issues.apache.org/jira/browse/FLINK-27436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529254#comment-17529254
]
Martijn Visser commented on FLINK-27436:
[~SpongebobZ] Have you enabled checkpointing? I believe this will only be
submitted if a snapshot has been made.
> option `properties.group.id` is not effective in kafka connector for finksql
>
>
> Key: FLINK-27436
> URL: https://issues.apache.org/jira/browse/FLINK-27436
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
>Affects Versions: 1.14.3
>Reporter: Spongebob
>Priority: Major
>
> option `properties.group.id` is not effective in kafka connector for finksql.
> when I run this sql, I can read message from specific topic normaly. But I
> could not
> find the group named `test-group` in kafka server.
> {code:java}
> // ddl like this
> "CREATE TABLE ...
> "WITH ('connector' = 'kafka',
> 'properties.bootstrap.servers' = '...'," +
> "'topic' = '...',"+
> "'scan.startup.mode'='latest-offset'," +
> "'properties.group.id' = 'test-group'," +
> "'format' = 'debezium-json')"; {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
