[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577679#comment-17577679 ] Luke Chen commented on FLINK-28060: --- [~mason6345] , yes, Kafka v3.1.1 expects(assumes) consumer poll

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577675#comment-17577675 ] Mason Chen commented on FLINK-28060: [~showuon] Earlier, I had attempted to write an integration

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577368#comment-17577368 ] Chesnay Schepler commented on FLINK-28060: -- I ran CI with Kafka 3.2.1 and it passed without

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575190#comment-17575190 ] Luke Chen commented on FLINK-28060: --- Could we try to test with Kafka v3.2.1. As mentioned in this

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574319#comment-17574319 ] Kyle R Stehbens commented on FLINK-28060: - Hi, we we're experiencing this issues and downgraded

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572197#comment-17572197 ] Qingsheng Ren commented on FLINK-28060: --- [~danderson] The ticket KAFKA-13840 is still pending for

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571628#comment-17571628 ] David Anderson commented on FLINK-28060: [~martijnvisser] [~renqs] [~mason6345] Are we any

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557289#comment-17557289 ] Martijn Visser commented on FLINK-28060: I'm not sure that we have a test for this behaviour. It

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557005#comment-17557005 ] Mason Chen commented on FLINK-28060: [~renqs] [~martijnvisser] were we able to reproduce this issue

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556320#comment-17556320 ] Christian Lorenz commented on FLINK-28060: -- I think the according issue in Kafka is

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555896#comment-17555896 ] Martijn Visser commented on FLINK-28060: Fixed in master:

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1758#comment-1758 ] Martijn Visser commented on FLINK-28060: +1 for this approach > Kafka Commit on checkpointing

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1727#comment-1727 ] David Anderson commented on FLINK-28060: It doesn't seem wise to upgrade the Kafka client from

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555303#comment-17555303 ] Martijn Visser commented on FLINK-28060: I've opened a PR against {{master}} to bump Kafka

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555271#comment-17555271 ] Martijn Visser commented on FLINK-28060: In my private CI run the upgrade to 3.1.1 was

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555061#comment-17555061 ] Christian Lorenz commented on FLINK-28060: -- [~mason6345] I did not observe that the commit

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555058#comment-17555058 ] Martijn Visser commented on FLINK-28060: {{FlinkKafkaConsumer}} has not been removed, but it has

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555057#comment-17555057 ] Mason Chen commented on FLINK-28060: +1 on [~peter.schrott] 's assessment–we need also need this for

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554952#comment-17554952 ] Martijn Visser commented on FLINK-28060: I'm waiting for CI to complete a run upgrading to

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554949#comment-17554949 ] Qingsheng Ren commented on FLINK-28060: --- Personally I prefer to upgrade the Kafka client.

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554946#comment-17554946 ] Chesnay Schepler commented on FLINK-28060: -- Indeed going back to 2.4.1 doesn't seem feasible;

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554943#comment-17554943 ] Christian Lorenz commented on FLINK-28060: -- Does someone know if the Kafka Team is aware that

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554941#comment-17554941 ] Martijn Visser commented on FLINK-28060: I have sincere doubts about reverting FLINK-24765,

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554935#comment-17554935 ] David Anderson commented on FLINK-28060: Along the lines of what Chesnay mentioned, what would

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554609#comment-17554609 ] Peter Schrott commented on FLINK-28060: --- >From a users perspective I see 2 issues here: 1)

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554597#comment-17554597 ] Chesnay Schepler commented on FLINK-28060: -- Could someone clarify what this issue means in

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554530#comment-17554530 ] Martijn Visser commented on FLINK-28060: I think it depends on the impact of bumping the Kafka

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554498#comment-17554498 ] David Anderson commented on FLINK-28060: I'd like to include a fix for this in 1.15.1, but I'm

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554457#comment-17554457 ] Qingsheng Ren commented on FLINK-28060: --- I did some investigation and strongly suspect that this

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554222#comment-17554222 ] Martijn Visser commented on FLINK-28060: [~renqs] This seems related to FLINK-27962 - Should we