[
https://issues.apache.org/jira/browse/FLINK-28435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17563667#comment-17563667
]
Martijn Visser commented on FLINK-28435:
----------------------------------------
[~HunterHunter] There have been more changes than just the Kafka upgrade in
Flink 1.15, so I don't think we can easily pin this on just the Kafka upgrade.
I think we need more information from logs and metrics in order to pinpoint if
there's something wrong in Flink or in your local setup. Are you constantly
generating data on Kafka? What format are you using? Which Kafka broker version
are you using etc. At first I'm suspecting something local, because we haven't
had additional reports on backpressure while Flink 1.15 has been in use for
quite some time already.
> Flink version 1.15.0 consumption Kafka has backpressure.
> ---------------------------------------------------------
>
> Key: FLINK-28435
> URL: https://issues.apache.org/jira/browse/FLINK-28435
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.15.0
> Reporter: HunterHunter
> Priority: Major
>
> A simple SQL program
> {code:java}
> CREATE temporary TABLE `print_sink` (
> `id` VARCHAR(2147483647)
> )WITH (
> 'connector' = 'print'
> );
> insert into print_sink
> select id
> from kafka-source
> /*+ OPTIONS('properties.bootstrap.servers'='brokers',
> 'topic' = 'topicname',
> 'properties.group.id'='test',
> 'scan.startup.mode'='latest-offset')
> */ {code}
> Back pressure occurs when I use `flink 1.15.0`,
> When I use `flink 1.13/ flink 1.14`, it works normally.
> I think this is caused by the version of Kafka.
> I have tried to consume versions `Kafka 1.1` and `Kafka 2.7.1`, and `Flink
> 1.13/1.14` is normal （`Kafka 2.4.1` is used in `Flink 1.13/1.14`）;
> But `Flink 1.15` has back pressure. (I had try to change Kafka version to
> `Kafka 2.7.1`, which is still back pressure).
>
>
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
