Re: Performance Issues in Source Operator while migrating to Flink-1.14 from 1.9

Hi, Unfortunately the new KafkaSource was contributed without good benchmarks, and so far you are the first one that noticed and reported this issue. Without more direct comparison (as Martijn suggested), it's hard for us to help right away. It would be a tremendous help for us if you could for

Re: Performance Issues in Source Operator while migrating to Flink-1.14 from 1.9

Hey Martijn, Thanks a lot for getting back to us. To give you a little bit more context, we do maintain an open-source project around flink dagger which is a wrapper for proto processing. As part of the upgrade to the latest version, we did some refactoring and

Re: Performance Issues in Source Operator while migrating to Flink-1.14 from 1.9

Hi Arujit, I'm also looping in some contributors from the connector and runtime perspective in this thread. Did you also test the upgrade first by only upgrading to Flink 1.14 and keeping the FlinkKafkaConsumer? That would offer a better way to determine if a regression is caused by the upgrade