Hey all, We have a Flink job reading from Kafka (specifically it uses FlinkKafkaConsumer011). There are instances when the job is processing a backlog and it ends up reading at a significantly high throughput and degrades the underlying Kafka cluster. If there was a way to rate limit the calls to Kafka (by controlling how often the *consumer*.poll() is called), it would be a useful feature for our use case.
Has anyone has run into a similar issue? Are there are any efforts/thoughts on implementing a rate-limiting feature in the Flink Kafka connector? Thanks Lakshmi
