[
https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456568#comment-16456568
]
Fabian Hueske commented on FLINK-9178:
--------------------------------------
I'd suggest to first collect some feedback from committers that are familiar
with the internals of the connector before starting with an actual
implementation.
Such features need to be carefully planned to fit in the overall design of the
connector and system.
Please wait for feedback from [~tzulitai] or [~aljoscha].
Thanks, Fabian
> Add rate control for kafka source
> ---------------------------------
>
> Key: FLINK-9178
> URL: https://issues.apache.org/jira/browse/FLINK-9178
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: buptljy
> Priority: Major
>
> When I want to run the flink program from the earliest offset in Kafka, it'll
> be very easy to cause OOM if there are too much data, because of too many
> HeapMemorySegment in NetworkBufferPool.
> Maybe we should have some settings to control the rate of the receiving data?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)