[
https://issues.apache.org/jira/browse/FLINK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911879#comment-16911879
]
boshu Zheng commented on FLINK-13792:
-------------------------------------
+1 for this feature :)
> source and sink support manual rate limit
> -----------------------------------------
>
> Key: FLINK-13792
> URL: https://issues.apache.org/jira/browse/FLINK-13792
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Common
> Affects Versions: 1.8.1
> Reporter: zzsmdfj
> Priority: Major
>
> in current flink implement automatic flow control by back pressure, it is
> efficient for the most scene, but in some special scenario, do we need
> fine-grained flow control to avoid impact on other systems? For example: if i
> have window with days(a lot of datas), then do call ProcessWindowFunction
> when trigger, this will produce a lot of data to sink, if sink to message
> queue, it can have a huge impact to message queue. so if there is sink rate
> limiter, it is friendly to external system. for source rate limiter, it is
> appropriate for having window operator and accumulating a large amount of
> historical data.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
