Hi all I want to initiate discussion around FLIP-284[1]. The purpose of the FLIP is making AsyncSinkWriter[2] buffer controls adjustable as this was discovered to be sink dependant during the implementation for DDB sink[3]. Currently the async sink buffer control logic can be classified into buffer blocking, flush triggering and rate limiting, while the later was addressed separately in a similar contribution[4] we will follow same footsteps with other controls (Buffer blocking and Flush Triggering), allowing sink implementers to adjust their suitable strategies.
FLIP review and feedback is highly appreciated. Best Regards, Ahmed Hamdy [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-284+%3A+Making+AsyncSinkWriter+Flush+triggers+adjustable [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink [3] https://issues.apache.org/jira/browse/FLINK-29854 [4] https://cwiki.apache.org/confluence/display/FLINK/FLIP-242%3A+Introduce+configurable+RateLimitingStrategy+for+Async+Sink