Re: Customizing backpressure mechanism for RichParallelSourceFunction

2022-03-10 Thread Chesnay Schepler
It's not possible to send events to sources; data only flows in 1 direction. On 03/03/2022 06:31, Le Xu wrote: Hello! I have a dataflow pipeline built using Flink's RichParallelSourceFunction as parallel sources. I'm wondering if there are any mechanisms that I could use to implement *ack-bas

Customizing backpressure mechanism for RichParallelSourceFunction

2022-03-02 Thread Le Xu
Hello! I have a dataflow pipeline built using Flink's RichParallelSourceFunction as parallel sources. I'm wondering if there are any mechanisms that I could use to implement *ack-based* back-pressure mechanism by sending ACK messages from operators (within the runtime) to source functions to achie