Hi everyone, I would like to start a discussion about FLIP-544 SinkUpsertMaterializer V2 [1].
SinkUpsertMaterializer is an operator in Flink that reconciles out of order changelog events before sending them to an upsert sink. In some cases (that we see in our production), performance of this operator degrades exponentially, depending on the input data. This FLIP proposes a new implementation that is optimized for such cases and serves as a synchronization point for other efforts in that area. Looking forward to feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-544%3A+SinkUpsertMaterializer+V2 Regards, Roman