Hi.
I'm thinking about a solution to a problem I have. I need to create keyed
session windows from multiple streams of data. Combining streams is done by
watermarks. The problem is, one of the streams can be slower. This opens
too many windows that wait for the stream to catch up, which wastes
resources, slows down checkpointing and access. I was thinking about some
way to detect this and stop reading from the faster streams which should
create backpressure. Is it something that is possible now? If not, would
there be any interest in adding this feature by me? If it would be a more
complex problem, I would like to make a master thesis form it.

Adam

Reply via email to