Hi, I am kind of building a batch/streaming hybrid beam application. Data is fed into a kinesis stream and the beam pipeline is run.
I want to stop the pipeline if no new data is fed into the stream for a certain period of time, say 5 minutes. Is there a way of achieving this ? Right now I only see something like this: pipeline.run().waitUntilFinish(); Instead of waiting until finish can we have some conditional finish in any way ? Thanks Sachin