Hello! In case of KinesisIO there is a param which you can set - withMaxReadTime I think many IOs implement it. It does not check if there is still some outstanding data, simply finishes the pipeline when this time is over.
Best Regards, Pavel Solomin Tel: +351 962 950 692 | Skype: pavel_solomin | Linkedin <https://www.linkedin.com/in/pavelsolomin> On Thu, 4 May 2023 at 18:20, Sachin Mittal <sjmit...@gmail.com> wrote: > Hi, > I am kind of building a batch/streaming hybrid beam application. > Data is fed into a kinesis stream and the beam pipeline is run. > > I want to stop the pipeline if no new data is fed into the stream for a > certain period of time, say 5 minutes. > > Is there a way of achieving this ? > > Right now I only see something like this: > > pipeline.run().waitUntilFinish(); > > Instead of waiting until finish can we have some conditional finish in any > way ? > > Thanks > Sachin >
