Re: How side input will work for streaming application in apache beam.

2019-10-24 Thread jitendra sharma
Thank you. Link is helpful. On Wed, Oct 23, 2019 at 2:56 PM Reza Rokni wrote: > Do you have a event that would initiate the creation of the Side Input? If > not you may want to look at this pattern as a way to trigger the API call > in process time : > > https://beam.apache.org/documentation/pat

Re: How side input will work for streaming application in apache beam.

2019-10-23 Thread Reza Rokni
Do you have a event that would initiate the creation of the Side Input? If not you may want to look at this pattern as a way to trigger the API call in process time : https://beam.apache.org/documentation/patterns/overview/ On Wed, 23 Oct 2019, 00:27 Maximilian Michels, wrote: > Hi Jitendra, >

Re: How side input will work for streaming application in apache beam.

2019-10-22 Thread Maximilian Michels
Hi Jitendra, Side inputs are materialized based on their windowing. If you assign a 10 second window to the side inputs, they can be renewed every 10 seconds. Whenever you access the side input, the newest instance of the side input will be retrieved. Cheers, Max On 22.10.19 10:42, jitendra

How side input will work for streaming application in apache beam.

2019-10-22 Thread jitendra sharma
Hi All, We have written a streaming application that will consume the Kafka event and will call the rest API for some validation information and passed as side input for validation for each event. I am just wondering how many times side input will be called for streaming applications as side inpu