Re: Execution of action: JobModelVersionChange failed.

2020-03-24 Thread Bharath Kumara Subramanian
Hi Omkar, So what does stopping a samza container mean in context of a Beam Pipeline? A container shutting down during a rebalance shouldn't affect the beam application unless the shutdown was unsuccessful. > Does pres.waitUntilFinish() return when samza container is being stopped ? >

Re: Execution of action: JobModelVersionChange failed.

2020-03-23 Thread Deshpande, Omkar
Hey Bharath, I probably know what is taking long in my shutdown sequence. My code roughly looks like this - https://gist.github.com/omkardeshpande8/dc4259a8aa7a726a4fe787d9ece8f44a I think Thread.sleep(3) in this code is increasing the time taken for the shutdown sequence. Is that

Re: Execution of action: JobModelVersionChange failed.

2020-03-22 Thread Bharath Kumara Subramanian
Hi Omkar, The errors are related to timeouts during shutdown which gets triggered during a rebalance. Whenever a new processor joins the quorum or leaves the quorum, a rebalance is triggered which requires all the existing processors to shutdown its container before agreeing on the new job model.