Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Aleksandr
Hello Derek, There no general solution for failing bundle. Some kind of dataflow errors you can fix using dataflow update feature. Another solution is to catch exceptions in ParDo function. 25. okt 2017 9:42 PM kirjutas kuupäeval "Griselda Cuevas" : Hi Derek, yes you can use

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Griselda Cuevas
Hi Derek, yes you can use that mailing list and also the SO channel. Cheers, G > BTW, do you know if there's a Dataflow mailing list for questions like > this? Would dataflow-feedback be the appropriate mailing list? > > Thanks, > > Derek > > On Wed, Oct 25, 2017 at 10:58 AM, Griselda Cuevas

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Derek Hao Hu
Aha, I just realized this is just a Dataflow behavior not a Beam default behavior. :) Thanks Griselda. I'll post in the SO channel. BTW, do you know if there's a Dataflow mailing list for questions like this? Would dataflow-feedback be the appropriate mailing list? Thanks, Derek On Wed, Oct

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Griselda Cuevas
Hi Derek - It sounds like this is a Dataflow specific questions so I'd recommend you also reach out through the Dataflow's Stack Overflow channel. I'm also cc'ing Thomas Groh who might be able to help. On 20 October 2017 at

Re: Infinite retry in streaming - is there a workaround?

2017-10-20 Thread Derek Hao Hu
​Kindly ping as I'm really curious about this. :p Derek​ On Thu, Oct 19, 2017 at 2:15 PM, Derek Hao Hu wrote: > Hi, > > ​We are trying to use Dataflow in Prod and right now one of our main > concerns is this "infinite retry" behavior which might stall the whole >