https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures This FLIP may help.
On Thu, Feb 16, 2017 at 7:34 PM Anton Solovev <anton_solo...@epam.com> wrote: > Hi Aljoscha, > > Could you share your plans of resolving it? > > > > Best, > > Anton > > > > > > *From:* Aljoscha Krettek [mailto:aljos...@apache.org] > *Sent:* Thursday, February 16, 2017 2:48 PM > *To:* user@flink.apache.org > *Subject:* Re: Flink batch processing fault tolerance > > > > Hi, > > yes, this is indeed true. We had some plans for how to resolve this but > they never materialised because of the focus on Stream Processing. We might > unite the two in the future and then you will get fault-tolerant > batch/stream processing in the same API. > > > > Best, > > Aljoscha > > > > On Wed, 15 Feb 2017 at 09:28 Renjie Liu <liurenjie2...@gmail.com> wrote: > > Hi, all: > I'm learning flink's doc and curious about the fault tolerance of batch > process jobs. It seems that when one of task execution fails, the whole job > will be restarted, is it true? If so, isn't it impractical to deploy large > flink batch jobs? > > -- > > Liu, Renjie > > Software Engineer, MVAD > > -- Liu, Renjie Software Engineer, MVAD
