Re: Self-checkpoint Support on Portable Flink

2020-10-23 Thread Boyuan Zhang
gt; > > all Runners to be > > > able to support delaying bundles. Flink supports > > cycles > > > and thus > > > approach #2 would also be applicable and could be > > us

Re: Self-checkpoint Support on Portable Flink

2020-10-14 Thread Maximilian Michels
:boyu...@google.com> <mailto:boyu...@google.com <mailto:boyu...@google.com>> >                  > <mailto:boyu...@google.com <mailto:boyu...@google.com> >                 <mailto:boyu...@google.com <mailto:boyu...@google.com>>>&

Re: Self-checkpoint Support on Portable Flink

2020-10-13 Thread Reuven Lax
> > > Thanks Boyuan, I left a few comments. > > > > > > On Mon, Oct 5, 2020 at 11:12 AM Boyuan Zhang > > mailto:boyu...@google.com> > > > <mailto:boyu...@

Re: Self-checkpoint Support on Portable Flink

2020-10-13 Thread Maximilian Michels
oogle.com <mailto:boyu...@google.com>>> wrote: > >     Hi team, > >     I'm looking at adding self-checkpoint support to portable Flink >     runner(BEAM-10940 >     <ht

Re: Self-checkpoint Support on Portable Flink

2020-10-06 Thread Reuven Lax
t; > >>> > On Mon, Oct 5, 2020 at 11:12 AM Boyuan Zhang >> > <mailto:boyu...@google.com>> wrote: >>> > >>> > Hi team, >>> > >>> > I'm looking at adding self-checkpoint support to portable Flink >>> >

Re: Self-checkpoint Support on Portable Flink

2020-10-06 Thread Boyuan Zhang
applicable and could be used to implement >> dynamic splitting. >> >> -Max >> >> On 05.10.20 23:13, Luke Cwik wrote: >> > Thanks Boyuan, I left a few comments. >> > >> > On Mon, Oct 5, 2020 at 11:12 AM Boyuan Zhang > > <mailto:bo

Re: Self-checkpoint Support on Portable Flink

2020-10-06 Thread Maximilian Michels
. -Max On 05.10.20 23:13, Luke Cwik wrote: Thanks Boyuan, I left a few comments. On Mon, Oct 5, 2020 at 11:12 AM Boyuan Zhang <mailto:boyu...@google.com>> wrote: Hi team, I'm looking at adding self-checkpoint support to portable Flink runner(BEAM-10940

Re: Self-checkpoint Support on Portable Flink

2020-10-05 Thread Luke Cwik
Thanks Boyuan, I left a few comments. On Mon, Oct 5, 2020 at 11:12 AM Boyuan Zhang wrote: > Hi team, > > I'm looking at adding self-checkpoint support to portable Flink runner( > BEAM-10940 <https://issues.apache.org/jira/browse/BEAM-10940>) for both > batch and st