Hi Ken,
sorry, I was mislead by the fact that you are using iterations and those
were only documented for the DataSet API.

Running checkpoints with closed sources sounds like a more general thing
than being part of the iterations rework of FLIP-15. I couldn't dig up
anything on jira regarding this improvement either.

@Stephan: is this documented somewhere?


On 02/03/18 23:55, Ken Krugler wrote:
> Hi Stephan,
> Thanks for the update.
> So is support for “running checkpoints with closed sources” part
> of FLIP-15
> <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=66853132>,
> or something separate?
> Regards,
> — Ken
>> On Mar 1, 2018, at 9:07 AM, Stephan Ewen <se...@apache.org
>> <mailto:se...@apache.org>> wrote:
>> @Ken The issue you are running into is that Checkpointing works
>> currently only until the job reaches the point where the pipeline
>> starts to drain out, meaning when the sources are done. In your case,
>> the source is done immediately, sending out only one tuple.
>> Running checkpoints with closed sources is something that's on the
>> feature list and will come soon…
> --------------------------------------------
> http://about.me/kkrugler
> +1 530-210-6378

Attachment: signature.asc
Description: OpenPGP digital signature

Reply via email to