Re: a typical ML algorithm flow

2016-03-27 Thread Chiwan Park
Hi Dmitriy, I think you can implement it with iterative API with custom convergence criterion. You can express the convergence criterion by two methods. One is using a convergence criterion data set [1][2] and the other is registering an aggregator with custom implementation of

Re: watermark in fault tolerance

2016-03-27 Thread Aljoscha Krettek
Hi, the current watermark position is not persisted. The sources will start emitting based on the elements that they are seeing. So if the source is reset to some previous reading position (say with Kafka). Then it will emit the watermarks based on those earlier elements again. Cheers, Aljoscha

[jira] [Created] (FLINK-3669) WindowOperator registers a log of timers at StreamTask

2016-03-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3669: --- Summary: WindowOperator registers a log of timers at StreamTask Key: FLINK-3669 URL: https://issues.apache.org/jira/browse/FLINK-3669 Project: Flink