Hey All,
I think there is some serious issue with the checkpoints. Running a simple
program like this won't complete any checkpoints:
StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
env.setParallelism(2);
env.enableCheckpointing(5000);
Hey!
The issue is that checkpoints can only happen in between elements being in
the pipeline. You block the pipeline in the sleep() call.
Since the checkpoint lock is not fair, the few cycles that the source
releases the lock are not enough for the checkpointer to acquire it.
I wonder if this is
Thanks!
I am personally using Thread.sleep() a lot for flow control in my test
topologies, this might only be me, but it seems to be a pretty annoying
thing when you want to test your streaming jobs.
Stephan Ewen ezt írta (időpont: 2015. okt. 21., Sze,
13:59):
> Hey!
>
> The