Re: Hazelcast Jet Runner - validation tests

2019-04-05 Thread Kenneth Knowles
Robert - that appears to be a test of state & timers, not triggers. Should work for testing that the watermark at least advances. We do already have similar java-based ValidatesRunner tests in ParDoTest. The results of triggering, while nondeterministic, should generally fall into a testable

Re: Hazelcast Jet Runner - validation tests

2019-04-05 Thread Robert Bradshaw
On Thu, Apr 4, 2019 at 6:38 PM Lukasz Cwik wrote: > > The issue with unbounded tests that rely on triggers/late data/early > firings/processing time is that these are several sources of non-determinism. > The sources make non-deterministic decisions around when to produce data, > checkpoint,

Re: Hazelcast Jet Runner - validation tests

2019-04-04 Thread Lukasz Cwik
The issue with unbounded tests that rely on triggers/late data/early firings/processing time is that these are several sources of non-determinism. The sources make non-deterministic decisions around when to produce data, checkpoint, and resume and runners make non-deterministic decisions around