There were a few discussions how we can facilitate testing for portable
streaming pipelines with the Flink runner. The problem is that we currently
don't have streaming sources in the Python SDK.

One way to support testing could be a generator that extends the idea of
Impulse to provide a Flink native trigger transform, optionally
parameterized with an interval and max count.

Test pipelines could then follow the generator with a Map function that
creates whatever payloads are desirable.

Thoughts?

Thanks,
Thomas

Reply via email to