Re: Flink job testing with

2018-04-18 Thread Tzu-Li (Gordon) Tai
Hi, The docs here [1] provide some example snippets of using the Kafka connector to consume from / write to Kafka topics. Once you consumed a `DataStream` from a Kafka topic using the Kafka consumer, you can use Flink transformations such as map, flatMap, etc. to perform processing on the

Flink job testing with

2018-04-17 Thread Chauvet, Thomas
Hi everybody, I would like to test a kafka / flink process in scala. I would like to proceed as in the integration testing documentation : https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/testing.html#integration-testing with Kafka as source and sink. For example, I have