Re: Question about E2E tests for pipelines

2020-11-26 Thread Artur Khanin
Thank you for the information and links, Alexey! We will try to follow this approach. On 25 Nov 2020, at 21:27, Alexey Romanenko mailto:aromanenko@gmail.com>> wrote: For Kafka testing, there is a Kafka IT [1] that runs on Jenkins [2]. It leverages a real Kafka cluster that runs on k8s.

Re: Proposal: Redis Stream Connector

2020-11-26 Thread Ismaël Mejía
Just want to mention that we have been working with Vincent in the ReadAll implementation for Cassandra based on normal DoFn, and we expect to get it merged for the next release of Beam. Vincent is familiarized now with DoFn based IO composition, a first step towards SDF understanding. Vincent you