Re: Kafka-to-Kafka Connector ?

2016-05-05 Thread Dean Arnold
Thnx, that looks like a good option. I'm a bit concerned about running/monitoring an additional external app, an in-stream solution (Connector or Streams plugin) would be preferable. But mirroring may be good enough until we eventually upgrade to 0.10. On Thu, May 5, 2016 at 10:57 AM, tao xiao w

Re: Kafka-to-Kafka Connector ?

2016-05-05 Thread tao xiao
You can use the built-in mirror maker to mirror data from one Kafka to the other. http://kafka.apache.org/documentation.html#basic_ops_mirror_maker On Thu, 5 May 2016 at 10:47 Dean Arnold wrote: > I'm developing a Streams plugin for Kafka 0.10, to be run in a dev sandbox, > but pull data from a

Kafka-to-Kafka Connector ?

2016-05-05 Thread Dean Arnold
I'm developing a Streams plugin for Kafka 0.10, to be run in a dev sandbox, but pull data from a production 0.9 Kafka deployment. Is there a source connector that can be used from the 0.10 sandbox to connect to the 0.9 cluster ? Given the number of changes/features in 0.10, such a connector would