Re: Cross-cluster mirror making

2018-02-12 Thread Andrew Otto
Hi Husna,

The trouble with cross cluster Kafka use is unpredictable network latency.
If a consumer encounters high latency, it will just lag, but (hopefully)
eventually it will catch up.  If a producer encounters high latency, it
will have to buffer messages locally until those messages are ACKed by the
Kafka cluster.  If the buffer gets too full, it will have to start dropping
messages.

- Andrew Otto

On Thu, Feb 8, 2018 at 5:21 PM, Husna Hadi  wrote:

> Hi, I read on The Definitive Guide to Kafka that when using cross-cluster
> kafka mirroring, when possible, consume from a remote datacenter rather
> than produce to a
> remote datacenter. Why is that the case?
>
> -Husna
>
>


Cross-cluster mirror making

2018-02-09 Thread Husna Hadi
Hi, I read on The Definitive Guide to Kafka that when using cross-cluster kafka 
mirroring, when possible, consume from a remote datacenter rather than produce 
to a
remote datacenter. Why is that the case?

-Husna