Hi guys,
I was wondering if someone here has an experience with streaming kafka
across data-centers?
How does kafka transfer the msgs? event by event or it batches some
events in one file(how many together?) and send them to the consumer on
the other data-center?
I am asking it, because we want to have a hadoop active-active clusters
(on two data-centers) and we might use the kafka as the sync stream from
which both centers will consume events,
Has anyone did something like that?
Thanks,
Guy Doulberg
Data Infra team leader @ Conduit