Re: Which node do you send data to?

2015-03-06 Thread Ewen Cheslack-Postava
Spencer, Kafka (and it's clients) handle failover automatically for you. When you create a topic, you can select a replication factor. For a replication factor n, each partition of the topic will be replicated to n different brokers. At any given time, one of those brokers is considered the

Re: Which node do you send data to?

2015-03-06 Thread Daniel Moreno
Hi Spencer, You can configure your producers with a list of brokers. You can add all, but usually at least two of the brokers in your cluster. Kind Regards, Daniel Moreno On Mar 6, 2015, at 23:43, Spencer Owen so...@netdocuments.commailto:so...@netdocuments.com wrote: I've setup a kafka

Which node do you send data to?

2015-03-06 Thread Spencer Owen
I've setup a kafka cluster with 3 nodes. Which node should I push the data to? I would normally push to kafka01, but if that node goes down, then the entire cluster goes down. How have other people solved this. Maybe a nginx reverse proxy?