Kafka Transactions with a stretch cluster

2018-02-12 Thread Joe Hammerman
Good evening Apache Kafka users group, I am architecting an Apache Kafka 5 node stretch cluster for 2 datacenters. If we set min.isr to 4 and acks to 4, it would seem that we have a full record of consumer and producer events on at least one node should datacenter 1 get hit by a meteor.

Single node in six node broker pool is under-utilized

2018-07-24 Thread Joe Hammerman
Hi Kafka users email distribution list, We have a six member broker pool. Traffic amongst the nodes is drastically uneven - at the extremes we have one node transmitting and receiving %35 of all traffic in and out of the pool, and another node transmitting only %1 of total traffic. We have

Resetting connect-offsets postion Using Kafka Connect and Debezium

2018-03-02 Thread Joe Hammerman
HiApache Kafka users email distribution list. I'm trying to post to connect-offsets topic a message with a lsn from the past. I dump the connect offsets topic with the following command: ./kafka-console-consumer.sh --bootstrap-server --consumer.config ../config/consumer.properties --property