Re: Urban Airship Connect

Hi, Great info. What is your approximate/average message size ? And, how many topics and partitions do you use in your 4-node cluster. Also, please share your hardware specs Thanks, Prabhjot On Sat, Oct 10, 2015 at 2:00 AM, Cory Kolbeck wrote: > The first level Kafkas are

Re: Urban Airship Connect

Hi, Nice to know another usage of Kafka Could you tell how much load does the first and second level Kafka clusters intake? What is your write throughput, and end-to-end latency, for how long do you hold data in Kafka and how many minimum in-sync replicas you've chosen? Thanks, Prabhjot On Oct

Re: Urban Airship Connect

The first level Kafkas are actually two separate clusters, and do about avg 50k messages/s, max 120k messages/s on 4 node clusters. The second level cluster doesn't handle all that load, as we filter down to the subset of our customers using the service. We currently use a retention window of 7