Setting kafka headers in ProducerRecord

Hi All, I need to use Kafka header in the ProducerRecord, however I see the constructor to provide headers also need to mention the partition number. I don't want the records to be distributed to available partitions based on kafka's default mechanism and don't want to specify the partition by

Re: Setting kafka headers in ProducerRecord

> I >> don't want the records to be distributed to available partitions based on >> kafka's default mechanism and don't want to specify the partition by >> myself This seems to be a contradiction. If you don't want either of them, what do you want? Btw: it is ok to pass `null` as partition; for

Re: Broker side partition round robin

Hey guys, I need some help here... Is this a flaw in the design (maybe a discussion point for a KIP?), is Kafka not supposed to perform equal load balancing with multiple producers or am I missing something (which is what I believe is happening)? On Wed, May 27, 2020 at 2:40 PM Vinicius

Re: Single Task running both worker node

Hi Team Just a Gentle Reminder. Regards and Thanks Deepak Raghav On Fri, May 29, 2020 at 1:15 PM Deepak Raghav wrote: > Hi Team > > Recently, I had seen strange behavior in kafka-connect. We have source > connector with single task only, which reads from S3 bucket and copy to > kafka

Re: Broker side partition round robin

Hi Vinicius, As you note, the cluster doesn't load balance producers, it relies on them using a partition strategy to do so. In production, I've never had actual broker load skew develop from multiple independent producers using round robining - and we're talking say 20 - 50 producers (depending

Using encrypted distributed worker file

Hi All, I am running a distributed worker that connects to a Kafka infrastructure over TLS and Scram authentication. In addition to this, the RESTAPI interface is also secured with userid/password authentication. Hence my config has a a lot of passwords (keystore,trust store , jaas config etc)

How to get the resolved network of kafka inside docker?

I have a spring application, which should connect to the kafka. This is what my Docker file looks for spring application: ``` FROM maven:3-jdk-11 as builder # create app folder for sources RUN mkdir -p /build WORKDIR /build COPY pom.xml /build #Download all required dependencies into one layer

Support of Kafka version 2.5 with SLES 12 SP3

Hello, We are planning to install apache kafka latest stable version 2.5.0 on our OS SLES 12 SP3 version. Is this supported ? Thanks, Chethan