Re: Kafka rebalancing - assignement of Kafka consumers to partitions

Hi, If you are using the official Java clients: (1) Partition assignments are performed on the client side. You could check the interface named ConsumerPartitionAssignor or PartitionAssignor ( deprecated in 2.4 ) for customized partition assignments. (2) You could implement the ConsumerPartitionA

Re: is there a way to do foldLeft with KafkaStreams?

Isn't `fold` an aggregation? Thus, you can use `KStream#groupByKey().aggregate(...)` ? -Matthias On 10/12/20 9:45 AM, Dumitru-Nicolae Marasoui wrote: > The join operation is tempting as a way to obtain the "current fold > state" to which each message is folded into. I mean joining the source >

Re: is there a way to do foldLeft with KafkaStreams?

The join operation is tempting as a way to obtain the "current fold state" to which each message is folded into. I mean joining the source topic with folded topic as a way to have in the same function call both the current message to fold and the current state of the fold.But then each new "curren

is there a way to do foldLeft with KafkaStreams?

Hello kafka community, When I need to compute something that in regular programming in Scala or Haskell would be a fold, how can it be done in Kafka-Streams? The join operation is tempting as a way to obtain the "current fold state" to which each message is folded into. But then the results need

Kafka rebalancing - assignement of Kafka consumers to partitions

When a new Kafka consumer joins/leaves a consumer group, Kafka runtime triggers a rebalancing process so that a new assignment/mapping of partitions to the new set of consumers is performed. I kindly have three questions on the rebalancing process: (1) Is it possible to plug in somehow a custom

Re: Reverse-Proxy and Kafka

On Thu, Oct 8, 2020 at 11:48 PM Mario Lafleur wrote: > Hi, we want to route Kafka producer connection thru a reverse-proxy. > Is this possible? > > Hi Mario, There is support for the Kafka protocol in Envoy Proxy that you can try: https://www.envoyproxy.io/docs/envoy/latest/configuration/listene

Re: Intended behavior when a broker loses its log volume

Hi Peter, When an unexpected IOException happens when accessing a file in a log directory, the broker will take that log directory offline. That means follower fetchers for partitions on that log dir will be stopped, the broker will stop serving requests from those logs and a notification is sent