Hello,

I couldn't find an answer in the documentation to the following. If a new
machine joins a consumer group and Kafka triggers a rebalance, will it
randomly reassign partitions or will it hand over partitions from existing
consumers to the newly joined one? In other words, will it attempt to move
as few partitions as possible between consumers?

The main implications of this is local in-memory caches and scaling up the
number of machines in a consumer group, since the scaling up operation will
require nuking any local caches for the partitions that were moved. This
would cause a spike on any DBs that are being cached on the consumers.

Best,
Edvard

Reply via email to