Julien C created KAFKA-10710:
--------------------------------
Summary: MirrorMaker 2 creates all combinations of herders
Key: KAFKA-10710
URL: https://issues.apache.org/jira/browse/KAFKA-10710
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Affects Versions: 2.5.1
Reporter: Julien C
We are using MM2 distributed to synchronize topics from a "Central" broker down
to multiple "Local" brokers.
{quote}
# enable and configure individual replication flows
replica_CENTRAL->replica_OLS.enabled = true
replica_CENTRAL->replica_OLS.topics = _schemas
replica_CENTRAL->replica_OLS.replication.factor = 3
replica_CENTRAL->replica_HBG.enabled = true
replica_CENTRAL->replica_HBG.topics = _schemas
replica_CENTRAL->replica_HBG.replication.factor = 3
# ...
# many more
# ...
replica_CENTRAL->replica_VIT.enabled = true
replica_CENTRAL->replica_VIT.topics = _schemas
replica_CENTRAL->replica_VIT.replication.factor = 3
replica_CENTRAL->replica_UGO.enabled = true
replica_CENTRAL->replica_UGO.topics = _schemas
replica_CENTRAL->replica_UGO.replication.factor = 3
{quote}
# enable and configure individual replication flows
When looking into the Mirror Maker logs, we discover that a herder is created
for each combination even if we specifically don't describe a link
Exemples:
[2020-11-12 08:43:30,351] INFO creating herder for replica_VIT->replica_UGO
(org.apache.kafka.connect.mirror.MirrorMaker)
[2020-11-12 08:43:33,697] INFO creating herder for replica_CNO->replica_UGO
(org.apache.kafka.connect.mirror.MirrorMaker)
[2020-11-12 08:43:38,508] INFO creating herder for replica_UMO->replica_UGO
(org.apache.kafka.connect.mirror.MirrorMaker)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
