David Bros created KAFKA-13795:
----------------------------------
Summary: MM2 Default topics.exclude does not work
Key: KAFKA-13795
URL: https://issues.apache.org/jira/browse/KAFKA-13795
Project: Kafka
Issue Type: Bug
Reporter: David Bros
Hi all,
We are testing Kafka 3.0.0 in a development environment with Java 17 in a
Centos 7 machine.
When setting up MM2 replication between two different clusters we get copies of
.internal among other excluded topics.
As I understand the default excluded topics should be .*.internal, .*.replica
and __consumer_offsets, but we still get internal topics replicated.
Here is our config for the us_central cluster:
```
# Clusters and bootstrap servers
clusters=eu_west, us_central
eu_west.bootstrap.servers=bus1log-lab1.hon-nl.net:9092,bus2log-lab1.hon-nl.net:9092
us_central.bootstrap.servers=bus3log-lab1.hon-nl.net:9092
us_central.consumer.auto.offset.reset=latest
us_central.consumer.fetch.max.bytes=31457280
us_central.consumer.fetch.max.wait.ms=10000
us_central.consumer.max.poll.records=3000
us_central.consumer.request.timeout.ms=60000
eu_west.consumer.auto.offset.reset=latest
eu_west.consumer.fetch.max.bytes=52428800
eu_west.consumer.fetch.max.wait.ms=10000
eu_west.consumer.max.poll.records=3000
eu_west.consumer.request.timeout.ms=60000
# Custom producer settings
us_central.producer.max.request.size=27262976
us_central.producer.batch.size=22000
us_central.producer.compression.type=none
us_central.producer.send.buffer.bytes=26214400
us_central.producer.receive.buffer.bytes=26214400
eu_west.producer.max.request.size=27262976
eu_west.producer.batch.size=22000
eu_west.producer.compression.type=none
eu_west.producer.send.buffer.bytes=26214400
eu_west.producer.receive.buffer.bytes=26214400
# Topics configuration
topics=.*
#topics.blacklist=".*\.internal, .*\.replica, __consumer_offsets"
# Tasks (threads)
tasks.max=10
# Groups
groups=phx_netflow
# Replication factors, these are 1 for lab
replication.factor=1
config.storage.replication.factor=1
offset.storage.replication.factor=1
status.storage.replication.factor=1
checkpoints.topic.replication.factor=1
offset-syncs.topic.replication.factor=1
sync.group.offsets.replication.factor=1
## Config
config.properties.exclude=local.retention.ms
# Refresh rates
us_central.refresh.topics.interval.seconds=15
us_central.refresh.groups.interval.seconds=15
eu_west.refresh.topics.interval.seconds=15
eu_west.refresh.groups.interval.seconds=15
# Sync options
sync.topic.acls.enabled=False
offset-syncs.topic.replication.enabled=True
sync.group.offsets.enabled=True
# EU pulls us, syd, nyc
us_central->eu_west.enabled=true
us_central->eu_west.sync.group.offsets.enabled=false
# US pulls eu, syd, nyc
eu_west->us_central.enabled=true
eu_west->us_central.sync.group.offsets.enabled=true
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
