Bharadwaj Bhimavarapu created KAFKA-12438:
---------------------------------------------
Summary: MirrorMaker 2: Not able to make it work for kerberized
clusters ( bothe source and target are kerberized )
Key: KAFKA-12438
URL: https://issues.apache.org/jira/browse/KAFKA-12438
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Reporter: Bharadwaj Bhimavarapu
I was trying to replicate data between kerberized clusters and i se belwo
errors . I was not able to find any documentation around it .
Error :-
[2021-03-08 15:42:19,595] ERROR Stopping due to error
(org.apache.kafka.connect.mirror.MirrorMaker:304)
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and
describe Kafka cluster. Check worker's broker connection and security
properties.
at
org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
at
org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235)
at
org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136)
at java.lang.Iterable.forEach(Iterable.java:75)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136)
at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148)
at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291)
Caused by: java.util.concurrent.ExecutionException:
org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes,
deadlineMs=1615236139583, tries=1, nextAllowedTryMs=1615236139684) timed out at
1615236139584 after 1 attempt(s)
at
org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
at
org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
at
org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
at
org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
at
org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
... 7 more
Caused by: org.apache.kafka.common.errors.TimeoutException:
Call(callName=listNodes, deadlineMs=1615236139583, tries=1,
nextAllowedTryMs=1615236139684) timed out at 1615236139584 after 1 attempt(s)
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting
for a node assignment. Call: listNodes
Properties :-
# Kafka datacenters.
clusters = source, target
source.bootstrap.servers = xxx:9092,xxx:9092
target.bootstrap.servers = yyy:9092,yyy:9092
# Source and target cluster configurations.
source.config.storage.replication.factor = 1
target.config.storage.replication.factor = 1
source.offset.storage.replication.factor = 1
target.offset.storage.replication.factor = 1
source.status.storage.replication.factor = 1
target.status.storage.replication.factor = 1
source->target.enabled = true
target->source.enabled = false
# Mirror maker configurations.
offset-syncs.topic.replication.factor = 1
heartbeats.topic.replication.factor = 1
checkpoints.topic.replication.factor = 1
topics = .*
groups = .*
tasks.max = 1
replication.factor = 1
refresh.topics.enabled = false
sync.topic.configs.enabled = true
refresh.topics.interval.seconds = 30
topics.blacklist = .*[\-\.]internal, .*\.replica, __consumer_offsets
groups.blacklist = console-consumer-.*, connect-.*, __.*
# Enable heartbeats and checkpoints.
source->target.emit.heartbeats.enabled = true
source->target.emit.checkpoints.enabled = true
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
