[
https://issues.apache.org/jira/browse/KAFKA-12438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430989#comment-17430989
]
felixzh commented on KAFKA-12438:
---------------------------------
first, you need to learn kafka documention about
Security([https://kafka.apache.org/documentation/#security)]
after a consumer or producer works ok with one kerberized cluster, the two
clusters need to be configured with mutual trust
> MirrorMaker 2: Not able to make it work for kerberized clusters ( bothe
> source and target are kerberized )
> -----------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-12438
> URL: https://issues.apache.org/jira/browse/KAFKA-12438
> Project: Kafka
> Issue Type: Wish
> Components: mirrormaker
> Reporter: Bharadwaj Bhimavarapu
> Priority: Minor
>
> I was trying to replicate data between kerberized clusters and i se belwo
> errors . I was not able to find any documentation around it .
>
> Error :-
>
> [2021-03-08 15:42:19,595] ERROR Stopping due to error
> (org.apache.kafka.connect.mirror.MirrorMaker:304)
> org.apache.kafka.connect.errors.ConnectException: Failed to connect to and
> describe Kafka cluster. Check worker's broker connection and security
> properties.
> at
> org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
> at
> org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
> at
> org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235)
> at
> org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136)
> at java.lang.Iterable.forEach(Iterable.java:75)
> at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136)
> at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148)
> at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291)
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes,
> deadlineMs=1615236139583, tries=1, nextAllowedTryMs=1615236139684) timed out
> at 1615236139584 after 1 attempt(s)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
> at
> org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
> ... 7 more
> Caused by: org.apache.kafka.common.errors.TimeoutException:
> Call(callName=listNodes, deadlineMs=1615236139583, tries=1,
> nextAllowedTryMs=1615236139684) timed out at 1615236139584 after 1 attempt(s)
> Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting
> for a node assignment. Call: listNodes
>
>
> Properties :-
> # Kafka datacenters.
> clusters = source, target
> source.bootstrap.servers = xxx:9092,xxx:9092
> target.bootstrap.servers = yyy:9092,yyy:9092
> # Source and target cluster configurations.
> source.config.storage.replication.factor = 1
> target.config.storage.replication.factor = 1
> source.offset.storage.replication.factor = 1
> target.offset.storage.replication.factor = 1
> source.status.storage.replication.factor = 1
> target.status.storage.replication.factor = 1
> source->target.enabled = true
> target->source.enabled = false
> # Mirror maker configurations.
> offset-syncs.topic.replication.factor = 1
> heartbeats.topic.replication.factor = 1
> checkpoints.topic.replication.factor = 1
> topics = .*
> groups = .*
> tasks.max = 1
> replication.factor = 1
> refresh.topics.enabled = false
> sync.topic.configs.enabled = true
> refresh.topics.interval.seconds = 30
> topics.blacklist = .*[\-\.]internal, .*\.replica, __consumer_offsets
> groups.blacklist = console-consumer-.*, connect-.*, __.*
> # Enable heartbeats and checkpoints.
> source->target.emit.heartbeats.enabled = true
> source->target.emit.checkpoints.enabled = true
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
