Hi All,
I'm trying to transfer data between kafka clusters using Kafka MirrorMaker
& running into issues.
I've created a consumer.config & producer.config files & using the command
shown below.
The error indicates - equirement failed: Missing required property
'zookeeper.connect'
------------------------------
$KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker
--consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2
--producer.config $KAFKA10_HOME/config/mmProducer.config
--whitelist="mmtopic"
[2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker.
(kafka.tools.MirrorMaker$)
java.lang.IllegalArgumentException: requirement failed: Missing required
property 'zookeeper.connect'
at scala.Predef$.require(Predef.scala:224)
at
kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177)
at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902)
at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101)
at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105)
at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306)
at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304)
at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233)
at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
Exception in thread "main" java.lang.NullPointerException
at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286)
at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
I tried adding the option (-zookeeper.connect = localhost:21810), it gives
error -> zookeeper.connect is not a recognized option
-----------------------------
[2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker.
(kafka.tools.MirrorMaker$)
joptsimple.UnrecognizedOptionException: zookeeper.connect is not a
recognized option
at
joptsimple.OptionException.unrecognizedOption(OptionException.java:108)
at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:449)
at
joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56)
at joptsimple.OptionParser.parse(OptionParser.java:381)
at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167)
at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
Exception in thread "main" java.lang.NullPointerException
at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286)
at kafka.tools.MirrorMaker.main(MirrorMaker.scala)
Any ideas on what needs to be done ?
