maybe this will help. https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html
-M On Thu, Jun 8, 2017 at 11:42 AM, karan alang <karan.al...@gmail.com> wrote: > Hi All, > > I'm trying to transfer data between kafka clusters using Kafka MirrorMaker > & running into issues. > > I've created a consumer.config & producer.config files & using the command > shown below. > The error indicates - equirement failed: Missing required property > 'zookeeper.connect' > > ------------------------------ > $KAFKA10_HOME/bin/kafka-run-class.sh kafka.tools.MirrorMaker > --consumer.config $KAFKA10_HOME/config/mmConsumer.config --num.streams 2 > --producer.config $KAFKA10_HOME/config/mmProducer.config > --whitelist="mmtopic" > [2017-06-08 11:32:55,962] ERROR Exception when starting mirror maker. > (kafka.tools.MirrorMaker$) > java.lang.IllegalArgumentException: requirement failed: Missing required > property 'zookeeper.connect' > at scala.Predef$.require(Predef.scala:224) > at > kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177) > at kafka.utils.ZKConfig.<init>(ZkUtils.scala:902) > at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:101) > at kafka.consumer.ConsumerConfig.<init>(ConsumerConfig.scala:105) > at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:306) > at kafka.tools.MirrorMaker$$anonfun$3.apply(MirrorMaker.scala:304) > at > scala.collection.TraversableLike$$anonfun$map$ > 1.apply(TraversableLike.scala:234) > at > scala.collection.TraversableLike$$anonfun$map$ > 1.apply(TraversableLike.scala:234) > at scala.collection.immutable.Range.foreach(Range.scala:160) > at scala.collection.TraversableLike$class.map( > TraversableLike.scala:234) > at scala.collection.AbstractTraversable.map(Traversable.scala:104) > at kafka.tools.MirrorMaker$.createOldConsumers(MirrorMaker.scala:304) > at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:233) > at kafka.tools.MirrorMaker.main(MirrorMaker.scala) > Exception in thread "main" java.lang.NullPointerException > at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) > at kafka.tools.MirrorMaker.main(MirrorMaker.scala) > > > I tried adding the option (-zookeeper.connect = localhost:21810), it gives > error -> zookeeper.connect is not a recognized option > > ----------------------------- > > [2017-06-08 11:40:11,033] ERROR Exception when starting mirror maker. > (kafka.tools.MirrorMaker$) > joptsimple.UnrecognizedOptionException: zookeeper.connect is not a > recognized option > at > joptsimple.OptionException.unrecognizedOption(OptionException.java:108) > at joptsimple.OptionParser.handleLongOptionToken( > OptionParser.java:449) > at > joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) > at joptsimple.OptionParser.parse(OptionParser.java:381) > at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:167) > at kafka.tools.MirrorMaker.main(MirrorMaker.scala) > Exception in thread "main" java.lang.NullPointerException > at kafka.tools.MirrorMaker$.main(MirrorMaker.scala:286) > at kafka.tools.MirrorMaker.main(MirrorMaker.scala) > > > Any ideas on what needs to be done ? > -- Legal Disclaimer: The information contained in this message may be privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and delete or destroy any copy of this message
