Hello, I am trying to setup mirroring between two kafka servers using MirrorMaker. The messages are successfully mirrored between the servers on all topics. I can list all topics on both the master and the slave (kafka-topics.sh --list).
The problem that I am facing now is that when I try to retrieve the offsets (kafka.tools.ConsumerOffsetChecker) for the topics from both the master and the slave for the default consumer group (test-consumer-group) (which I have never changed), I am able to retrieve all the topics from the master but none from the slave. Also, I don't see any topic that was mirrored when I run kafka.tools.ExportZkOffsets on the slave whereas I see all of them on the master. Note that I did not explicitly create these topics on both the master and the slave as I wanted this auto.create.topic functionality. I just used the producer to inject some messages. Also, I had to use the auto.offset.reset to be smallest since I did not want to lose any message if the mirrorMaker was not started from the beginning. Could anyone please help me understand the following. 1. As to why I don't see those mirrored topic offsets? 2. What consumer group are the mirrored topics created with and how can I access their offsets? 3. Is there any other way I can display all the consumer groups present? Thanks in advance for any help! -Manoj
