just to be sure, you're using the zkCli tool and then connecting to your zookeeper server by issueing:
connect zkHost:port followed by: ls /brokers On Fri, Nov 6, 2015 at 5:40 PM, Birendra Kumar Singh <[email protected]> wrote: > Thats what my problem is. I am not able to find any such file/directory > "/brokers" (brokers is my zkRoot) > I am using the zookeeper provided by kafka and have not changed any value in > its config. > per kafka doc = /brokers is their default broker. But I dont see such file > or directory anywhere in /var or /tmp or any of the log folder of kafka. > > On Fri, Nov 6, 2015 at 3:04 PM, Stephen Powis <[email protected]> wrote: >> >> Can you login to zookeeper and look under /zkRoot and see the >> consumerGroupId node there? Does it have actual offsets set? >> >> I also assume you don't have any other settings being set on >> spoutConfig like :spoutConfig.maxOffsetBehind ? >> >> >> On Fri, Nov 6, 2015 at 5:29 PM, Birendra Kumar Singh <[email protected]> >> wrote: >> > I am running my topology on a cluster. I have my 2 GCE VMs running. On >> > one >> > of the VMs I am running the zookeeper and nimbus. On another I am >> > running >> > the supervisor. >> > all the values in SpoutConfig contructor are the same in subsequent >> > restarts >> > >> > spoutConfig = new SpoutConfig(hosts, topic, zkRoot, consumerGroupId); >> > --- >> > all values remain the same >> > >> > >> > On Fri, Nov 6, 2015 at 2:50 PM, Stephen Powis <[email protected]> >> > wrote: >> >> >> >> Are you running your topology in local mode or on a cluster? What are >> >> you using as your consumer id in the spout? >> >> >> >> IE when you're building your spout config like here: >> >> >> >> SpoutConfig spoutConfig = new SpoutConfig(zkHosts, topic, zkRoot, >> >> zkSpoutId); >> >> >> >> What are you using for zkSpoutId? Is it the same value every time you >> >> submit the topology? >> >> >> >> >> >> On Fri, Nov 6, 2015 at 4:38 PM, Birendra Kumar Singh >> >> <[email protected]> >> >> wrote: >> >> > Hi >> >> > >> >> > I am using Kafka with Storm as described here - >> >> > https://github.com/apache/storm/tree/master/external/storm-kafka >> >> > However, If I kill my topology and start it again, it restarts the >> >> > KafkaSpout from offset 0. Ideally, it should restart from where it >> >> > left >> >> > off. >> >> > My nimbus and supervisors are up and running all the time. >> >> > >> >> > I am using the default zookeeper provided by kafka. >> >> > >> >> > storm version - 0.95 >> >> > kafka - 2.9.1 >> > >> > > >
