ZK stores critical data such as topics/partitions on each broker, in addition to consumer offsets. So ZK data needs to be protected.
Thanks, Jun On Mon, May 7, 2012 at 4:21 AM, navneet sharma <navneetsharma0...@gmail.com>wrote: > Hi, > > I observed that if zookeeper folder is deleted, consumer is trying to read > the messages it read in previous runs. And there are lots of exceptions > seen on zookeeper console as well:: > > java.nio.channels.CancelledKeyException > at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) > at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59) > at > > org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:418) > at > > org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1509) > at > > org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:171) > at > > org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:135) > [2012-05-07 15:57:35,569] ERROR Unexpected Exception: > (org.apache.zookeeper.server.NIOServerCnxn) > > > Is it an expected behaviour? Is zookeeper directory need to be protected to > avoid consumer falling off on offsets? > > Thanks, > Navneet Sharma >
