Re: Official Kafka Disaster Recovery is insufficient - Suggestions needed

2018-09-07 Thread Manjunath N
Henning, > It is my understanding that you produce messages to Kafka partitions using > the normal producer API and then subsequently ETL them to some cold storage > using one or more consumers, i.e. the cold storage is eventually consistent > with Kafka!? In some of the deployments i have

Re: Requesting for JIRA permission as contributor/committer

2018-08-10 Thread Manjunath N
Hi Guozhang, Could please add manj...@gmail.com too. So that i can take up some open issues to contribute. Thanks Manjunath > On Aug 10, 2018, at 9:13 PM, Guozhang Wang wrote: > > It's done. > > Cheers, > Guozhang > > On Fri, Aug 10, 2018 at 6:34 AM, M. Manna

Re: Zookeeper logging “exception causing close of session 0x0” infinitely in logs

2018-08-06 Thread Manjunath N
Check this thread. Not sure if it is the same case. you could also enable trace and see if you can find more information. http://zookeeper-user.578899.n2.nabble.com/chatty-error-Exception-causing-close-of-session-0x0-due-to-java-io-IOException-Len-error-1835955314-td7198695.html

Re: Apache Kafka Process showing high CPU (100 to 200+) usage in Linux when Idle

2018-08-05 Thread Manjunath N
After you deleted a topic was it a clean delete. Did you verify in zookeeper and kafka logs directory? if not you may need to do some clean up if there are inconsistency in kafka logs dir and zookeeper. did you try to move the replicas assignment to different machines for this topic and see if

Re: A Question about stopping brokers

2018-08-03 Thread Manjunath N
Hi Kyle, When below command is executed to get the pid of the kafka process the CMD column output text is incomplete. It does not show process name kafka.kafka. Hence, the returned PID is blank and it displays “No kafka server to stop”. I faced this issue in version 1.0.0 but no tin 2.0.0.

Replica not coming up for a partition after restarting broker | Error NOT_LEADER_FOR_PARTITION

2018-08-01 Thread Manjunath N
Hi, Problem: A replica for a partition is not coming up. Steps below; I have a zookeeper cluster with three machines and a kafka cluster with 3 brokers on the same machine. I created a topic test as below. Operation: kafka-topics.sh --zookeeper rh3:2181/kafka --create --topic test