Brokers restart when ZK address changes

2017-07-19 Thread Andrey Dyachkov
Good day, We are using AWS and it is quite common for us to terminate instances very often, which introduces ip address change and requires to restart brokers one by one. Maybe there is a knowledge on how to avoid such restarts? According to Confluent recommendations(on their web page), one should

KAFKA-5723: Refactor BrokerApiVersionsCommand to use the new AdminClient

2017-08-17 Thread Andrey Dyachkov
Good day, I am quite new here, my apologies for being kind of pushy. We had discussion here https://issues.apache.org/jira/browse/KAFKA-5723, that having separate branch for implementing the whole change https://issues.apache.org/jira/browse/KAFKA-3268 would simplify dev process. Could some of comm

Kafka high cpu usage

2016-11-16 Thread Andrey Dyachkov
Hi, Our production env uses Kafka 0.9.0.1 cluster of 12 m3.large nodes. Partitions count per broker is ~450, percent of leaders per broker is 30-40%. The average messages load is ~3K/s, bytes flow in is ~10MB/s and bytes flow out is ~60 MB/s. We observed strange behaviour while putting one instan

Kafka client circuit breaker

2016-10-28 Thread Andrey Dyachkov
Hi Kafka developers :) We use Kafka for around half a year as a main backend system for storing events from big variety of internal microservices. In general It works quite well and we experience issues only in some rare 'corner cases' where we either run against a bug or do not understand why Kaf

Re: Kafka client circuit breaker

2016-10-31 Thread Andrey Dyachkov
ittle on what kind of problems are you referring to? And what do you mean by "circuit breaker" here? Jiangjie (Becket) Qin On Fri, Oct 28, 2016 at 12:07 PM, Andrey Dyachkov wrote: > Hi Kafka developers :) > > We use Kafka for around half a year as a main backend system

Re: Kafka client circuit breaker

2016-10-31 Thread Andrey Dyachkov
such that if the kafka > client call gets stuck your software doesn't get stuck > - you're wondering why the kafka client is not more resilient to the broker > being unavailable/down > > Is this correct? > > Nacho > > On Mon, Oct 31, 2016 at 1:54 PM, Andrey Dyac

[jira] [Commented] (KAFKA-4657) Improve test coverage of CompositeReadOnlyWindowStore

2017-03-05 Thread Andrey Dyachkov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896576#comment-15896576 ] Andrey Dyachkov commented on KAFKA-4657: I would like to grab, but it is

[jira] [Commented] (KAFKA-4643) Improve test coverage of StreamsKafkaClient

2017-03-13 Thread Andrey Dyachkov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922945#comment-15922945 ] Andrey Dyachkov commented on KAFKA-4643: I would like to grab this one, c

[jira] [Commented] (KAFKA-4643) Improve test coverage of StreamsKafkaClient

2017-03-15 Thread Andrey Dyachkov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926189#comment-15926189 ] Andrey Dyachkov commented on KAFKA-4643: [~damianguy] exceptions paths are

[jira] [Created] (KAFKA-4258) Page not found http://kafka.apache.org/streams.html

2016-10-06 Thread Andrey Dyachkov (JIRA)
Andrey Dyachkov created KAFKA-4258: -- Summary: Page not found http://kafka.apache.org/streams.html Key: KAFKA-4258 URL: https://issues.apache.org/jira/browse/KAFKA-4258 Project: Kafka Issue