Can leader be removed from ISR if leader is unstable

Hi team, I use Kafka 0.10.0.0 and recently encountered an issue where the hard disk mounted in one of the nodes experienced performance degradation that caused the node being unstable. But controller didn't remove the node from ISR of partitions for which the node is a leader. I wonder if anyway

Re: Streams: Why is ForwardingCacheFlushListener internal? Can I replicate its functionality in my code?

Thank you Guozhang. > related to your consistency requirement of the store? Do you mean flushing the cache to persist into the store or flushing the store Yes, motivated by consistency, I want to forward the state downstream only after LRU cache is persisted into the store on disk, and the

Re: Recommended max number of topics (and data separation)

After brief search, I found KAFKA-6469 FYI Original message From: Andrey Falko Date: 2/1/18 5:28 PM (GMT-08:00) To: users@kafka.apache.org Subject: Re: Recommended max number of topics (and data separation) Indeed David, I confirmed that I can't push

Re: Recommended max number of topics (and data separation)

Indeed David, I confirmed that I can't push my clusters to more than 72k topics with default zookeeper settings. Once I get to that quantity, leader election never happens for new topics. Additionally if I kill one of the brokers, all the topics don't get leaders re-elected and it is impossible to

Re: Kafka Consumers not rebalancing.

Any help would be appreciated! Hi All, I was experimenting on the new consumer API and have a question regarding the rebalance process. I start a consumer group with single thread and make the Thread sleep while processing the records retrieved from the first consumer.poll call, i was making

Re: Streams: Why is ForwardingCacheFlushListener internal? Can I replicate its functionality in my code?

Hello Dmitry, Forwarding to downstream upon state store flushing is an internal implementation detail that is used by the DSL operators only, and hence we define related classes internals to abstract them away from the users. For your case, one thing I need to clarify is for "flushing the

Load connect jars without restarting connector

Hi, How can I load new connector jars without restarting connect? Thanks, Farhan Haider. www.technify.pk

KAFKA step by step installation help

Hi, We are interested in using KAFKA for our application and are trying to start it on out Windows system. It would be great if you could help us with a more easier step by step guide to setup the environment on Windows. Thanks & Regards, Naveen Consultant | Host End trad...@neml.in [image:

Failed to send SSL Close messages unexpected status returned by SSLEngine.wrap, expected Close received Ok

Hello all: I encountered an issue. Have filed a issue: https://issues.apache.org/jira/browse/KAFKA-6510 Anybody have encountered that before? Thanks.

Re: Fixing Wrecked Kafka Topic Partitions after a cluster reconfigure

Hi Michal Many thanks for the detailed advice. I've tested this on a dev cluster and indeed the data is recoverable by reverting. On Thu, Feb 1, 2018 at 10:11 PM, Michal Michalski < michal.michal...@zalando.ie> wrote: > Hey, > > Changing broker IDs made existing data in ZK irrelevant - since

Re: Fixing Wrecked Kafka Topic Partitions after a cluster reconfigure

Hey, Changing broker IDs made existing data in ZK irrelevant - since ZK uses broker ID to identify brokers and "associate" them with the partition placement (where the data is for each partition), it expects your data to be on the "old" brokers, while the ones that are connecting now are

Fixing Wrecked Kafka Topic Partitions after a cluster reconfigure

Hi all, I reconfigured my kafka cluster, changing: - default replication factor from 1 to 3 and also - changing the location of the kafka data dir on disk So after restarting all nodes, the cluster seemed ok but then I noticed all the topics are failing to come online. In the logs there are

Re: Streams: Why is ForwardingCacheFlushListener internal? Can I replicate its functionality in my code?

Right, but I want to forward messages to downstream processor nodes only when the store flushes. How does that happen automatically when KTableSourceProcessor sets that up to happen with a TupleForwarder? On Thu, Feb 1, 2018 at 2:59 AM, Matthias J. Sax wrote: > If you

Re: RE: NoClassDefFoundError: Could not initialize class com.yammer.metrics.Metrics

yes, it is. It is metrics-core-2.2.0.jar. I have checked all the brokers. wangchunc...@outlook.com From: TSANG, Brilly Date: 2018-02-01 14:54 To: users; user Subject: