Re: ISR shrink rate & IsrExpandsPerSec issue

These metrics are meter type metrics, which tracks count, mean rate, 1-, 5-, and 15-minute moving averages. You maybe observing count measure, which gives number of events which have been marked. You can try monitoring 1/5/15 miniture averages. On Wed, Jun 20, 2018 at 12:33 AM Arunkumar wrote:

Re: Frequent "offset out of range" messages, partitions deserted by consumer

How often is the consumer actually consuming? I know there's an issue where old committed offsets expire after a period of time. On Wed, 20 Jun. 2018, 5:46 pm Shantanu Deshmukh, wrote: > It is happening via auto-commit. Frequence is 3000 ms > > On Wed, Jun 20, 2018 at 10:31 AM Liam Clarke > wr

Re: Frequent "offset out of range" messages, partitions deserted by consumer

It is happening via auto-commit. Frequence is 3000 ms On Wed, Jun 20, 2018 at 10:31 AM Liam Clarke wrote: > How frequently are your consumers committing offsets? > > On Wed, 20 Jun. 2018, 4:52 pm Shantanu Deshmukh, > wrote: > > > I desperately need help. Facing this issue on production since a

Re: Frequent "offset out of range" messages, partitions deserted by consumer

How frequently are your consumers committing offsets? On Wed, 20 Jun. 2018, 4:52 pm Shantanu Deshmukh, wrote: > I desperately need help. Facing this issue on production since a while now. > Someone please help me out. > > On Fri, Jun 15, 2018 at 2:02 AM Lawrence Weikum > wrote: > > > unsubscrib

Re: Frequent "offset out of range" messages, partitions deserted by consumer

I desperately need help. Facing this issue on production since a while now. Someone please help me out. On Fri, Jun 15, 2018 at 2:02 AM Lawrence Weikum wrote: > unsubscribe > >

about message blocking problem

See letter good?? The kafka version I use is ??kafka_2.11-0.9.0.1.jarTopic messages cause a lot of blocking and the consumption speed is very slow. Please see the following monitoring information. What should I do? The consumer code is multithreaded according to the topic partition??

Re: [VOTE] 1.1.1 RC0

+1 Ran unit test suite which passed. Checked signatures. On Tue, Jun 19, 2018 at 4:47 PM, Dong Lin wrote: > Re-send to kafka-clie...@googlegroups.com > > On Tue, Jun 19, 2018 at 4:29 PM, Dong Lin wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the first candi

Re: [VOTE] 1.1.1 RC0

Re-send to kafka-clie...@googlegroups.com On Tue, Jun 19, 2018 at 4:29 PM, Dong Lin wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 1.1.1. > > Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first > rel

[VOTE] 1.1.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 1.1.1. Apache Kafka 1.1.1 is a bug-fix release for the 1.1 branch that was first released with 1.1.0 about 3 months ago. We have fixed about 25 issues since that release. A few of the more

Re: [pykafka-user] Re: Timestamp based reset_offset fails with OffsetOutOfRangeError

Thanks! I ask because I think it's possible that only having a single log segment (as your partition does) hamstrings the functionality of reset_offsets(). I haven't verified this experimentally, but I think it's possible. Maybe someone on the Kafka users group has insight. On Tue, Jun 19, 2018 at

ISR shrink rate & IsrExpandsPerSec issue

Hi All, I am seeing  IsrShrinksPerSec & IsrExpandsPerSec increases (>0) when one or more brokers goes down and comes back up into the cluster. But the values should get back to 0 once the servers catches up, is my understanding after reading most of the documents. But in our production environme

Re: SQL Server CDC

You can read more here: https://docs.confluent.io/current/connect/connect-jdbc/docs/source_connector.html Hope that helps. Thanks, Subhash Sent from my iPhone > On Jun 19, 2018, at 11:12 AM, Pranav Shah wrote: > > Hello, > > Is there connector available for Kafka SQL Server CDC? > > Thanks

Re: SQL Server CDC

Hi Pranav, Yes, there is a JDBC source connector that you can use to achieve CDC from SQL into Kafka using connect. Thanks, Subhash Sent from my iPhone > On Jun 19, 2018, at 11:12 AM, Pranav Shah wrote: > > Hello, > > Is there connector available for Kafka SQL Server CDC? > > Thanks, > Pr

Kafka active controller count stays at 2 (split brain issue)

Deployed Kafka several weeks ago. So far cannot get the cluster to stay up consistently for more than a day!! Every time, it works fine for several hours. I can send and receive messages with producers and consumers. Eventually within a day, the active controller count goes to 2 and then stays the

Re: SQL Server CDC

Hello, Is there connector available for Kafka SQL Server CDC? Thanks, Pranav On Fri, 15 Jun 2018 at 11:12, Pranav Shah wrote: > Hello, > > Good day!!! > > I have requirement to capture change of SQL Server; but I don't want to > use SQL Server Replication. I can't use SQL Server CDC because li

Re: Doubt related to Kafka Streams

It’s in the ProcessorContext: https://kafka.apache.org/0110/javadoc/org/apache/kafka/streams/processor/ProcessorContext.html (methods offset(), partition() ). You can get the context by invoking the method context() in any AbstractProcessor: https://kafka.apache.org/0110/javadoc/org/apache/kaf

Re: Is 0.11 inter broker protocol and log message format backward compatible with 0.10.0 ?

On 18/6/18 4:11 pm, Debraj Manna wrote: Hi I have seen the ugrade doc for 0.11. Please don't *see* it, read it :) The documentation is written with some very intricate details so administrators do not mess up during upgrades. Let's

Doubt related to Kafka Streams

Hi there, While using Kafka streams, I’m stuck with a problem. I’m unable to find a suitable method to print the partition number and offset value of the messages retrieved from the topic. Its pretty easy to find the key and value of the message but I’m unable to get the partition number and offset

RE: Comparison

I am referring for the pubsub comparison. Any kind of existing comparison that you know? Except this http://dev.solace.com/kafka/solace-kafka-comparison-summary/ -Original Message- From: Pavel Sapozhnikov [mailto:pavel.sapozhni...@gmail.com] Sent: יום ג 19 יוני 2018 17:40 To: users@kaf

Re: Comparison

Besides the fact that Solace is a JMS based system, what other comparison factors are you looking for? On Tue, Jun 19, 2018 at 10:34 AM Dor Ben Dov wrote: > Hi Everyone, > > Do you have any comparison between Kafka and solace? > > Regards, > Dor Ben Dov > This message and the information contain

Comparison

Hi Everyone, Do you have any comparison between Kafka and solace? Regards, Dor Ben Dov This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer

Secure Kafka cluster

Hi, We've started looking into working securely (encryption + authentication + authorization) with our Kafka cluster. So far it seems that most of our questions regarding securing the brokers and zookeeper our answered. However - we are looking into working with Confluent's kafka-rest and schema-re

Re: NPE in low level Kafka topology

We've tried running a fresh version with yesterday morning's trunk version, with the same result. We're running +- 15 KafkaStreams instances, and the one that fails is ithe biggest one, with >150 processors. We haven't been able to reproduce this error with smaller sub-sets. I'm now going to try t