Asynchronous Producer Retry Behaviour

2020-01-31 Thread Trinity Xia
Hi group, I am wondering what is the retry behavior of asynchronous producer. Does asynchronous producer retry to send messages if it doesn't receive a response from a broker for a certain amount of time? Thank you for the help! Trinity

RE: kafka-run-class.sh kafka.tools.GetOffsetShell in SASL enabled cluster

2020-01-31 Thread JOHN, BIBIN
Team, Could you please help on this? Thanks Bibin John From: JOHN, BIBIN Sent: Thursday, January 30, 2020 11:59 PM To: users@kafka.apache.org Subject: kafka-run-class.sh kafka.tools.GetOffsetShell in SASL enabled cluster Team, I am getting below error when try to use kafka-run-class.sh

Re: High CPU in 2.2.0 kafka cluster

2020-01-31 Thread Brandon Barron
We were running client version 2.3.0 for a while, then bumped to 2.3.1 for a particular kafka streams bug fix. We saw this issue while both versions were running. Brandon From: Jamie Sent: Thursday, January 30, 2020 1:03 PM To: users@kafka.apache.org Subject:

Kafka audit logs in Apache Kafka?

2020-01-31 Thread Otis Gospodnetić
Hi, Does Apache Kafka have audit logs equivalent of https://docs.confluent.io/current/security/audit-logs.html or does only Confluent's Kafka have this? Thanks, Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training -

Eclipse Scala IDE with MacOS (Catalina) and OpenJDK11

2020-01-31 Thread M. Manna
Hey Dev Group, Apologies if this was meant to be sent for dev group, so I thought I would put it out here. It seems that I cannot get Eclipse Scala to start with MacOS (Catalina). I must be honest, that I haven't tried it on Mac before. Additionally, I am using OpenJDK 11. I have put it inside

Re: Resource based kafka assignor

2020-01-31 Thread John Roesler
Hi Srinivas, Your approach sounds fine, as long as you don’t need the view of the assignment to be strictly consistent. As a roughy approximation, it could work. On the other hand, if you’re writing a custom assignor, you could consider using the SubscriptionInfo field of the joinGroup

Re: Kafka consumers freeze

2020-01-31 Thread M. Manna
Hey Tim On Fri, 31 Jan 2020 at 13:06, Sullivan, Tim wrote: > > > Is there a way I can proactively check my consumers to see if > they are consuming? Periodically some or all of my consumers stop > consuming. The only way I am made aware of this is when my down stream > feeds folks

Re: Kafka consumers freeze

2020-01-31 Thread Jamie
Hi Tim, Can you use the “bytes-consumed-rate” jinx metric which reports the bytes consumed per topic?  What errors are you seeing in the consumer when it freezes? Thanks, Jamie  Sent from AOL Mobile Mail Get the new AOL app: mail.mobile.aol.com On Friday, 31 January 2020, Sullivan, Tim  wrote:

Kafka consumers freeze

2020-01-31 Thread Sullivan, Tim
Is there a way I can proactively check my consumers to see if they are consuming? Periodically some or all of my consumers stop consuming. The only way I am made aware of this is when my down stream feeds folks alert me that their data isn’t flowing into Kafka. My normal solution