Re: Removing the Kafka DEBUG logs in catalina.out using log4j.properties

2018-05-15 Thread Karthick Kumar
Hi Andras/Kaufman, I have tried both logger properties, But it is not working for me. Here I share the some DEBUG logger message which is print in my tomcat node DEBUG AbstractCoordinator:704 - Sending Heartbeat request for group apptivodb5-newsfeed-messages-4-consumer to coordinator

Exception stopps data processing (Kafka Streams)

2018-05-15 Thread Claudia Wegmann
Hey there, I've got a few Kafka Streams services which run smoothly most of the time. Sometimes, however, some of them get an exception "Abort sending since an error caught with a previous record" (see below for a full example). The Stream Service having this exception just stops its work

Re: Exception stopps data processing (Kafka Streams)

2018-05-15 Thread Matthias J. Sax
Claudia, I leader change is a retryable error. What is your producer config for `retries`? You might want to increase it such that the producer does not throw the exception immediately but retries couple of times -- you might also want to adjust `retry.backoff.ms` that sets the time to wait until

[VOTE] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-15 Thread Bill Bejeck
Hi all, I'd like to start a vote on KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization. KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3A+Add+Streams+Configuration+Allowing+for+Optional+Topology+Optimization Discussion thread:

Re: Producer#commitTransaction() Not Being Called if New Records Aren't Processed by StreamTask

2018-05-15 Thread Matthias J. Sax
Thanks for reporting this @David! @Guozhang: I actually think this is two different issues. This is also exposed in a current PR: https://github.com/apache/kafka/pull/4912/files#r188179256 I created https://issues.apache.org/jira/browse/KAFKA-6906 for this issue. -Matthias On 5/11/18 10:39