Re: Consumer group describe issue

2018-02-22 Thread sahil aggarwal
Bill, I have created the jira: https://issues.apache.org/jira/browse/KAFKA-6581 but i am not able to assign it to myself. Can you please help? Thanks, Sahil On 28 December 2017 at 11:50, sahil aggarwal wrote: > @TedYu > From 0.10.0

Re: usage of depricated method in kafka 2_12.1.0.0

2018-02-22 Thread Matthias J. Sax
As the JavaDocs point out (https://kafka.apache.org/10/javadoc/org/apache/kafka/streams/kstream/KGroupedStream.html#count-java.lang.String-), the new method is #count(Materialized) for example stream.groupByKey.count(Materialized.as("store-name")); -Matthias On 2/21/18 11:08 PM, pravin

Kafka Streams : TimeoutException Expiring Records

2018-02-22 Thread Tony John
Hi All, I am running into an issue with my Kafka Streams application. The application was running fine for almost 2 weeks, then it started throwing the below exception which caused the threads to die. Now when I restart the application, it dies quickly (1-2 hrs) when trying to catch up the lag.

Producer blocks on send to topic that doesn't exist if auto create is disabled

2018-02-22 Thread Josef Ludvíček
Hello, Is anyone aware of plans for resolving [KAFKA-3450] - Producer blocks on send to topic that doesn't exist if auto create is disabled ? Or any good workaround / hints to fix? Thanks for any advice. Josef https://issues.apache.org/jira/browse/KAFKA-3450

Review fo patch JIRA 1194 (pull req 3838)

2018-02-22 Thread M. Manna
Hello, Could someone please review the patch provided? We are going live in prod with 9 brokers on windows VM, and this is a blocker. To summarise, the patch allows unmapping when log index files are looked. Cleanup fails as a result, and it is specific that Windows OS. Regards,

Re: Kafka Streams : TimeoutException Expiring Records

2018-02-22 Thread Bill Bejeck
Hi Tony, Looks like you have a known issue that KIP-91( https://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer) will address. In the meantime, as a workaround, you could try setting REQUEST_TIMEOUT_MS_CONFIG to a large value (Integer.MAX_VALUE ?)

Re: Doubts about multiple instance in kafka

2018-02-22 Thread naresh Goud
Hi Pravin, Your correct. you can run application with multiple times so they will be started on multiples JVM's ( run1 :- java yourclass (which runs in one JVM) ; run2: java yourclass(which runs in another JVM ) ) or else you can run application on multiple machines i.e multiple

ProcessorTopology

2018-02-22 Thread pravin kumar
Can we give the ouput of one processorTopology as the input to another processorTopology. if it is possible,how can we do it. Can anyone provide it with any example

Re: Kafka Streams : TimeoutException Expiring Records

2018-02-22 Thread Tony John
Thanks a lot Bill for looking in to this. I would definitely attempt the suggestions and let you know the outcome. I have gone through KIP-91, but struggling to understand the behavior. So does it mean that these errors are happening due to a failure in the broker? If so why would it kill all the

Re: Consumer group describe issue

2018-02-22 Thread Bill Bejeck
Can someone add Sahil to the contributor list? Thanks, Bill On Thu, Feb 22, 2018 at 3:39 AM, sahil aggarwal wrote: > Bill, > > I have created the jira: https://issues.apache.org/jira/browse/KAFKA-6581 > but i am not able to assign it to myself. > > Can you please help? >