Re: Re: kafka streams coordinator error

there is no errors in that time broker server.logs funk...@live.com From: Sameer Kumar Date: 2018-03-30 13:33 To: users Subject: Re: kafka streams coordinator error Check Kafka broker logs as well, see

Re: kafka streams coordinator error

Check Kafka broker logs as well, see if there some error there. On Fri, Mar 30, 2018, 10:57 AM ? ? wrote: > Hi: > I used kafka streams for days. > and I meet a problem today.when I test 2400W data in kafka though kafka > streaming then write datas to HDFS . > I found the final

kafka streams coordinator error

Hi: I used kafka streams for days. and I meet a problem today.when I test 2400W data in kafka though kafka streaming then write datas to HDFS . I found the final results is bigger then 2400W.and in console I found the error. Offset commit failed on partition -2 at offset 63514037: The

Is Restart needed after change in trust store for Kafka 1.1 ?

Hi We have a 3 node Kafka cluster running. Time to time, we have some changes in trust store and we restart Kafka to take new changes into account. We are on Kafka 0.10.x. If we move to 1.1, would we still need to restart Kafka upon trust store changes ? Thanks. -- Raghav

partition replication vs. partition clustering ?

Can someone clarify difference between partition replication and partition replication? Or, are they referring to the same thing?

Re: Kafka Stream - Building KTable in Kafka 1.0.0

Hello Cédric, Your observation is correct, and I think we have some obsoleted docs that we need to fix. In KIP-182 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-182%3A+Reduce+Streams+DSL+overloads+and+allow+easier+use+of+custom+storage+engines) we are effectively materializing all state

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

Congratulations, Dong! On Wed, Mar 28, 2018 at 7:04 PM, Hu Xi wrote: > Congrats, Dong Lin! > > > > 发件人: Matthias J. Sax > 发送时间: 2018年3月29日 6:37 > 收件人: users@kafka.apache.org; d...@kafka.apache.org > 主题: Re: [ANNOUNCE]

Re: Two instances of Kafka consumer reading same partition

Hi, We had one more of such an issue, and looks like such issues are coming more frequently, whenever there is some issue in the kafka cluster. This time, I could retrieve both the server and client side logs, have added the detail in the same ticket - KAFKA-6681

Re: [ANNOUNCE] Apache Kafka 1.1.0 Released

Thanks Damian and Rajini for running the release! Congrats and good job everyone! -James Sent from my iPhone > On Mar 29, 2018, at 2:27 AM, Rajini Sivaram wrote: > > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 1.1.0. > > > Kafka

Re: [ANNOUNCE] Apache Kafka 1.1.0 Released

Thanks to Damian and Rajini for running the release and thanks to everyone who helped make it happen! Ismael On Thu, Mar 29, 2018 at 2:27 AM, Rajini Sivaram wrote: > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 1.1.0. > > > Kafka 1.1.0

Kafka Stream - Building KTable in Kafka 1.0.0

Hello, In the new api 1.0.0 for building KTable, it is written that No internal changelod topic is created. public KTable table(java.lang.String topic) Create a KTable

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

Congrats Dong! :) On Thu, Mar 29, 2018 at 2:12 PM, Satish Duggana wrote: > Congratulations Dong! > > > On Thu, Mar 29, 2018 at 5:12 PM, Sandor Murakozi > wrote: > > > Congrats, Dong! > > > > > > On Thu, Mar 29, 2018 at 2:15 AM, Dong Lin

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong! On Thu, Mar 29, 2018 at 5:12 PM, Sandor Murakozi wrote: > Congrats, Dong! > > > On Thu, Mar 29, 2018 at 2:15 AM, Dong Lin wrote: > > > Thanks everyone!! > > > > It is my great pleasure to be part of the Apache Kafka community and

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

Congrats, Dong! On Thu, Mar 29, 2018 at 2:15 AM, Dong Lin wrote: > Thanks everyone!! > > It is my great pleasure to be part of the Apache Kafka community and help > make Apache Kafka more useful to its users. I am super excited to be a > Kafka committer and I am hoping to

Re: Need help in kafka hdfs connector

Try this : https://github.com/pinterest/secor On Thu, Mar 29, 2018 at 2:36 PM, Santosh Kumar J P < santoshkumar...@gmail.com> wrote: > Hi, > > Do we have any other Kafka HDFS connectors implementation other than > Confluent HDFS connector. > > Thank you, > Regards, > Santosh >

Re: [ANNOUNCE] Apache Kafka 1.1.0 Released

Great to hear! thanks for driving the release process. -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Mickael Maison To: Users Cc: kafka-clients

Re: partition selection with message key

Yes. As long as we use same partitioner and have same number of partitions, messages with same key will go to same partition. On Thu, Mar 29, 2018 at 3:11 PM, Victor L wrote: > I am looking for best method to keep consumption of messages in the same > order as client

Re: [ANNOUNCE] Apache Kafka 1.1.0 Released

Great news, thanks Damian and Rajini for running this release! On Thu, Mar 29, 2018 at 10:33 AM, Rajini Sivaram wrote: > Resending to kaka-clients group: > > -- Forwarded message -- > From: Rajini Sivaram > Date: Thu, Mar 29, 2018 at

partition selection with message key

I am looking for best method to keep consumption of messages in the same order as client produced them, one thing i am looking at is using of message key to select partition: If a valid partition number is specified that partition will be used when sending the record. If no partition is specified

Fwd: [ANNOUNCE] Apache Kafka 1.1.0 Released

Resending to kaka-clients group: -- Forwarded message -- From: Rajini Sivaram Date: Thu, Mar 29, 2018 at 10:27 AM Subject: [ANNOUNCE] Apache Kafka 1.1.0 Released To: annou...@apache.org, Users , dev < d...@kafka.apache.org>,

[ANNOUNCE] Apache Kafka 1.1.0 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 1.1.0. Kafka 1.1.0 includes a number of significant new features. Here is a summary of some notable changes: ** Kafka 1.1.0 includes significant improvements to the Kafka Controller that speed up controlled

Need help in kafka hdfs connector

Hi, Do we have any other Kafka HDFS connectors implementation other than Confluent HDFS connector. Thank you, Regards, Santosh

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

congratulations Dong! -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN From: Hu Xi To: "users@kafka.apache.org" , "d...@kafka.apache.org" Date: