Re: [VOTE] 1.1.0 RC4

+1 Checked keys, built, ran quickstart. LGTM. On Fri, Mar 23, 2018 at 4:37 PM, Rajini Sivaram wrote: > Hello Kafka users, developers and client-developers, > > This is the fifth candidate for release of Apache Kafka 1.1.0. > >

Re: Upgrade choice between 0.11.0 and 1.0.1

Thanks Jim, that article gives me a lot of inspiration. 原始邮件 发件人:Jim langstonjlangs...@resolutebi.com 收件人:users@kafka.apache.orgus...@kafka.apache.org 发送时间:2018年3月28日(周三) 03:07 主题:Re: Upgrade choice between 0.11.0 and 1.0.1 After reading the blog from Neha

Re: [VOTE] 1.1.0 RC4

+1 non binding. downloaded kafka_2.11-1.1.0.tgz artifact and upgraded in place including message format / broker protocol in our smallest non-production environment. Upgraded path has been 1.0.1->1.1.0-rc3->1.1.0-rc4 and it has run fine on rc4 for 2 days. We have a mixture of 0.9 through to

Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

Hello Mihaela, It is possible that when you have caching enabled, the value of the record has already been serialized before sending to the changelogger while the key was not. Admittedly it is not very friendly for trouble-shooting related log4j entries.. Guozhang On Tue, Mar 27, 2018 at 5:25

Re: [kafka-clients] Re: [VOTE] 1.1.0 RC4

Hi, Rajini, Thanks for running the release. Verified quickstart on scala 2.11 binary. +1 Jun On Tue, Mar 27, 2018 at 6:22 AM, Rajini Sivaram wrote: > Can we get some more votes for this RC so that the release can be rolled > out soon? > > Many thanks, > > Rajini > >

Re: Upgrade choice between 0.11.0 and 1.0.1

After reading the blog from Neha https://www.confluent.io/blog/apache-kafka-goes-1-0/ I moved to the 1.0 platform in production .. Jim / On 3/27/18, 7:07 AM, "chou.fan" wrote: Hi, we are planning to upgrade our kafka cluster to benefit from the new

Re: Running kafka in containers

I think is an open-ended question we are all starting to ask as we are moving to K8 and docker environments. Do we stand up a Kafka cluster by itself, or do we pull Kafka in the K8 umbrella ? Jim On 3/22/18, 3:28 PM, "Jason Turim" wrote: What container orchestration

Re: [kafka-clients] Re: [VOTE] 1.1.0 RC4

Hi Rajini, +1 (non-binding) Built from source on Linux and Windows (Java 8), and tested quickstart on both platforms. Connect quickstart on Windows is not working as per my note on RC3: https://www.mail-archive.com/dev@kafka.apache.org/msg86138.html No other issues detected. Thanks! --Vahid

Fwd: Consumer slowness issue

-- Forwarded message -- From: "pravin kumar" Date: 27-Mar-2018 6:11 PM Subject: Consumer slowness issue To: Cc: i have two topics with 5 partitions each wikifeedInputT10 KafkaProducer produces 10 elements and wikifeedInputT10

Re: [kafka-clients] Re: [VOTE] 1.1.0 RC4

Hello, +1 (non-binding). Ran through our regression and performance suite. Looks good, thanks. Jeff Chao Heroku On Tue, Mar 27, 2018 at 8:44 AM, Jason Gustafson wrote: > +1 Went through the quickstart, checked upgrade documentation. Thanks > Rajini! > > On Tue, Mar 27,

Re: onPartitionAssigned called also at startup - for the first partitions a consumer gets?

Hello Nicu, That is correct, when consumer start up the first thing it does is to join its group. And by joining the group it goes through the rebalance protocol where the onPartitionRevoked and onPartitionAssigned are called consecutively. Though onPartitionRevoked nothing will be there to

Re: Upgrade choice between 0.11.0 and 1.0.1

1.0.1 is the best choice right now. 1.1.0 is going to be out this week though. Ismael On Tue, Mar 27, 2018 at 4:07 AM, chou.fan wrote: > Hi, we are planning to upgrade our kafka cluster to benefit from the new > feature of transactional processing. There are two

Re: [kafka-clients] Re: [VOTE] 1.1.0 RC4

+1 Went through the quickstart, checked upgrade documentation. Thanks Rajini! On Tue, Mar 27, 2018 at 6:28 AM, Manikumar wrote: > +1 (non-binding) > > - Verified src, binary artifacts and basic quick start > - Verified delegation token operations and docs > - Verified

Re: Kafka & ZooKeeper IDs

Hi Chritophe, Thank you...This helps!! It is User IDs. I untarred and set appropriate permissions. - Vignesh On Mon, Mar 26, 2018 at 5:32 PM, Christophe Schmitz < christo...@instaclustr.com> wrote: > Hi Vignesh > > I am not sure what you mean by UNIX IDs is. Do you mean User ID (UID) which >

Re: [kafka-clients] Re: [VOTE] 1.1.0 RC4

+1 (non-binding) - Verified src, binary artifacts and basic quick start - Verified delegation token operations and docs - Verified dynamic broker configuration and docs. On Tue, Mar 27, 2018 at 6:52 PM, Rajini Sivaram wrote: > Can we get some more votes for this RC so

Re: [VOTE] 1.1.0 RC4

Can we get some more votes for this RC so that the release can be rolled out soon? Many thanks, Rajini On Sat, Mar 24, 2018 at 6:54 PM, Ted Yu wrote: > I wasn't able to reproduce the test failure when it is run alone. > > This seems to be flaky test. > > +1 from me. > >

Consumer slowness issue

i have two topics with 5 partitions each wikifeedInputT10 KafkaProducer produces 10 elements and wikifeedInputT10 have received these elements. [admin@nms-181 bin]$ sh kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic wikifeedInputT10 --time -1

Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

Hello, I have a Kafka Streams application that is consuming from two topics and internally aggregating, transforming and joining data. One of the aggregation steps is adding an id to an ArrayList of ids. Naturally since there was a lot of data the changelog message became too big and was not sent

Upgrade choice between 0.11.0 and 1.0.1

Hi, we are planning to upgrade our kafka cluster to benefit from the new feature of transactional processing. There are two alternatives: 0.11.0 and 1.0.1 so far. Maybe I didn’t look into the new changes so deeply but I notice that 1.0 haven't add some new features makes it so distinguishable

onPartitionAssigned called also at startup - for the first partitions a consumer gets?

Hi, The "rebalancing" callback is also called for the partitions the consumer gets when it starts up and joins the consumer group? Thank you, Nicu Marrasoiu Geschäftsanschrift/Business address: METRO SYSTEMS GmbH, Metro-Straße 12, 40235 Düsseldorf, Germany Aufsichtsrat/Supervisory Board: Heiko

Re: Developing with kafka and other non jvm languages

Hi Robin, Maybe this is where I have been getting confused - when I read the docs about the regex support for topics - I probably made a big assumption it was a server side thing. Is this not the case ? would explain why Ive not found much support for it lol Cheers Gary > On 26 Mar 2018,