Re: Subject: [VOTE] 2.4.1 RC0

ache Kafka 2.4.1. > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> This is a bug fix release and it includes fixes and improvements > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >> > > > >> > > > >> > > > >> from > > > >> > > > >> > > > >>> > > > >>>> > > > >>>> > > > >>>> 38 > > > >>>> > > > >>>> > > > >>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> JIRAs, including a few critical bugs. > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> Release notes for the 2.4.1 release: > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >> > > > >> > > > >> > > > >> https:/ / home. apache. org/ ~bbejeck/ kafka-2. 4. 1-rc0/ > > > RELEASE_NOTES. html > > > >> ( > https://home.apache.org/~bbejeck/kafka-2.4.1-rc0/RELEASE_NOTES.html ) > > > >> > > > >> > > > >>> > > > >>>> > > > >>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> *Please download, test and vote by Thursday, March 5, 9 am PT* > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> Kafka's KEYS file containing PGP keys we use to sign the > release: > > > https:/ / > > > >>>>>> kafka. apache. org/ KEYS ( https://kafka.apache.org/KEYS ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Release artifacts to be voted upon (source and binary): > https:/ / > > > home. apache. > > > >>>>>> org/ ~bbejeck/ kafka-2. 4. 1-rc0/ ( > > > >>>>>> https://home.apache.org/~bbejeck/kafka-2.4.1-rc0/ ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Maven artifacts to be voted upon: > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >> > > > >> > > > >> > > > >> https:/ / repository. apache. org/ content/ groups/ staging/ org/ > > > apache/ kafka/ > > > >> ( > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > ) > > > >> > > > >> > > > >> > > > >>> > > > >>>> > > > >>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Javadoc: > > > >>>>>> https:/ / home. apache. org/ ~bbejeck/ kafka-2. 4. 1-rc0/ > javadoc/ ( > > > >>>>>> https://home.apache.org/~bbejeck/kafka-2.4.1-rc0/javadoc/ ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Tag to be voted upon (off 2.4 branch) is the 2.4.1 tag: > https:/ / > > > github. > > > >>>>>> com/ apache/ kafka/ releases/ tag/ 2. 4. 1-rc0 ( > > > >>>>>> https://github.com/apache/kafka/releases/tag/2.4.1-rc0 ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Documentation: > > > >>>>>> https:/ / kafka. apache. org/ 24/ documentation. html ( > > > >>>>>> https://kafka.apache.org/24/documentation.html ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Protocol: > > > >>>>>> https:/ / kafka. apache. org/ 24/ protocol. html ( > > > >>>>>> https://kafka.apache.org/24/protocol.html ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> * Successful Jenkins builds for the 2.4 branch: > > > >>>>>> Unit/integration tests: Links to successful unit/integration > test > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>>> > > > >>>> build to > > > >>>> > > > >>>> > > > >>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> follow > > > >>>>>> System tests: > > > >>>>>> https:/ / jenkins. confluent. io/ job/ system-test-kafka/ job/ > 2. > > > 4/ 152/ ( > > > >>>>>> https://jenkins.confluent.io/job/system-test-kafka/job/2.4/152/ > ) > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> Thanks, > > > >>>>>> Bill Bejeck > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >>> > > > >>> -- > > > >>> David Arthur > > > >>> > > > >>> > > > >> > > > >> > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > Thanks! > > > > --Vahid > > > > > > > > > > > > > -- Sean Glover Principal Engineer, Akka Streams, Lightbend, Inc. @seg1o, in/seanaglover

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

ats great, look forward to it. > > Thanks, > Habib > > On Tue, Jan 14, 2020, at 2:55 PM, Sean Glover wrote: > > Hi Habib, > > > > Thank you for the reminder. I'll update the KIP this week and address the > > feedback from you and Gokul. > > > > Regards,

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

me, or LogAppendTime). I'm curious what others think. > > Cheers. > > On Wed, Dec 18, 2019 at 3:28 PM Habib Nahas wrote: > > > Thanks Sean. Look forward to the updated KIP. > > > > Regards, > > Habib > > > > On Fri, Dec 13, 2019, at 6:22 AM, Sean Glover wro

Re: [ANNOUNCE] New Kafka PMC Members: Colin, Vahid and Manikumar

Congratulations Colin, Vahid and Manikumar and thank you for all your excellent work on Apache Kafka! On Wed, Jan 15, 2020 at 8:42 AM Ron Dagostino wrote: > Congratulations! > > > On Jan 15, 2020, at 5:04 AM, Viktor Somogyi-Vass < > viktorsomo...@gmail.com> wrote: > > > > Congrats to you guys,

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

> Habib > Sr SDE, AWS > > On Wed, Dec 18, 2019, at 3:27 PM, Habib Nahas wrote: > > Thanks Sean. Look forward to the updated KIP. > > > > Regards, > > Habib > > > > On Fri, Dec 13, 2019, at 6:22 AM, Sean Glover wrote: > > > Hi, > > > >

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

cenario where the user sets this timestamp in timezone A and consumes the >> record in timezone B. Its not clear to me if a custom implementation of >> LatencyTime will help here. >> >> Thanks, >> Habib >> >> On Wed, Dec 11, 2019, at 4:52 PM, Sean Glover wrote: &g

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

. What is the recommendation for the proposed metric in a > scenario where the user sets this timestamp in timezone A and consumes the > record in timezone B. Its not clear to me if a custom implementation of > LatencyTime will help here. > > Thanks, > Habib > > On Wed, Dec 11,

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

Hello again, There has been some interest in this KIP recently. I'm bumping the thread to encourage feedback on the design. Regards, Sean On Mon, Jul 15, 2019 at 9:01 AM Sean Glover wrote: > To hopefully spark some discussion I've copied the motivation section from > the KIP: > &

Re: [VOTE] 2.4.0 RC1

Hi, I also used Eric's test script. I had a few issues running it that I address below[0][1], otherwise looks good. - Signing keys all good - All md5, sha1sums and sha512sums are good - A couple transient test failures that passed on a second run

Re: Preliminary blog post about the Apache Kafka 2.4.0 release

l Juma wrote: > That makes sense to me. > > Ismael > > On Mon, Nov 18, 2019 at 8:40 AM Sean Glover > wrote: > > > Hi Manikumar, > > > > I'm putting together an akka.io blog post regarding [KAFKA-7548] - > > KafkaConsumer should not throw away already fet

Re: Preliminary blog post about the Apache Kafka 2.4.0 release

Hi Manikumar, I'm putting together an akka.io blog post regarding [KAFKA-7548] - KafkaConsumer should not throw away already fetched data for paused partitions. Since it doesn't change any user-facing APIs it has no KIP, but it has a significant impact on consumer use cases that frequently pause

Re: [VOTE] KIP-531: Drop support for Scala 2.11 in Kafka 2.5

; > KIP-531: > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-531%3A+Drop+support+for+Scala+2.11+in+Kafka+2.5 > > > > > > Ismael > > > > > > -- Sean Glover Principal Engineer, Alpakka, Lightbend, Inc. <https://lightbend.com> @seg1o <https://twitter.com/seg1o>, in/seanaglover <https://www.linkedin.com/in/seanaglover/>

Re: [ANNOUNCE] New committer: Mickael Maison

9 at 1:38 PM Jun Rao > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Hi, Everyone, > > > > > > > > > > > > > > > > > > > > > > The PMC of Apache Kafka is pleased to announce a new > > Kafka > > > > > > > committer > > > > > > > > > > > Mickael > > > > > > > > > > > Maison. > > > > > > > > > > > > > > > > > > > > > > Mickael has been contributing to Kafka since 2016. He > > > proposed > > > > > > and > > > > > > > > > > > implemented multiple KIPs. He has also been propomating > > > Kafka > > > > > > > through > > > > > > > > > > blogs > > > > > > > > > > > and public talks. > > > > > > > > > > > > > > > > > > > > > > Congratulations, Mickael! > > > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > > > > > > > Jun (on behalf of the Apache Kafka PMC) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > Thanks! > > > > > > > --Vahid > > > > > > > > > > > > > > > > > > > > > > > > -- Sean Glover Principal Engineer, Alpakka, Lightbend, Inc. <https://lightbend.com> @seg1o <https://twitter.com/seg1o>, in/seanaglover <https://www.linkedin.com/in/seanaglover/>

Daily build artifacts

Hi, I'm curious if there's a daily build of trunk that can be accessed publicly? Specifically, I'm interested in referencing client libraries from a public maven or ivy repository, if one exists. I scanned the Apache Kafka builds and the Release Process wiki, but I didn't see any mention of a

[jira] [Created] (KAFKA-8822) Remove CompletedFetch type from Fetcher

Sean Glover created KAFKA-8822: -- Summary: Remove CompletedFetch type from Fetcher Key: KAFKA-8822 URL: https://issues.apache.org/jira/browse/KAFKA-8822 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-8814) Consumer benchmark test for paused partitions

Sean Glover created KAFKA-8814: -- Summary: Consumer benchmark test for paused partitions Key: KAFKA-8814 URL: https://issues.apache.org/jira/browse/KAFKA-8814 Project: Kafka Issue Type: New

Re: [DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

or as input to automatic scaling solutions. On Thu, Jul 11, 2019 at 12:36 PM Sean Glover wrote: > Hi kafka-dev, > > I've created KIP-489 as a proposal for adding latency metrics to the Kafka > Consumer in a similar way as record-lag metrics are implemented. > > > htt

[DISCUSS] KIP-489 Kafka Consumer Record Latency Metric

Hi kafka-dev, I've created KIP-489 as a proposal for adding latency metrics to the Kafka Consumer in a similar way as record-lag metrics are implemented. https://cwiki.apache.org/confluence/display/KAFKA/489%3A+Kafka+Consumer+Record+Latency+Metric Regards, Sean -- Principal Engineer,

[jira] [Created] (KAFKA-8656) Kafka Consumer Record Latency Metric

Sean Glover created KAFKA-8656: -- Summary: Kafka Consumer Record Latency Metric Key: KAFKA-8656 URL: https://issues.apache.org/jira/browse/KAFKA-8656 Project: Kafka Issue Type: New Feature

Request access to create a KIP

Hi, I'd like permission to create a new KIP page in the wiki. Confluence username: sean.glover Regards, Sean -- Principal Engineer, Lightbend, Inc. @seg1o , in/seanaglover

Re: [DISCUSS] KIP-385: Provide configuration allowing consumer to no throw away prefetched data

Hi everyone, I want to revive a solution to this issue. I created a new PR that accomodates Jason Gustafson's suggestion in the original PR to re-add paused completed fetches back to the completed fetches queue for less bookeeping. If someone could jump in and do a review it would be

Re: [ANNOUNCE] Apache Kafka 2.0.0 Released

gt; > > > > > > > > > > > > > > > > > A big thank you for the following 131 contributors to this release! > > > > > > > > > > > > Adem Efe Gencer, Alex D, Alex Dunayevsky, Allen Wang, Andras Beni, > > > > > >

Re: [DISCUSS] KIP-270 A Scala wrapper library for Kafka Streams

Type names: I vote for option 2. The user must explicitly add a dependency to this library and the wrapper types are in a different package. It seems reasonable to expect them to do an import rename if there's a need to drop down to the Java API. Test Utils: The test utils in

[jira] [Commented] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover commented on KAFKA-903: --- I still see this exception on Windows 7 Pro SP1

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 6:53 PM: - I

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:15 PM: - I

[jira] [Comment Edited] (KAFKA-903) [0.8.0 - windows] FATAL - [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt to swap the new high watermark file with the old one failed

[ https://issues.apache.org/jira/browse/KAFKA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832845#comment-13832845 ] Sean Glover edited comment on KAFKA-903 at 11/26/13 7:58 PM: - I