Jenkins build is back to normal : kafka-trunk-jdk8 #4429

2020-04-13 Thread Apache Jenkins Server
See

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Matthias J. Sax
Thanks for running the release Arthur! - verified signatures - build from sources - run tests locally (some flaky tests failed, but eventually all tests passed) - run quickstart (core/connect/streams) using Scala 2.13 binaries +1 (binding) -Matthias On 4/13/20 5:14 PM, Colin McCabe wrote:

Re: [DISCUSS] KIP-591: Add Kafka Streams config to set default store type

2020-04-13 Thread Sophie Blee-Goldman
Hey Matthias, Thanks for picking this up! This'll be really nice for testing in particular. My only question is, do we want to make this available for use with custom state stores as well? I'm not sure how common custom stores are in practice, but I imagine when they *are* used, they're likely

Re: [DISCUSS] KIP-588: Allow producers to recover gracefully from transaction timeouts

2020-04-13 Thread Boyang Chen
Thanks Guozhang! Will wait and see if there are more comments. On Fri, Apr 10, 2020 at 5:17 PM Guozhang Wang wrote: > Thanks Boyang, the newly added example looks good to me. > > On Thu, Apr 9, 2020 at 2:47 PM Boyang Chen > wrote: > > > Hey Guozhang, > > > > I have added an example of the

Re: Permission to create a KIP

2020-04-13 Thread 张祥
Thanks Guozhang. Guozhang Wang 于2020年4月14日周二 上午12:52写道: > I've added your id to the apache wiki space. You should be able to create > new pages now. > > On Sun, Apr 12, 2020 at 10:55 PM 张祥 wrote: > > > I just registered a new account with xiangzhang1...@gmail.com and my > > username is

Build failed in Jenkins: kafka-trunk-jdk8 #4428

2020-04-13 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: need to cleanup any tasks closed in TaskManager (#8463) -- [...truncated 3.02 MB...]

[jira] [Resolved] (KAFKA-9842) Address testing gaps in consumer OffsetsForLeaderEpochs request grouping

2020-04-13 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9842. Resolution: Fixed > Address testing gaps in consumer OffsetsForLeaderEpochs request

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Colin McCabe
+1 (binding) verified checksums ran unitTest ran check best, Colin On Tue, Apr 7, 2020, at 21:03, David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 support (1.2 is now the default) > *

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-04-13 Thread Kowshik Prakasam
Hi Jun, Thanks for the feedback! I have updated the KIP-584 addressing your comments. Please find my response below. > 100.6 You can look for the sentence "This operation requires ALTER on > CLUSTER." in KIP-455. Also, you can check its usage in > KafkaApis.authorize(). (Kowshik): Done. Great

[DISCUSS] KIP-593: Enable --if-exists and --if-not-exists for AdminClient in TopicCommand

2020-04-13 Thread Cheng Tan
Hi developers, In kafka-topic.sh, we expect to use --if-exists to ensure that the topic to create or change exists. Similarly, we expect to use --if-not-exists to ensure that the topic to create or change does not exist. Currently, only ZookeeperTopicService supports these two options. We want

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-04-13 Thread Christopher Egerton
HI Zihan, Thanks for the KIP! I have some questions that I'm hoping we can address to help better understand the motivation for this proposal. 1. In the "Motivation" section it's written that "If users want to store their broken records, they have to config a broken record queue, which is too

[jira] [Created] (KAFKA-9862) Enable --if-exists and --if-not-exists for AdminClient in TopicCommand

2020-04-13 Thread Cheng Tan (Jira)
Cheng Tan created KAFKA-9862: Summary: Enable --if-exists and --if-not-exists for AdminClient in TopicCommand Key: KAFKA-9862 URL: https://issues.apache.org/jira/browse/KAFKA-9862 Project: Kafka

Build failed in Jenkins: kafka-2.4-jdk8 #186

2020-04-13 Thread Apache Jenkins Server
See Changes: [konstantine] [MINOR] allow additional JVM args in KafkaService (#7297) [konstantine] Fix missing reference in kafka.py (#7715) -- [...truncated 2.76 MB...]

[KAFKA-9861] Process Simplification - Community Validation of Kafka Release Candidates

2020-04-13 Thread Israel Ekpo
Hi Everyone, I have created [KAFKA-9861] as a process improvement and I have started work on it. https://issues.apache.org/jira/browse/KAFKA-9861 I understand that KIPs are generally reserved for code improvements or changes but I wanted to find out if something like this is better as a KIP

[jira] [Created] (KAFKA-9861) Process Simplification - Community Validation Kafka Release Candidates

2020-04-13 Thread Israel Ekpo (Jira)
Israel Ekpo created KAFKA-9861: -- Summary: Process Simplification - Community Validation Kafka Release Candidates Key: KAFKA-9861 URL: https://issues.apache.org/jira/browse/KAFKA-9861 Project: Kafka

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Jun Rao
Hi, David, Thanks for running the release. Verified quickstart on the scala 2.12 binary. +1 from me. Jun On Tue, Apr 7, 2020 at 9:03 PM David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3

[jira] [Resolved] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-04-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9859. Resolution: Not A Problem > kafka-streams-application-reset tool doesn't take into account

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-04-13 Thread Kowshik Prakasam
Hi Guozhang, Thanks for the explanation! This is a very good point. I have updated the KIP incorporating the proposed idea. We now maintain/serve MAX as well as MIN version levels of finalized features. So, the client will get to know both these values in the ApiVersionsResponse. This serves as a

Re: Permission to create a KIP

2020-04-13 Thread Guozhang Wang
I've added your id to the apache wiki space. You should be able to create new pages now. On Sun, Apr 12, 2020 at 10:55 PM 张祥 wrote: > I just registered a new account with xiangzhang1...@gmail.com and my > username is `iamabug`, not sure which one is id. > > Guozhang Wang 于2020年4月13日周一

Re: Kafka topology monitoring

2020-04-13 Thread Guozhang Wang
Hello Timothy, I'm not sure I get your question: what do you mean that these metrics `do not seem to extrapolate the above messages`? Note that the metrics reporting has reporting levels (current there are INFO and DEBUG) and the ones you mentioned are DEBUG level, so you'd need to override your

Re: [DISCUSS] (KAFKA-9806) authorize cluster operation when creating internal topics

2020-04-13 Thread Paolo Moriello
Right, the problem in this case is that restoring ACLs to a correct configuration does not fix the problem, because the internal topics remains in a bad state. For instance: 1) user sets insufficient cluster level ACLs (now brokers are not able to communicate) 2) user consumes for the first

Re: [DISCUSS] KIP-587 Suppress detailed responses for handled exceptions in security-sensitive environments

2020-04-13 Thread Connor Penhale
Hi Chris! RE: SSL, indeed, the issue is not that the information is not encrypted, but that there is no authorization layer. I'll be sure to edit the KIP as we continue discussion! RE: the 200 response you highlighted, great catch! I'll work with my customer and get back to you on their audit

[jira] [Created] (KAFKA-9860) Transactional Producer could add partitions by batch at the end

2020-04-13 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9860: -- Summary: Transactional Producer could add partitions by batch at the end Key: KAFKA-9860 URL: https://issues.apache.org/jira/browse/KAFKA-9860 Project: Kafka

Kafka topology monitoring

2020-04-13 Thread timothy
Good Afternoon and hope you all are well. Im trying to monitor my topologies to ensure That I can look at the following metrics Thread metrics - Average time for commits, poll, process operations - Tasks created per second, tasked closed per second I have seen metrics in micrometer, but

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

2020-04-13 Thread Aneel Nazareth
Thanks to David Jacot for his suggestions. Would it be possible for a committer to have a look at this PR? Thanks! https://github.com/apache/kafka/pull/8184 On Wed, Apr 1, 2020 at 12:30 PM Aneel Nazareth wrote: > > I have a PR that I think is ready for review here: >

Re: [DISCUSS] (KAFKA-9806) authorize cluster operation when creating internal topics

2020-04-13 Thread Colin McCabe
On Thu, Apr 9, 2020, at 09:36, Paolo Moriello wrote: > Hi Colin, > > Thanks again for checking this out. > > Indeed you are right, a configuration problem is what leads to > authorization failure (and consequently to the internal topics bug): i.e. > incorrect ACLs configuration. In particular,

[jira] [Created] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-04-13 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-9859: Summary: kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation Key: KAFKA-9859 URL:

Re: Need JIRA permission to self-assign tickets

2020-04-13 Thread Manikumar
Hi, Thanks for your interest. I just added you to the the contributors list. Thanks, On Mon, Apr 13, 2020 at 7:13 PM Luke Chen wrote: > Hi devs, > I need the JIRA permission to self-assign tickets. > Please help grant me the permission. > > JIRA username: showuon > > Thank you very much. >

Need JIRA permission to self-assign tickets

2020-04-13 Thread Luke Chen
Hi devs, I need the JIRA permission to self-assign tickets. Please help grant me the permission. JIRA username: showuon Thank you very much. Luke

[jira] [Created] (KAFKA-9858) CVE-2016-3189 Use-after-free vulnerability in bzip2recover in bzip2 1.0.6 allows remote attackers to cause a denial of service (crash) via a crafted bzip2 file, related

2020-04-13 Thread sihuanx (Jira)
sihuanx created KAFKA-9858: -- Summary: CVE-2016-3189 Use-after-free vulnerability in bzip2recover in bzip2 1.0.6 allows remote attackers to cause a denial of service (crash) via a crafted bzip2 file, related to block ends set to before the start of

[jira] [Created] (KAFKA-9857) Failed to build image ducker-ak-openjdk-8 on arm

2020-04-13 Thread jiamei xie (Jira)
jiamei xie created KAFKA-9857: - Summary: Failed to build image ducker-ak-openjdk-8 on arm Key: KAFKA-9857 URL: https://issues.apache.org/jira/browse/KAFKA-9857 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-9856) GetOffsetShell does not support SSL or Kerberos

2020-04-13 Thread Tek Kee Wang (Jira)
Tek Kee Wang created KAFKA-9856: --- Summary: GetOffsetShell does not support SSL or Kerberos Key: KAFKA-9856 URL: https://issues.apache.org/jira/browse/KAFKA-9856 Project: Kafka Issue Type: Bug