[jira] [Created] (KAFKA-8932) Add tag for TopicConfigErrorCode in CreateTopics response when KIP-482 is merged

Rajini Sivaram created KAFKA-8932: - Summary: Add tag for TopicConfigErrorCode in CreateTopics response when KIP-482 is merged Key: KAFKA-8932 URL: https://issues.apache.org/jira/browse/KAFKA-8932

Build failed in Jenkins: kafka-trunk-jdk8 #3919

See -- [...truncated 2.64 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldProcessConsumerRecordList[Eos enabled = false] STARTED

Re: [DISCUSS] KIP-504 - Add new Java Authorizer Interface

Hi all, I have submitted a PR to address a few review comments from Ismael. There are a couple of interface changes in the PR, I have updated the KIP as well. 1. The `listener()` method in AuthorizableRequestContext and Endpoint has been renamed to listenerName() 2.

Re: [VOTE] KIP-525 - Return topic metadata and configs in CreateTopics response

Hi Satish, I have updated the KIP to use TopicMetadataAndConfig for the inner class instead of CreateResult. I also fixed the version in the protocol to use 5 instead of 6 since the update to version 5 in KIP-482 will be going out in the same release as this KIP. Since both are minor changes

Build failed in Jenkins: kafka-trunk-jdk8 #3920

See Changes: [github] KAFKA-8848; Update system tests to use new AclAuthorizer (#7374) -- Started by an SCM change [EnvInject] - Loading node environment variables.

[jira] [Resolved] (KAFKA-8848) Update system test to use new authorizer

[ https://issues.apache.org/jira/browse/KAFKA-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8848. --- Reviewer: Manikumar Resolution: Fixed > Update system test to use new authorizer >

Re: [DISCUSS] Apache Kafka 2.4.0 release

Hi Manikumar, Can we add KIP-525 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-525+-+Return+topic+metadata+and+configs+in+CreateTopics+response) to 2.4.0 release? It has been accepted and is a minor KIP. Thank you, Rajini On Fri, Sep 20, 2019 at 6:14 AM Manikumar wrote: > Hi, > >

Re: [VOTE] KIP-525 - Return topic metadata and configs in CreateTopics response

The vote has passed with 4 binding votes (Colin, Manikumar, Harsha, Rajini) and 2 non-binding votes (Satish, Kamal). I will update the KIP page and submit a PR. Many thanks for the discussion and votes. Regards, Rajini On Tue, Sep 24, 2019 at 9:22 AM Rajini Sivaram wrote: > > Hi Satish, I

[jira] [Created] (KAFKA-8933) An unhandled SSL handshake exception in polling event - needed a retry logic

Remigius created KAFKA-8933: --- Summary: An unhandled SSL handshake exception in polling event - needed a retry logic Key: KAFKA-8933 URL: https://issues.apache.org/jira/browse/KAFKA-8933 Project: Kafka

Re: [DISCUSS] Apache Kafka 2.4.0 release

Hi All, Just a reminder that tomorrow (Sep 25, 2019) is the last date for KIP acceptance for 2.4.0 release. Thanks, On Tue, Sep 24, 2019 at 7:05 PM Manikumar wrote: > Hi Rajini, > > Added KIP-525 to the release plan for tracking. > > Thanks, > > > On Tue, Sep 24, 2019 at 4:36 PM Rajini

[jira] [Resolved] (KAFKA-6958) Allow to define custom processor names with KStreams DSL

[ https://issues.apache.org/jira/browse/KAFKA-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-6958. Resolution: Fixed Thanks again [~fhussonnois] for your hard work and persistence in seeing this

[jira] [Created] (KAFKA-8934) Introduce Instance-level Metrics

Bruno Cadonna created KAFKA-8934: Summary: Introduce Instance-level Metrics Key: KAFKA-8934 URL: https://issues.apache.org/jira/browse/KAFKA-8934 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-507: Securing Internal Connect REST Endpoints

Thanks, Chris! +1 (binding) On Thu, Sep 19, 2019 at 7:43 PM Chris Egerton wrote: > Hi all, > > I'd like to begin voting on KIP-507: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-507%3A+Securing+Internal+Connect+REST+Endpoints > > Thanks to Ryanne, Magesh, Konstantine, Greg, and

Re: [Discuss] - KIP-532 - Add KStream#toTable to the Streams DSL

Thank you for the suggestion Matthais, i've made the necessary changes in the KIP. Keeping this thread open for further input. KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-523%3A+Add+KStream%23toTable+to+the+Streams+DSL Best, Aishwarya On Thu, Sep 19, 2019 at 10:50 AM

Re: [DISCUSS] KIP-527: Add NothingSerde to Serdes

Hello, KIP [1] updated to VoidSerde. [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-527%3A+Add+VoidSerde+to+Serdes В Вт, 24/09/2019 в 09:11 -0400, Andrew Otto пишет: > Ah it is! +1 to VoidSerde > > On Mon, Sep 23, 2019 at 11:25 PM Matthias J. Sax > wrote: > > > Because the

Re: [DISCUSS] Apache Kafka 2.4.0 release

Hi Rajini, Added KIP-525 to the release plan for tracking. Thanks, On Tue, Sep 24, 2019 at 4:36 PM Rajini Sivaram wrote: > Hi Manikumar, > > Can we add KIP-525 ( > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-525+-+Return+topic+metadata+and+configs+in+CreateTopics+response > ) >

Build failed in Jenkins: kafka-trunk-jdk11 #830

See -- [...truncated 2.69 MB...] org.apache.kafka.streams.kstream.internals.KStreamImplTest > shouldNotAllowNullTableOnJoinWithGlobalTable STARTED

[jira] [Created] (KAFKA-8936) Connect metrics have a chance to disappear on rebalance

Steven Blumenthal created KAFKA-8936: Summary: Connect metrics have a chance to disappear on rebalance Key: KAFKA-8936 URL: https://issues.apache.org/jira/browse/KAFKA-8936 Project: Kafka

Re: [DISCUSS] KIP-527: Add NothingSerde to Serdes

Ah it is! +1 to VoidSerde On Mon, Sep 23, 2019 at 11:25 PM Matthias J. Sax wrote: > Because the actually data type is `Void`, I am wondering if `VoidSerde` > might be a more descriptive name? > > -Matthias > > On 9/23/19 12:25 PM, Nikolay Izhikov wrote: > > Hello, guys > > > > Any additional

Re: [Discuss] - KIP-532 - Add KStream#toTable to the Streams DSL

Hey Aishwarya, Thanks for the KIP! It looks good to me, although in a post-KIP-307 world, we also need a "Named" parameter (to give the processor node a name, as opposed to the store itself). This would result in a total of four overloads: 1. no args 2. Named 3. Materialized 4. Materialized,

Re: [VOTE] KIP-517: Add consumer metrics to observe user poll behavior

Hi All, It has been a few days so I am closing the vote now. This KIP has passed with +4 binding votes (Harsha, Manikumar, Jason, Bill) and +3 non-binding votes (Mickael, Maulin, Tom). Regards, Kevin On Fri, Sep 20, 2019 at 1:37 PM Kevin Lu wrote: > Hi All, > > Thanks for the votes! > > I

Re: [VOTE] KIP-507: Securing Internal Connect REST Endpoints

Thanks for the KIP, Chris! +1 (binding) Regards, Rajini On Tue, Sep 24, 2019 at 3:12 PM Randall Hauch wrote: > Thanks, Chris! > > +1 (binding) > > On Thu, Sep 19, 2019 at 7:43 PM Chris Egerton wrote: > > > Hi all, > > > > I'd like to begin voting on KIP-507: > > > > >

Re: [DISCUSS] Apache Kafka 2.4.0 release

Hi Manikumar, Please add KIP-517 as it is now accepted too https://cwiki.apache.org/confluence/display/KAFKA/KIP-517%3A+Add+consumer+metrics+to+observe+user+poll+behavior Thanks. Regards, Kevin On Tue, Sep 24, 2019 at 7:25 AM Manikumar wrote: > Hi All, > > Just a reminder that tomorrow (Sep

Re: [VOTE] KIP-528: Deprecate PartitionGrouper configuration and interface

Thanks for voting. +1 (binding) for myself. I am closing this vote. The KIP is accepted with 4 binding (Gouzhang, Bill, Gwen, Matthias) and 2 non-binding (John, Bruno) votes. -Matthias On 9/20/19 10:41 AM, Gwen Shapira wrote: > +1 (binding) > > On Thu, Sep 19, 2019 at 4:28 PM Matthias J.

[VOTE] KIP-524: Allow users to choose config source when describing configs

Hi All, I'm starting a vote for KIP-524, which is a small change to the config tool: https://cwiki.apache.org/confluence/display/KAFKA/KIP-524%3A+Allow+users+to+choose+config+source+when+describing+configs . +1 from me. Thanks, Jason

Build failed in Jenkins: kafka-2.2-jdk8 #167

See Changes: [github] HOTFIX: fix Kafka Streams upgrade note for broker backward compatibility -- Started by an SCM change [EnvInject] - Loading node environment variables.

Re: [VOTE] KIP-507: Securing Internal Connect REST Endpoints

Nicely done! +1 (non-binding) Konstantine On Tue, Sep 24, 2019 at 9:10 AM Rajini Sivaram wrote: > Thanks for the KIP, Chris! > > +1 (binding) > > Regards, > > Rajini > > On Tue, Sep 24, 2019 at 3:12 PM Randall Hauch wrote: > > > Thanks, Chris! > > > > +1 (binding) > > > > On Thu, Sep 19,

[jira] [Created] (KAFKA-8940) Flaky SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

Guozhang Wang created KAFKA-8940: Summary: Flaky SmokeTestDriverIntegrationTest.shouldWorkWithRebalance Key: KAFKA-8940 URL: https://issues.apache.org/jira/browse/KAFKA-8940 Project: Kafka

Re: [VOTE] KIP-521: Redirect Connect log4j messages also to a file by default

Thanks everyone! After 3+ business days since this thread started, I'm concluding the vote on KIP-521. The KIP has passed with: 3 binding votes from Gwen, Randall and Bill. 1 non-binding vote from Mitchell. Thank you all for voting! Best, Konstantine On Fri, Sep 20, 2019 at 5:50 PM Bill

Re: [DISCUSS] KIP-515: Reorganize checkpoint system in log cleaner to be per partition

Hi Richard, It would be unsatisfying to make a big change to the checkpointing logic in order to handle only one case of this problem, right? I did have one idea about how to do this. It's a bit of a hack, but keep an open mind ;). The basic problem is having somewhere to embed the delete

Re: [VOTE] KIP-479 Add Materialized to Join

Adding a +1 (binding) from myself. Thanks to everyone for voting. I am closing this vote. The KIP is accepted with 3 binding (Gouzhang, Bill, Matthias) and 1 non-binding (John) votes. Thanks, Bill On Thu, Sep 19, 2019 at 9:23 PM John Roesler wrote: > FWIW, I'm also +1 (non-binding). > >

[jira] [Created] (KAFKA-8939) Flaky test ReassignPartitionsClusterTest#shouldTriggerReassignmentWithZnodePrecedenceOnControllerStartup

Sophie Blee-Goldman created KAFKA-8939: -- Summary: Flaky test ReassignPartitionsClusterTest#shouldTriggerReassignmentWithZnodePrecedenceOnControllerStartup Key: KAFKA-8939 URL:

[jira] [Created] (KAFKA-8937) Flaky Test SaslPlainSslEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl

Sophie Blee-Goldman created KAFKA-8937: -- Summary: Flaky Test SaslPlainSslEndToEndAuthorizationTest#testNoDescribeProduceOrConsumeWithoutTopicDescribeAcl Key: KAFKA-8937 URL:

[jira] [Reopened] (KAFKA-7965) Flaky Test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

[ https://issues.apache.org/jira/browse/KAFKA-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman reopened KAFKA-7965: Assignee: (was: Jason Gustafson) Saw another failure in PR builder (2.4) >

[jira] [Created] (KAFKA-8938) Connect - Improve Memory Allocations During Struct Validation

Auston McReynolds created KAFKA-8938: Summary: Connect - Improve Memory Allocations During Struct Validation Key: KAFKA-8938 URL: https://issues.apache.org/jira/browse/KAFKA-8938 Project: Kafka

Re: [DISCUSS] KIP-502: Connect SinkTask.put(...) to specify ArrayList in Signature

Almog, I think that's a great point -- I will update the KIP to reflect your suggestion! On Tue, Sep 24, 2019 at 12:46 PM Almog Gavra wrote: > Thanks Cyrus! I think this change is a good step in hardening the API. I do > believe that APIs should be defined by functionality and not performance >

[jira] [Resolved] (KAFKA-8880) Augment Consumer.committed(partition) to allow multiple partitions

[ https://issues.apache.org/jira/browse/KAFKA-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8880. -- Fix Version/s: 2.4.0 Assignee: Guozhang Wang Resolution: Fixed > Augment

Re: [VOTE] KIP-507: Securing Internal Connect REST Endpoints

+1 (binding) A couple of comments on the details: - I think this might be the first time we're adding a new message type to the config topic. Might be worth noting that (somewhat unfortunately) we currently log unknown keys as an error. Kinda unclear whether it should be an error or warn (since

Re: [DISCUSS] KIP-502: Connect SinkTask.put(...) to specify ArrayList in Signature

Thanks Cyrus! I think this change is a good step in hardening the API. I do believe that APIs should be defined by functionality and not performance characteristics, so I'd prefer using List<> over ArrayList<> (the alternative you mention in rejected). That also gives us leeway in the future to

Re: [VOTE] 2.3.1 RC0

Hi David, Thanks for running the release. I think we should consider getting this bug fixed: https://issues.apache.org/jira/browse/KAFKA-8896. The impact of this bug is that consumer groups cannot commit offsets or rebalance. The patch should be ready shortly. Thanks, Jason On Fri, Sep 13,

Build failed in Jenkins: kafka-2.3-jdk8 #111

See Changes: [matthias] HOTFIX: fix Kafka Streams upgrade note for broker backward compatibility -- [...truncated 2.74 MB...]

Build failed in Jenkins: kafka-trunk-jdk11 #831

See Changes: [github] KAFKA-8848; Update system tests to use new AclAuthorizer (#7374) -- [...truncated 2.80 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #3921

See Changes: [github] HOTFIX: fix Kafka Streams upgrade note for broker backward compatibility -- [...truncated 2.99 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #3922

See Changes: [github] KAFKA-8880: Add overloaded function of Consumer.committed (#7304) [wangguoz] KAFKA-8580: Compute RocksDB metrics (#7263) [wangguoz] KAFKA-8179: do not suspend standby tasks during

Build failed in Jenkins: kafka-trunk-jdk11 #832

See Changes: [github] HOTFIX: fix Kafka Streams upgrade note for broker backward compatibility [github] KAFKA-8880: Add overloaded function of Consumer.committed (#7304) [wangguoz] KAFKA-8580: Compute RocksDB