[jira] [Created] (KAFKA-8563) Minor: Remove method call in netoworkSend

2019-06-18 Thread karan kumar (JIRA)
karan kumar created KAFKA-8563: -- Summary: Minor: Remove method call in netoworkSend Key: KAFKA-8563 URL: https://issues.apache.org/jira/browse/KAFKA-8563 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-8559) PartitionStates.partitionStates cause array grow allocation.

2019-06-18 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-8559. Resolution: Fixed Fix Version/s: 2.4.0 > PartitionStates.partitionStates cause array grow

[DISCUSS] KIP-479: Add Materialized to Join

2019-06-18 Thread Bill Bejeck
All, I'd like to start a discussion for adding a Materialized configuration object to KStream.join for naming state stores involved in joins. https://cwiki.apache.org/confluence/display/KAFKA/KIP-479%3A+Add+Materialized+to+Join Your comments and suggestions are welcome. Thanks, Bill

[jira] [Created] (KAFKA-8562) SASL_SSL still performs reverse DNS lookup despite KAFKA-5051

2019-06-18 Thread Badai Aqrandista (JIRA)
Badai Aqrandista created KAFKA-8562: --- Summary: SASL_SSL still performs reverse DNS lookup despite KAFKA-5051 Key: KAFKA-8562 URL: https://issues.apache.org/jira/browse/KAFKA-8562 Project: Kafka

[jira] [Created] (KAFKA-8561) Make Kafka Pluggable with customized Keystore/TrustStore

2019-06-18 Thread Thomas Zhou (JIRA)
Thomas Zhou created KAFKA-8561: -- Summary: Make Kafka Pluggable with customized Keystore/TrustStore Key: KAFKA-8561 URL: https://issues.apache.org/jira/browse/KAFKA-8561 Project: Kafka Issue

Re: Become a contributer

2019-06-18 Thread Bill Bejeck
Hi Anastasia, Thanks for your interest in Apache Kafka. You're all set now. -Bill On Mon, Jun 17, 2019 at 4:36 PM Anastasia Vela wrote: > My user ID is anastasiavela. > > Anastasia > > On Thu, Jun 13, 2019 at 11:18 AM Anastasia Vela > wrote: > > > Hi, > > > > I would like to contribute to

Re: Request for Contributor Permissions

2019-06-18 Thread Bill Bejeck
Hi Thomas, You're all set now. Thanks, Bill On Tue, Jun 18, 2019 at 8:41 PM Thomas Zhou wrote: > Hi, > > I want to contribute to Kafka, could you please give me contributor > permission? > My Jira id is - thomas930410 > > > Thanks, > Thomas

Request for Contributor Permissions

2019-06-18 Thread Thomas Zhou
Hi, I want to contribute to Kafka, could you please give me contributor permission? My Jira id is - thomas930410 Thanks, Thomas

Build failed in Jenkins: kafka-trunk-jdk11 #642

2019-06-18 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: fix consumer group failure message typo (#6962) -- [...truncated 2.52 MB...] org.apache.kafka.streams.StreamsConfigTest >

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Thanks, Konstantine. I reworked the wording a bit -- take a look. best, C. On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > Thanks Colin. > Great initiative! > > Here's a small correction (between **) for KIP-415 with a small suggestion > as well (between _ _): > > In Kafka

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Thanks, Swen. Fixed. C. On Tue, Jun 18, 2019, at 13:50, Swen Moczarski wrote: > Nice overview! > > I found some typos: > rbmainder > bmits > implbmentation > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen >: > > > One typo: > > KIP-428: Add in-mbmory window store > > should be >

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Thanks, Boyang! Fixed. C. On Tue, Jun 18, 2019, at 13:43, Boyang Chen wrote: > One typo: > KIP-428: Add in-mbmory window store > should be > KIP-428: Add in-memory window store > > > > From: Colin McCabe > Sent: Wednesday, June 19, 2019 4:22 AM > To:

Build failed in Jenkins: kafka-trunk-jdk8 #3733

2019-06-18 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-8448: Cancel PeriodicProducerExpirationCheck when closing a Log -- [...truncated 3.98 MB...]

[jira] [Resolved] (KAFKA-8491) Bump up Consumer Protocol to v2 (part 1)

2019-06-18 Thread Sophie Blee-Goldman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-8491. Resolution: Fixed > Bump up Consumer Protocol to v2 (part 1) >

Request for Contributor Permissions

2019-06-18 Thread Thomas Zhou
Hi, I want to contribute to Kafka, could you please give me contributor permission? My Jira id is - thomas930410 Thanks, Thomas

[jira] [Created] (KAFKA-8560) The Kafka protocol generator should support common structures

2019-06-18 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-8560: -- Summary: The Kafka protocol generator should support common structures Key: KAFKA-8560 URL: https://issues.apache.org/jira/browse/KAFKA-8560 Project: Kafka

[jira] [Created] (KAFKA-8559) PartitionStates.partitionStates cause array grow allocation.

2019-06-18 Thread Wenshuai Hou (JIRA)
Wenshuai Hou created KAFKA-8559: --- Summary: PartitionStates.partitionStates cause array grow allocation. Key: KAFKA-8559 URL: https://issues.apache.org/jira/browse/KAFKA-8559 Project: Kafka

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

2019-06-18 Thread John Roesler
Hi Daniyar, That's a very clever solution! One observation is that, now, this is what we might call a polymorphic serde. That is, you're detecting the actual concrete type and then promising to produce the exact same concrete type on read. There are some inherent problems with this approach,

Build failed in Jenkins: kafka-trunk-jdk11 #641

2019-06-18 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-8448: Cancel PeriodicProducerExpirationCheck when closing a Log -- [...truncated 2.96 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Konstantine Karantasis
Thanks Colin. Great initiative! Here's a small correction (between **) for KIP-415 with a small suggestion as well (between _ _): In Kafka Connect, worker tasks are distributed among the available worker nodes. When a connector is reconfigured or a new connector is deployed _as well as when a

[jira] [Created] (KAFKA-8558) KIP-479 - Add Materialized Overload to KStream#Join

2019-06-18 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-8558: -- Summary: KIP-479 - Add Materialized Overload to KStream#Join Key: KAFKA-8558 URL: https://issues.apache.org/jira/browse/KAFKA-8558 Project: Kafka Issue Type:

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Swen Moczarski
Nice overview! I found some typos: rbmainder bmits implbmentation Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen : > One typo: > KIP-428: Add in-mbmory window store > should be > KIP-428: Add in-memory window store > > > > From: Colin McCabe > Sent:

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Boyang Chen
One typo: KIP-428: Add in-mbmory window store should be KIP-428: Add in-memory window store From: Colin McCabe Sent: Wednesday, June 19, 2019 4:22 AM To: dev@kafka.apache.org Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release Sorry, I copied

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Sorry, I copied the wrong URL at first. Try this URL instead: https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache best, Colin On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > Hmm. I'm looking to see if there's any way to open up the permissions... :| > > > > On

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Hmm. I'm looking to see if there's any way to open up the permissions... :| C. On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > It’s asking for credentials...? > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > Hi all, > > > > I've written up a preliminary blog post about the

[jira] [Created] (KAFKA-8557) Support named listeners in system tests

2019-06-18 Thread Stanislav Vodetskyi (JIRA)
Stanislav Vodetskyi created KAFKA-8557: -- Summary: Support named listeners in system tests Key: KAFKA-8557 URL: https://issues.apache.org/jira/browse/KAFKA-8557 Project: Kafka Issue

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread M. Manna
It’s asking for credentials...? On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > Hi all, > > I've written up a preliminary blog post about the upcoming Apache Kafka > 2.3.0 release. Take a look and let me know what you think. > > >

Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread Colin McCabe
Hi all, I've written up a preliminary blog post about the upcoming Apache Kafka 2.3.0 release. Take a look and let me know what you think. https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache cheers, Colin

Re: [DISCUSS] KIP-459: Improve KafkaStreams#close

2019-06-18 Thread Dongjin Lee
Hello. I just uploaded the draft implementation of the three proposed alternatives. - Type A: define a close timeout constant - https://github.com/dongjinleekr/kafka/tree/feature/KAFKA-7996-a - Type B: Provide a new configuration option, 'close.wait.ms' -

[jira] [Reopened] (KAFKA-4222) Transient failure in QueryableStateIntegrationTest.queryOnRebalance

2019-06-18 Thread Boyang Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen reopened KAFKA-4222: Assignee: (was: Damian Guy) > Transient failure in

[jira] [Created] (KAFKA-8556) Add system tests for assignment stickiness validation

2019-06-18 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-8556: -- Summary: Add system tests for assignment stickiness validation Key: KAFKA-8556 URL: https://issues.apache.org/jira/browse/KAFKA-8556 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-06-18 Thread Guozhang Wang
Hello Bruno, I've read through the aggregation section and I think they look good to me. There are a few minor comments about the wiki page itself: 1) A state store might consist of multiple state stores -> You mean a `logical` state store be consistent of multiple `physical` store instances?

[jira] [Resolved] (KAFKA-8448) Too many kafka.log.Log instances (Memory Leak)

2019-06-18 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe resolved KAFKA-8448. Resolution: Fixed Fix Version/s: 2.4.0 > Too many kafka.log.Log instances (Memory

Re: [VOTE] KIP-475: New Metric to Measure Number of Tasks on a Connector

2019-06-18 Thread Guozhang Wang
Cyrus, thanks for the updates, +1. On Mon, Jun 17, 2019 at 10:58 PM Cyrus Vafadari wrote: > Many thanks for the feedback. Per Gwen's suggestion, I've updated the KIP > to specify that the task count will be per-worker (no additional MBean tag, > since each process is a worker) and per-connector

Build failed in Jenkins: kafka-trunk-jdk8 #3732

2019-06-18 Thread Apache Jenkins Server
See Changes: [rhauch] MINOR: Update docs for KIP-415 (#6958) -- [...truncated 1.46 MB...] kafka.log.LogCleanerParameterizedIntegrationTest >

[jira] [Created] (KAFKA-8555) Flaky test ExampleConnectIntegrationTest#testSourceConnector

2019-06-18 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-8555: -- Summary: Flaky test ExampleConnectIntegrationTest#testSourceConnector Key: KAFKA-8555 URL: https://issues.apache.org/jira/browse/KAFKA-8555 Project: Kafka

Re: [VOTE] KIP-476: Add Java AdminClient interface

2019-06-18 Thread Ismael Juma
I agree with Ryanne, I think we should avoid deprecating AdminClient and causing so much churn for users who don't actually care about this niche use case. Ismael On Tue, Jun 18, 2019 at 6:43 AM Andy Coates wrote: > Hi Ryanne, > > If we don't change the client code, then everywhere will still

Re: [VOTE] KIP-476: Add Java AdminClient interface

2019-06-18 Thread Ismael Juma
I don't agree with this change. The idea that an interface cannot have a default implementation is outdated in my view. Can someone provide any benefit to introducing a separate class for the factory method? Ismael On Mon, Jun 17, 2019 at 10:07 AM Andy Coates wrote: > Hi All, > > I've updated

[jira] [Created] (KAFKA-8554) Generate Topic/Key from Json Transform

2019-06-18 Thread Gokhan Sari (JIRA)
Gokhan Sari created KAFKA-8554: -- Summary: Generate Topic/Key from Json Transform Key: KAFKA-8554 URL: https://issues.apache.org/jira/browse/KAFKA-8554 Project: Kafka Issue Type: New Feature

Re: [VOTE] KIP-476: Add Java AdminClient interface

2019-06-18 Thread Andy Coates
Hi Ryanne, If we don't change the client code, then everywhere will still expect subclasses of `AdminClient`, so the interface will be of no use, i.e. I can't write a class that implements the new interface and pass it to the client code. Thanks, Andy On Mon, 17 Jun 2019 at 19:01, Ryanne Dolan

[VOTE] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-06-18 Thread Bruno Cadonna
Hi, I would like to start the voting on KIP-471: https://cwiki.apache.org/confluence/display/KAFKA/KIP-471%3A+Expose+RocksDB+Metrics+in+Kafka+Streams You can find the discussion here:

[jira] [Resolved] (KAFKA-8488) FetchSessionHandler logging create 73 mb allocation in TLAB which could be no op

2019-06-18 Thread Kamal Chandraprakash (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash resolved KAFKA-8488. - Resolution: Fixed > FetchSessionHandler logging create 73 mb allocation in TLAB

[jira] [Created] (KAFKA-8553) Kafka Connect Schema Compatibility Checks for Name Changes

2019-06-18 Thread Omer van Kloeten (JIRA)
Omer van Kloeten created KAFKA-8553: --- Summary: Kafka Connect Schema Compatibility Checks for Name Changes Key: KAFKA-8553 URL: https://issues.apache.org/jira/browse/KAFKA-8553 Project: Kafka

Build failed in Jenkins: kafka-2.3-jdk8 #53

2019-06-18 Thread Apache Jenkins Server
See Changes: [rhauch] MINOR: Update docs for KIP-415 (#6958) -- [...truncated 2.91 MB...] kafka.utils.CoreUtilsTest > testUrlSafeBase64EncodeUUID PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #3731

2019-06-18 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: rename subscription construction function (#6954) -- [...truncated 4.91 MB...] kafka.log.LogSegmentTest > testTruncateFull PASSED

Jenkins build is back to normal : kafka-trunk-jdk11 #640

2019-06-18 Thread Apache Jenkins Server
See

Continuing of Kafka producer transaction after producer restart

2019-06-18 Thread Viliam Durina
The KafkaProducer.initTransactions() by default rolls back the transaction with the same transactional.id. I need an ability to commit such a transaction. I'm using Kafka as a part of a two-phase commit and if all participants voted "yes" in the pre-commit phase and the Kafka producer crashed

[jira] [Created] (KAFKA-8552) Use SASL authentication in ConfigCommand for connection to zookeeper

2019-06-18 Thread Tim Lansbergen (JIRA)
Tim Lansbergen created KAFKA-8552: - Summary: Use SASL authentication in ConfigCommand for connection to zookeeper Key: KAFKA-8552 URL: https://issues.apache.org/jira/browse/KAFKA-8552 Project: Kafka