Re: [VOTE] 2.1.0 RC1

2018-11-16 Thread Dong Lin
Hey Eno, Vahid and everyone, Thanks for reporting the test error! https://builds.apache.org/job/kafka-2.1-jdk8/ shows the list of recent unit test runs. 7 out of 10 recent runs have passed all tests. Each of the three runs shows one unique flaky test failure. I have opened umbrella JIRA

[jira] [Resolved] (KAFKA-7402) Kafka Streams should implement AutoCloseable where appropriate

2018-11-16 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7402. Resolution: Fixed Fix Version/s: 2.2.0 > Kafka Streams should implement

Build failed in Jenkins: kafka-trunk-jdk8 #3206

2018-11-16 Thread Apache Jenkins Server
See Changes: [wangguoz] * MINOR: Catching null pointer exception for empty leader URL when [colin] KAFKA-7402: Implement KIP-376 AutoCloseable additions -- [...truncated

[jira] [Created] (KAFKA-7651) Flaky test SaslSslAdminClientIntegrationTest.testMinimumRequestTimeouts

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7651: --- Summary: Flaky test SaslSslAdminClientIntegrationTest.testMinimumRequestTimeouts Key: KAFKA-7651 URL: https://issues.apache.org/jira/browse/KAFKA-7651 Project: Kafka

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-11-16 Thread Guozhang Wang
Thanks Florian! I will take a look at the PR. On Mon, Nov 12, 2018 at 2:44 PM Florian Hussonnois wrote: > Hi Matthias, > > Sorry I was absent for a while. I have started a new PR for this KIP. It is > still in progress for now. I'm working on it. > https://github.com/apache/kafka/pull/5909 >

[jira] [Created] (KAFKA-7650) make "auto.create.topics.enable" dynamically configurable.

2018-11-16 Thread xiongqi wu (JIRA)
xiongqi wu created KAFKA-7650: - Summary: make "auto.create.topics.enable" dynamically configurable. Key: KAFKA-7650 URL: https://issues.apache.org/jira/browse/KAFKA-7650 Project: Kafka Issue

Re: Request for permissions to add KIP for user shnguyen

2018-11-16 Thread Guozhang Wang
Hello Shawn, You should be able to create KIPs now. Cheers, Guozhang On Fri, Nov 16, 2018 at 3:27 PM Shawn Nguyen wrote: > Hi there, > Can you grant me permissions for adding a KIP page? My username is shnguyen > and email is shavvnnngu...@gmail.com on Confluence. > > Thanks, > Shawn > --

Request for permissions to add KIP for user shnguyen

2018-11-16 Thread Shawn Nguyen
Hi there, Can you grant me permissions for adding a KIP page? My username is shnguyen and email is shavvnnngu...@gmail.com on Confluence. Thanks, Shawn

[jira] [Created] (KAFKA-7649) Flaky test SslEndToEndAuthorizationTest.testNoProduceWithDescribeAcl

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7649: --- Summary: Flaky test SslEndToEndAuthorizationTest.testNoProduceWithDescribeAcl Key: KAFKA-7649 URL: https://issues.apache.org/jira/browse/KAFKA-7649 Project: Kafka

[jira] [Created] (KAFKA-7648) Flaky test DeleteTopicsRequestTest.testValidDeleteTopicRequests

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7648: --- Summary: Flaky test DeleteTopicsRequestTest.testValidDeleteTopicRequests Key: KAFKA-7648 URL: https://issues.apache.org/jira/browse/KAFKA-7648 Project: Kafka Issue

[jira] [Created] (KAFKA-7647) Flaky test LogCleanerParameterizedIntegrationTest.testCleansCombinedCompactAndDeleteTopic

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7647: --- Summary: Flaky test LogCleanerParameterizedIntegrationTest.testCleansCombinedCompactAndDeleteTopic Key: KAFKA-7647 URL: https://issues.apache.org/jira/browse/KAFKA-7647

[jira] [Created] (KAFKA-7646) Flaky test SaslOAuthBearerSslEndToEndAuthorizationTest.testNoConsumeWithDescribeAclViaSubscribe

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7646: --- Summary: Flaky test SaslOAuthBearerSslEndToEndAuthorizationTest.testNoConsumeWithDescribeAclViaSubscribe Key: KAFKA-7646 URL: https://issues.apache.org/jira/browse/KAFKA-7646

[jira] [Created] (KAFKA-7645) Fix flaky unit test for 2.1 branch

2018-11-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7645: --- Summary: Fix flaky unit test for 2.1 branch Key: KAFKA-7645 URL: https://issues.apache.org/jira/browse/KAFKA-7645 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-7644) Worker Re balance enhancements

2018-11-16 Thread satya (JIRA)
satya created KAFKA-7644: Summary: Worker Re balance enhancements Key: KAFKA-7644 URL: https://issues.apache.org/jira/browse/KAFKA-7644 Project: Kafka Issue Type: Improvement Components:

[jira] [Created] (KAFKA-7642) Kafka Connect - graceful shutdown of distributed worker

2018-11-16 Thread satya (JIRA)
satya created KAFKA-7642: Summary: Kafka Connect - graceful shutdown of distributed worker Key: KAFKA-7642 URL: https://issues.apache.org/jira/browse/KAFKA-7642 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-7643) Connectors do not unload even when tasks fail in kafka connect

2018-11-16 Thread satya (JIRA)
satya created KAFKA-7643: Summary: Connectors do not unload even when tasks fail in kafka connect Key: KAFKA-7643 URL: https://issues.apache.org/jira/browse/KAFKA-7643 Project: Kafka Issue Type:

Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2018-11-16 Thread Bill Bejeck
Hi John, Thanks for the update, I'm +1 on changes and my +1 vote stands. -Bill On Fri, Nov 16, 2018 at 4:19 PM John Roesler wrote: > Hi all, sorry to do this again, but during review of the code to add the > metrics proposed in this KIP, the reviewers and I noticed some > inconsistencies and

Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2018-11-16 Thread John Roesler
Hi all, sorry to do this again, but during review of the code to add the metrics proposed in this KIP, the reviewers and I noticed some inconsistencies and drawbacks of the metrics I proposed in the KIP. Here's the diff:

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-16 Thread Boyang Chen
Thanks Colin and Jason for the further inputs! I understand that k8 integration will be the long term solution for KStream to serve as a streaming platform, and I buy in the idea of "pre-registration" which could save us from using timeout tricks. > If we have a way to indicate the > expected

[jira] [Created] (KAFKA-7640) Kafka stream interactive query not returning data when state is backed by rocksdb

2018-11-16 Thread hitesh gollahalli bachanna (JIRA)
hitesh gollahalli bachanna created KAFKA-7640: - Summary: Kafka stream interactive query not returning data when state is backed by rocksdb Key: KAFKA-7640 URL:

[jira] [Created] (KAFKA-7641) Add `group.max.size` to cap group metadata on broker

2018-11-16 Thread Boyang Chen (JIRA)
Boyang Chen created KAFKA-7641: -- Summary: Add `group.max.size` to cap group metadata on broker Key: KAFKA-7641 URL: https://issues.apache.org/jira/browse/KAFKA-7641 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-16 Thread Colin McCabe
As Jason said, there are definitely scenarios where we know how many group members we expect ahead of time. It would be nice if we could distinguish between the error case of "we expected 5 clients in the group, but one failed" and a case like "4 clients started up quickly but the 5th took an

[jira] [Created] (KAFKA-7639) Read one request at a time from socket to reduce broker memory usage

2018-11-16 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-7639: - Summary: Read one request at a time from socket to reduce broker memory usage Key: KAFKA-7639 URL: https://issues.apache.org/jira/browse/KAFKA-7639 Project: Kafka

[jira] [Created] (KAFKA-7638) Trogdor - Support mass task creation endpoint

2018-11-16 Thread Stanislav Kozlovski (JIRA)
Stanislav Kozlovski created KAFKA-7638: -- Summary: Trogdor - Support mass task creation endpoint Key: KAFKA-7638 URL: https://issues.apache.org/jira/browse/KAFKA-7638 Project: Kafka

[jira] [Created] (KAFKA-7637) ERROR Error while writing to checkpoint file due to too many open files

2018-11-16 Thread Sander van Loo (JIRA)
Sander van Loo created KAFKA-7637: - Summary: ERROR Error while writing to checkpoint file due to too many open files Key: KAFKA-7637 URL: https://issues.apache.org/jira/browse/KAFKA-7637 Project:

[jira] [Created] (KAFKA-7636) Allow consumer to update maxPollRecords value

2018-11-16 Thread Kcirtap Seven (JIRA)
Kcirtap Seven created KAFKA-7636: Summary: Allow consumer to update maxPollRecords value Key: KAFKA-7636 URL: https://issues.apache.org/jira/browse/KAFKA-7636 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-7565) NPE in KafkaConsumer

2018-11-16 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7565. --- Resolution: Duplicate Fix Version/s: (was: 2.2.0) [~avakhrenev] Thanks for

[jira] [Resolved] (KAFKA-7576) Dynamic update of replica fetcher threads may fail to start/close fetchers

2018-11-16 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7576. --- Resolution: Fixed Reviewer: Jason Gustafson > Dynamic update of replica fetcher

Build failed in Jenkins: kafka-trunk-jdk8 #3205

2018-11-16 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6774; Improve the default group id behavior in KafkaConsumer -- [...truncated 2.59 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Created] (KAFKA-7635) FetcherThread stops processing after "Error processing data for partition"

2018-11-16 Thread Steven Aerts (JIRA)
Steven Aerts created KAFKA-7635: --- Summary: FetcherThread stops processing after "Error processing data for partition" Key: KAFKA-7635 URL: https://issues.apache.org/jira/browse/KAFKA-7635 Project:

[jira] [Resolved] (KAFKA-6774) Improve default groupId behavior in consumer

2018-11-16 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6774. Resolution: Fixed > Improve default groupId behavior in consumer >

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-16 Thread Jason Gustafson
> > If we initialize a set of member names (I assume ids = names here) on > broker through Admin API, the client needs to pick up this information > simultaneously which I doubt if there is a generic way to achieve that? It > would also make the scaling operations difficult if we need to define