Re: Kafka streams issue

2019-06-11 Thread Brian Putt
The application just hangs (we let it sit for ~1 hour, small dataset as we're testing), we can restart it listening to 1 of the 3 topics we start it with and it chugs along, no problem. The same code is executed as separate application.ids listening to other topics without any issues. We'll try to

[jira] [Created] (KAFKA-8527) add dynamic maintenance broker config

2019-06-11 Thread xiongqi wu (JIRA)
xiongqi wu created KAFKA-8527: - Summary: add dynamic maintenance broker config Key: KAFKA-8527 URL: https://issues.apache.org/jira/browse/KAFKA-8527 Project: Kafka Issue Type: Improvement

Re: [DISCUSSION] KIP-418: A method-chaining way to branch KStream

2019-06-11 Thread Matthias J. Sax
Thanks for the input John! > under your suggestion, it seems that the name is required If you want to get the `KStream` as part of the `Map` back using a `Function`, yes. If you follow the "embedded chaining" pattern using a `Consumer`, no. Allowing for a default name via `split()` can of

[jira] [Created] (KAFKA-8526) Broker may select a failed dir for new replica even in the presence of other live dirs

2019-06-11 Thread Anna Povzner (JIRA)
Anna Povzner created KAFKA-8526: --- Summary: Broker may select a failed dir for new replica even in the presence of other live dirs Key: KAFKA-8526 URL: https://issues.apache.org/jira/browse/KAFKA-8526

Build failed in Jenkins: kafka-2.2-jdk8 #137

2019-06-11 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-4893; Fix deletion and moving of topics with long names -- [...truncated 2.74 MB...] kafka.controller.ReplicaStateMachineTest >

Re: Kafka streams issue

2019-06-11 Thread Matthias J. Sax
What do you exactly observe? - Does the application rebalance correctly? - Does it start processing? - Anything in the logs about the status of the application? -Matthias On 6/10/19 6:19 PM, Brian Putt wrote: > Hello, > > I'm working with the kafka streams api and am running into issues

Re: [DISCUSS] KIP-466: Add support for List serialization and deserialization

2019-06-11 Thread Matthias J. Sax
Seems you missed my reply from 31/6. C below: > (1) The current PR suggests to always instantiate an `ArrayList` -- > however, if a user wants to use any other list implementation, they have > no way to specify this. It might be good to either allow users to > specify the list-type on the

Build failed in Jenkins: kafka-2.1-jdk8 #205

2019-06-11 Thread Apache Jenkins Server
See Changes: [cmccabe] KAFKA-4893; Fix deletion and moving of topics with long names -- [...truncated 2.54 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Created] (KAFKA-8525) Make log in Partion non-optional

2019-06-11 Thread Vikas Singh (JIRA)
Vikas Singh created KAFKA-8525: -- Summary: Make log in Partion non-optional Key: KAFKA-8525 URL: https://issues.apache.org/jira/browse/KAFKA-8525 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-476: Add Java AdminClient interface

2019-06-11 Thread Colin McCabe
On Tue, Jun 11, 2019, at 12:12, Andy Coates wrote: > Thanks for the response Colin, > > > What specific benefits do we get from transitioning to using an interface > > rather than an abstract class? > > This is covered in the KLIP: "An AdminClient interface has several > advantages over an

[VOTE] KIP-466: Add support for List serialization and deserialization

2019-06-11 Thread Development
Hello, I want to start a vote for KIP-466 > "Add

Build failed in Jenkins: kafka-trunk-jdk8 #3717

2019-06-11 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8487: Only request re-join on REBALANCE_IN_PROGRESS in -- [...truncated 2.14 MB...] org.apache.kafka.streams.scala.WordCountTest >

Re: [VOTE] KIP-476: Add Java AdminClient interface

2019-06-11 Thread Andy Coates
Thanks for the response Colin, > What specific benefits do we get from transitioning to using an interface rather than an abstract class? This is covered in the KLIP: "An AdminClient interface has several advantages over an abstract base class, most notably allowing multi-inheritance and the use

Build failed in Jenkins: kafka-trunk-jdk8 #3716

2019-06-11 Thread Apache Jenkins Server
See Changes: [bbejeck] KAFKA-8501: Removing key and value from exception message (#6904) -- [...truncated 2.54 MB...]

[jira] [Resolved] (KAFKA-8487) Consumer should not resetGeneration upon REBALANCE_IN_PROGRESS in commit response handler

2019-06-11 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8487. -- Resolution: Fixed Fix Version/s: 2.4.0 > Consumer should not resetGeneration upon

Re: [DISCUSS] KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint

2019-06-11 Thread Matthias J. Sax
Boyang, Thanks for pushing this KIP. Re-reading it, it only allows to specify number of partitions for internally created repartition topics. I still believe, that using `through()` in it's current form might be too clumsy for some cases, because (talking to users) it's a regular use-case to

[jira] [Resolved] (KAFKA-7469) Broker keeps group rebalance after adding FS

2019-06-11 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-7469. - Resolution: Fixed > Broker keeps group rebalance after adding FS >

[jira] [Created] (KAFKA-8524) Zookeeper Acl

2019-06-11 Thread sebastien diaz (JIRA)
sebastien diaz created KAFKA-8524: - Summary: Zookeeper Acl Key: KAFKA-8524 URL: https://issues.apache.org/jira/browse/KAFKA-8524 Project: Kafka Issue Type: Bug Reporter:

[jira] [Resolved] (KAFKA-8501) Remove key and value from exception message

2019-06-11 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8501. Resolution: Fixed > Remove key and value from exception message >

Jenkins build is back to normal : kafka-trunk-jdk8 #3715

2019-06-11 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-8523) InsertField transformation fails when encountering tombstone event

2019-06-11 Thread Gunnar Morling (JIRA)
Gunnar Morling created KAFKA-8523: - Summary: InsertField transformation fails when encountering tombstone event Key: KAFKA-8523 URL: https://issues.apache.org/jira/browse/KAFKA-8523 Project: Kafka

35023...@qq.com

2019-06-11 Thread ????
35023...@qq.com

[jira] [Resolved] (KAFKA-8193) Flaky Test MetricsIntegrationTest#testStreamMetricOfWindowStore

2019-06-11 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8193. Resolution: Duplicate > Flaky Test MetricsIntegrationTest#testStreamMetricOfWindowStore >

Jenkins build is back to normal : kafka-2.0-jdk8 #276

2019-06-11 Thread Apache Jenkins Server
See