[jira] [Created] (KAFKA-8253) Unrecoverable state when a broker's INPUT access is blocked (Zombie broker)

2019-04-18 Thread Gowtham Gutha (JIRA)
Gowtham Gutha created KAFKA-8253: Summary: Unrecoverable state when a broker's INPUT access is blocked (Zombie broker) Key: KAFKA-8253 URL: https://issues.apache.org/jira/browse/KAFKA-8253 Project:

[jira] [Created] (KAFKA-8256) Replace Heartbeat request/response with automated protocol

2019-04-18 Thread Mickael Maison (JIRA)
Mickael Maison created KAFKA-8256: - Summary: Replace Heartbeat request/response with automated protocol Key: KAFKA-8256 URL: https://issues.apache.org/jira/browse/KAFKA-8256 Project: Kafka

[jira] [Created] (KAFKA-8258) Verbose logs in org.apache.kafka.clients.consumer.internals.Fetcher

2019-04-18 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created KAFKA-8258: --- Summary: Verbose logs in org.apache.kafka.clients.consumer.internals.Fetcher Key: KAFKA-8258 URL: https://issues.apache.org/jira/browse/KAFKA-8258 Project: Kafka

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread Patrik Kleindl
Hi John Thanks for your feedback It's C, it does not consume the messages in contrast to the readOutput. Is it a requirement to do so? That's why I picked a different name so the difference is more noticeable. I will add that to the JavaDoc. I see your point regarding future changes, that's why

Re: [VOTE] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-18 Thread Guozhang Wang
+1 (binding). Thanks. On Thu, Apr 18, 2019 at 10:48 AM John Roesler wrote: > Thanks, Maarten! > > +1 (non-binding) > > -John > > On Wed, Apr 17, 2019 at 1:45 PM Bill Bejeck wrote: > > > Thanks for the KIP. > > > > +1(binding) > > > > -Bill > > > > On Wed, Apr 17, 2019 at 12:58 PM Bruno

Jenkins build is back to normal : kafka-trunk-jdk8 #3568

2019-04-18 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread Matthias J. Sax
I am not sure if (C) is the best option to pick. What is the reasoning to suggest (C) over the other options? It seems that users cannot clear buffered output using option (C). This might it make difficult to write tests. The original Jira tickets suggest: > which returns either an iterator or

[VOTE] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread Patrik Kleindl
Hello all, I would like to start a vote for KIP-451 which adds two methods for the TopologyTestDriver to iterate over the output. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-451%3A+Make+TopologyTestDriver+output+iterable JIRA: https://issues.apache.org/jira/browse/KAFKA-8200 PR:

New Contributor Request

2019-04-18 Thread Newton, Brandt (CAI - Burlington)
Hello, I’d like to contribute to Kafka. Can someone please add me as a contributor to JIRA so I can assign an issue to myself? My username is bnewton Thanks, Brandt

[jira] [Reopened] (KAFKA-7965) Flaky Test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

2019-04-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reopened KAFKA-7965: Assignee: Jason Gustafson (was: huxihx) I'm still seeing this: 

Re: New Contributor Request

2019-04-18 Thread Bill Bejeck
Brandt, You should be all set now. -Bill On Thu, Apr 18, 2019 at 3:36 PM Newton, Brandt (CAI - Burlington) < brandt.new...@coxautoinc.com> wrote: > Hello, > > I’d like to contribute to Kafka. Can someone please add me as a > contributor to JIRA so I can assign an issue to myself? My username

[VOTE] KIP-421: Automatically resolve external configurations.

2019-04-18 Thread TEJAL ADSUL
Hi All, As we have reached a consensus on the design, I would like to start a vote for KIP-421. Below are the links for this proposal: KIP Link: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=100829515 DiscussionThread:

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Jonathan Santilli
Definitely well deserved! Congrats Matthias! On Thu, Apr 18, 2019, 10:46 PM Bill Bejeck wrote: > Congrats Matthias! Well deserved! > > -Bill > > On Thu, Apr 18, 2019 at 5:35 PM Guozhang Wang wrote: > > > Hello Everyone, > > > > I'm glad to announce that Matthias J. Sax is now a member of Kafka

Re: [VOTE] KIP-258: Allow to Store Record Timestamps in RocksDB

2019-04-18 Thread Matthias J. Sax
Quick update to the KIP. While working on https://github.com/apache/kafka/pull/6601 I realized that I forgot to list the following three new methods that we need to add in addition: > public static KeyValueBytesStoreSupplier > persistentTimestampedKeyValueStore(final String name); > >

Re: [DISCUSSION] KIP-421: Automatically resolve external configurations.

2019-04-18 Thread Colin McCabe
Hi Tejal, Thanks for the updates. Looks good :) best, Colin On Wed, Apr 17, 2019, at 16:53, TEJAL ADSUL wrote: > Hi Rajini and Colin, > > I have incorporated your feedbacks and have enabled the the automatic > resolution of configs for all the components. Also I have removed the > flag to

Re: [ANNOUNCE] New Kafka PMC member: Sriharsh Chintalapan

2019-04-18 Thread Matthias J. Sax
Congrats! -Matthias On 4/18/19 2:11 PM, Vahid Hashemian wrote: > Congratulations Harsh! > > --Vahid > > On Thu, Apr 18, 2019 at 12:35 PM Bill Bejeck wrote: > >> Congrats Harsh! >> >> -Bill >> >> On Thu, Apr 18, 2019 at 3:14 PM Guozhang Wang wrote: >> >>> Congrats Harsh! >>> >>> >>> Guozhang

Re: [VOTE] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-18 Thread Matthias J. Sax
Thanks a lot for the KIP! +1 (binding) -Matthias On 4/18/19 12:31 PM, Guozhang Wang wrote: > +1 (binding). > > Thanks. > > On Thu, Apr 18, 2019 at 10:48 AM John Roesler wrote: > >> Thanks, Maarten! >> >> +1 (non-binding) >> >> -John >> >> On Wed, Apr 17, 2019 at 1:45 PM Bill Bejeck

[jira] [Created] (KAFKA-8260) Flaky test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

2019-04-18 Thread John Roesler (JIRA)
John Roesler created KAFKA-8260: --- Summary: Flaky test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup Key: KAFKA-8260 URL: https://issues.apache.org/jira/browse/KAFKA-8260

Build failed in Jenkins: kafka-2.0-jdk8 #251

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7866; Ensure no duplicate offsets after txn index append failure -- [...truncated 2.69 MB...] org.apache.kafka.connect.transforms.CastTest >

[ANNOUNCE] New Kafka PMC member: Sriharsh Chintalapan

2019-04-18 Thread Jun Rao
Hi, Everyone, Sriharsh Chintalapan has been active in the Kafka community since he became a Kafka committer in 2015. I am glad to announce that Harsh is now a member of Kafka PMC. Congratulations, Harsh! Jun

Jenkins build is back to normal : kafka-trunk-jdk11 #447

2019-04-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-8259) Build RPM for Kafka

2019-04-18 Thread Patrick Dignan (JIRA)
Patrick Dignan created KAFKA-8259: - Summary: Build RPM for Kafka Key: KAFKA-8259 URL: https://issues.apache.org/jira/browse/KAFKA-8259 Project: Kafka Issue Type: Improvement

[ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Guozhang Wang
Hello Everyone, I'm glad to announce that Matthias J. Sax is now a member of Kafka PMC. Matthias has been a committer since Jan. 2018, and since then he continued to be active in the community and made significant contributions the project. Congratulations to Matthias! -- Guozhang

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Bill Bejeck
Congrats Matthias! Well deserved! -Bill On Thu, Apr 18, 2019 at 5:35 PM Guozhang Wang wrote: > Hello Everyone, > > I'm glad to announce that Matthias J. Sax is now a member of Kafka PMC. > > Matthias has been a committer since Jan. 2018, and since then he continued > to be active in the

Build failed in Jenkins: kafka-2.0-jdk8 #250

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Ensure producer state append exceptions areuseful (#6591) -- [...truncated 2.68 MB...] org.apache.kafka.connect.transforms.CastTest >

Re: [DISCUSS] KIP-454: Expansion of the ConnectClusterState interface

2019-04-18 Thread Chris Egerton
Hi Magesh, Thanks for your comments. I'll address them in the order you provided them: 1 - Reason for exposing task configurations to REST extensions: Yes, the motivation is a little thin for exposing task configs to REST extensions. I can think of a few uses for this functionality, such as

Build failed in Jenkins: kafka-2.2-jdk8 #86

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7866; Ensure no duplicate offsets after txn index append failure -- [...truncated 2.51 MB...]

Build failed in Jenkins: kafka-2.1-jdk8 #166

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7866; Ensure no duplicate offsets after txn index append failure -- [...truncated 923.79 KB...] kafka.coordinator.group.GroupMetadataTest >

Build failed in Jenkins: kafka-trunk-jdk11 #448

2019-04-18 Thread Apache Jenkins Server
See Changes: [bbejeck] KAFKA-6958: Allow to name operation using parameter classes (#6410) -- [...truncated 2.38 MB...]

Kafka point in time recovery?

2019-04-18 Thread kumar
Is there any possibility of recovering kafka topic and brokers point in time?. I want to recover kafka topics and brokers as of yesterday 5 PM. I dont want any data arrived in kafka yesterday after 5 PM. I read about mirroring of data using kafka replicator, ureplicator..etc..All the mirroring

Re: [ANNOUNCE] New Kafka PMC member: Sriharsh Chintalapan

2019-04-18 Thread Manikumar
Congrats Harsha!. On Fri, Apr 19, 2019 at 7:43 AM Dong Lin wrote: > Congratulations Sriharsh! > > On Thu, Apr 18, 2019 at 11:46 AM Jun Rao wrote: > > > Hi, Everyone, > > > > Sriharsh Chintalapan has been active in the Kafka community since he > became > > a Kafka committer in 2015. I am glad

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Vahid Hashemian
Congratulations Matthias! --Vahid On Thu, Apr 18, 2019 at 9:39 PM Manikumar wrote: > Congrats Matthias!. well deserved. > > On Fri, Apr 19, 2019 at 7:44 AM Dong Lin wrote: > > > Congratulations Matthias! > > > > Very well deserved! > > > > On Thu, Apr 18, 2019 at 2:35 PM Guozhang Wang >

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Dong Lin
Congratulations Matthias! Very well deserved! On Thu, Apr 18, 2019 at 2:35 PM Guozhang Wang wrote: > Hello Everyone, > > I'm glad to announce that Matthias J. Sax is now a member of Kafka PMC. > > Matthias has been a committer since Jan. 2018, and since then he continued > to be active in the

Re: [ANNOUNCE] New Kafka PMC member: Sriharsh Chintalapan

2019-04-18 Thread Dong Lin
Congratulations Sriharsh! On Thu, Apr 18, 2019 at 11:46 AM Jun Rao wrote: > Hi, Everyone, > > Sriharsh Chintalapan has been active in the Kafka community since he became > a Kafka committer in 2015. I am glad to announce that Harsh is now a member > of Kafka PMC. > > Congratulations, Harsh! > >

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Ankur Rana
Congratulations Matthias. On Fri, Apr 19, 2019 at 4:39 AM Manikumar wrote: > Congrats Matthias!. well deserved. > > On Fri, Apr 19, 2019 at 7:44 AM Dong Lin wrote: > > > Congratulations Matthias! > > > > Very well deserved! > > > > On Thu, Apr 18, 2019 at 2:35 PM Guozhang Wang > wrote: > > >

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-18 Thread Manikumar
Congrats Matthias!. well deserved. On Fri, Apr 19, 2019 at 7:44 AM Dong Lin wrote: > Congratulations Matthias! > > Very well deserved! > > On Thu, Apr 18, 2019 at 2:35 PM Guozhang Wang wrote: > > > Hello Everyone, > > > > I'm glad to announce that Matthias J. Sax is now a member of Kafka PMC.

Build failed in Jenkins: kafka-2.0-jdk8 #252

2019-04-18 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: remove unused import (#6605) -- [...truncated 439.76 KB...] kafka.utils.CoreUtilsTest > testTryAll PASSED kafka.utils.CoreUtilsTest >

Build failed in Jenkins: kafka-trunk-jdk8 #3567

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7026; Sticky Assignor Partition Assignment Improvement (KIP-341) [github] MINOR: Ensure producer state append exceptions areuseful (#6591) [github] KAFKA-7866; Ensure no duplicate

Build failed in Jenkins: kafka-trunk-jdk11 #446

2019-04-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7026; Sticky Assignor Partition Assignment Improvement (KIP-341) [github] MINOR: Ensure producer state append exceptions areuseful (#6591) [github] KAFKA-7866; Ensure no duplicate

[jira] [Created] (KAFKA-8255) Replica fetcher thread exits with OffsetOutOfRangeException

2019-04-18 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-8255: -- Summary: Replica fetcher thread exits with OffsetOutOfRangeException Key: KAFKA-8255 URL: https://issues.apache.org/jira/browse/KAFKA-8255 Project: Kafka

[jira] [Created] (KAFKA-8254) Suppress incorrectly passes a null topic to the serdes

2019-04-18 Thread John Roesler (JIRA)
John Roesler created KAFKA-8254: --- Summary: Suppress incorrectly passes a null topic to the serdes Key: KAFKA-8254 URL: https://issues.apache.org/jira/browse/KAFKA-8254 Project: Kafka Issue

[jira] [Resolved] (KAFKA-7026) Sticky assignor could assign a partition to multiple consumers (KIP-341)

2019-04-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7026. Resolution: Fixed Fix Version/s: 2.3.0 > Sticky assignor could assign a partition

[jira] [Resolved] (KAFKA-7652) Kafka Streams Session store performance degradation from 0.10.2.2 to 0.11.0.0

2019-04-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7652. -- Resolution: Fixed Fix Version/s: 2.3.0 It should be fixed by the latest PR (details

Re: [VOTE] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-18 Thread John Roesler
Thanks, Maarten! +1 (non-binding) -John On Wed, Apr 17, 2019 at 1:45 PM Bill Bejeck wrote: > Thanks for the KIP. > > +1(binding) > > -Bill > > On Wed, Apr 17, 2019 at 12:58 PM Bruno Cadonna wrote: > > > Hi Maarten Duijn, > > > > Thank you for driving this. > > > > +1 (non-binding) > > > >

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread John Roesler
Hi, Patrik, Thanks for this proposal! I have one question, which I didn't see addressed by the KIP. Currently, when you call `readOutput`, it consumes the result (removes it from the test driver's output). Does your proposed method: A: consume the whole output stream for that topic "atomically"

Re: [DISCUSS] KIP-454: Expansion of the ConnectClusterState interface

2019-04-18 Thread Magesh Nandakumar
Hi Chris, Thanks for the KIP. Overall, it looks good and straightforward to me. I had a few questions on the new methods 1. I'm not sure if an extension would ever require the task configs. An extension generally should only require the health and current state of the connector which includes

[jira] [Created] (KAFKA-8257) Flaky Test DynamicConnectionQuotaTest#testDynamicListenerConnectionQuota

2019-04-18 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-8257: -- Summary: Flaky Test DynamicConnectionQuotaTest#testDynamicListenerConnectionQuota Key: KAFKA-8257 URL: https://issues.apache.org/jira/browse/KAFKA-8257 Project:

[jira] [Resolved] (KAFKA-7866) Duplicate offsets after transaction index append failure

2019-04-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7866. Resolution: Fixed Assignee: Jason Gustafson Fix Version/s: 2.2.1