Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-24 Thread Boyang Chen
Nice KIP Kowshik! This is a long due feature for the ease of both client side and server side upgrade in general. One meta comment: it seems the KIP's font is a bit weirdly rendered: [image: image.png] Could you try to remove all the rectangle blocks? It looks inconsistent with most KIPs. Thanks,

[jira] [Resolved] (KAFKA-9752) Consumer rebalance can be stuck after new member timeout with old JoinGroup version

2020-03-24 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9752. Fix Version/s: 2.4.2 2.3.2 Resolution: Fixed > Consumer rebalance

Build failed in Jenkins: kafka-trunk-jdk8 #4364

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9711 The authentication failure caused by SSLEngine#beginHandshake -- [...truncated 2.94 MB...] org.apache.kafka.streams.TopologyTestDriverT

Build failed in Jenkins: kafka-trunk-jdk11 #1285

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9711 The authentication failure caused by SSLEngine#beginHandshake -- [...truncated 2.96 MB...] org.apache.kafka.streams.internals.WindowSto

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

2020-03-24 Thread Gwen Shapira
+1 (binding), thank you On Wed, Mar 18, 2020, 2:26 PM Colin McCabe wrote: > +1 (binding). > > Thanks, Aneel. > > best, > Colin > > On Wed, Mar 18, 2020, at 00:04, David Jacot wrote: > > +1 (non-binding), thanks for the KIP! > > > > David > > > > On Mon, Mar 16, 2020 at 4:06 PM Aneel Nazareth >

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread David Jacot
+1 (non-binding) Thanks for the KIP, great improvement! Le mer. 25 mars 2020 à 04:44, Gwen Shapira a écrit : > +1 (binding) - thank you > > On Mon, Mar 23, 2020, 10:50 AM Sanjana Kaundinya > wrote: > > > Hi Everyone, > > > > I’d like to start a vote for KIP-580: Exponential Backoff for Kafka >

Build failed in Jenkins: kafka-2.3-jdk8 #188

2020-03-24 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as -- [...truncated 2.87 MB...] kafka.coordinator.group.GroupMetadataManagerTest >

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Gwen Shapira
+1 (binding) - thank you On Mon, Mar 23, 2020, 10:50 AM Sanjana Kaundinya wrote: > Hi Everyone, > > I’d like to start a vote for KIP-580: Exponential Backoff for Kafka > Clients. The link to the KIP can be found here: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-580%3A+Exponential+Bac

Jenkins build is back to normal : kafka-trunk-jdk8 #4363

2020-03-24 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-2.0-jdk8 #313

2020-03-24 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-2.2-jdk8 #35

2020-03-24 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-9760) Add EOS protocol changes to documentation

2020-03-24 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9760: -- Summary: Add EOS protocol changes to documentation Key: KAFKA-9760 URL: https://issues.apache.org/jira/browse/KAFKA-9760 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: kafka-trunk-jdk11 #1284

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6145: Add balanced assignment algorithm (#8334) [github] MINOR: Add method to Herder to control logging of connector configs -- [...truncate

[jira] [Resolved] (KAFKA-9711) The authentication failure caused by SSLEngine#beginHandshake is not properly caught and handled

2020-03-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-9711. Fix Version/s: 2.6.0 Resolution: Fixed Merged the PR to trunk. > The authentication failure caused

Build failed in Jenkins: kafka-2.5-jdk8 #74

2020-03-24 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as -- [...truncated 2.90 MB...] org.apache.kafka.streams.TopologyTestDriverTest > s

[jira] [Created] (KAFKA-9759) Add documentation change for KIP-562

2020-03-24 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9759: -- Summary: Add documentation change for KIP-562 Key: KAFKA-9759 URL: https://issues.apache.org/jira/browse/KAFKA-9759 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: kafka-trunk-jdk11 #1283

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as [github] MINOR: move some client methods to new ClientUtils (#8328) -- [..

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-24 Thread Kowshik Prakasam
Hi all, Apologies, please ignore the reference to https://issues.apache.org/jira/browse/KIP-584. It was included accidentally. But the link to the KIP is the right one. Cheers, Kowshik On Tue, Mar 24, 2020 at 5:08 PM Kowshik Prakasam wrote: > Hi all, > > I've opened KIP-584

[DISCUSS] KIP-584: Versioning scheme for features

2020-03-24 Thread Kowshik Prakasam
Hi all, I've opened KIP-584 which is intended to provide a versioning scheme for features. I'd like to use this thread to discuss the same. I'd appreciate any feedback on this. Here is a link to KIP-584: https://cwiki.apache.org/confluence/display/KA

Build failed in Jenkins: kafka-trunk-jdk8 #4362

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9749; Transaction coordinator should treat KAFKA_STORAGE_ERROR as [github] MINOR: move some client methods to new ClientUtils (#8328) -- [...

[jira] [Created] (KAFKA-9758) Add documentations for Streams release

2020-03-24 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9758: -- Summary: Add documentations for Streams release Key: KAFKA-9758 URL: https://issues.apache.org/jira/browse/KAFKA-9758 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-9757) Add documentation change for KIP-535

2020-03-24 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9757: -- Summary: Add documentation change for KIP-535 Key: KAFKA-9757 URL: https://issues.apache.org/jira/browse/KAFKA-9757 Project: Kafka Issue Type: Sub-task Affec

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Jason Gustafson
+1 Thanks for the KIP! On Tue, Mar 24, 2020 at 10:31 AM Boyang Chen wrote: > +1 (non-binding). > > agree with Guozhang for the warning. > > On Tue, Mar 24, 2020 at 9:57 AM Guozhang Wang wrote: > > > +1 (binding). > > > > One minor thing is that upon starting, when we find the specified > > `max

Build failed in Jenkins: kafka-2.1-jdk8 #256

2020-03-24 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-8417: Remove redundant network definition --net=host when starting -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

[jira] [Resolved] (KAFKA-9749) TransactionMarkerRequestCompletionHandler should treat storage exceptions as retriable

2020-03-24 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9749. Fix Version/s: 2.4.2 2.3.2 2.5.0 Resolution: Fi

[jira] [Created] (KAFKA-9756) Refactor the main loop to process more than one record of one task at a time

2020-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9756: Summary: Refactor the main loop to process more than one record of one task at a time Key: KAFKA-9756 URL: https://issues.apache.org/jira/browse/KAFKA-9756 Project: K

[jira] [Created] (KAFKA-9755) Implement versioning scheme for features

2020-03-24 Thread Kowshik Prakasam (Jira)
Kowshik Prakasam created KAFKA-9755: --- Summary: Implement versioning scheme for features Key: KAFKA-9755 URL: https://issues.apache.org/jira/browse/KAFKA-9755 Project: Kafka Issue Type: Impr

Build failed in Jenkins: kafka-trunk-jdk8 #4361

2020-03-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9743: Catch commit offset exception to eventually close dirty [github] MINOR: Restore and global consumers should never have group.instance.id --

[jira] [Created] (KAFKA-9754) Trogdor workloads fail because topics are not fully created when workloads start.

2020-03-24 Thread Scott Hendricks (Jira)
Scott Hendricks created KAFKA-9754: -- Summary: Trogdor workloads fail because topics are not fully created when workloads start. Key: KAFKA-9754 URL: https://issues.apache.org/jira/browse/KAFKA-9754 P

[jira] [Created] (KAFKA-9753) Add task-level active-process-ratio to Streams metrics

2020-03-24 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9753: Summary: Add task-level active-process-ratio to Streams metrics Key: KAFKA-9753 URL: https://issues.apache.org/jira/browse/KAFKA-9753 Project: Kafka Issue Ty

[jira] [Resolved] (KAFKA-6820) Improve on StreamsMetrics Public APIs

2020-03-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6820. -- Resolution: Fixed > Improve on StreamsMetrics Public APIs > ---

Re: [Discuss] KIP-582 Add a "continue" option for Kafka Connect error handling

2020-03-24 Thread Zihan Li
Hi, I just want to re-up this discussion thread about KIP-582 Add a "continue" option for Kafka Connect error handling. Wiki page: https://cwiki.apache.org/confluence/x/XRvcC JIRA: https://issues.apache.org/jira/browse/KAFKA-9740

[jira] [Resolved] (KAFKA-9475) Replace transaction abortion scheduler with a delayed queue

2020-03-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-9475. Resolution: Won't Fix It seems not worth the effort as we could just shrink the scheduler time > R

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Boyang Chen
+1 (non-binding). agree with Guozhang for the warning. On Tue, Mar 24, 2020 at 9:57 AM Guozhang Wang wrote: > +1 (binding). > > One minor thing is that upon starting, when we find the specified > `max.backoff` config < `backoff`, we can log a warning message. > > > Guozhang > > On Tue, Mar 24,

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Guozhang Wang
+1 (binding). One minor thing is that upon starting, when we find the specified `max.backoff` config < `backoff`, we can log a warning message. Guozhang On Tue, Mar 24, 2020 at 12:22 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding). Thanks for the KIP! > > On

Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Guozhang Wang
In Kafka clients, there are cases where we log a warning when overriding some conflicting configs and in some other cases we throw and let the brokers to die during startup --- you can check the `postProcessParsedConfig` function in Producer/ConsumerConfig for such logic. I think for this case, i

[jira] [Resolved] (KAFKA-9743) StreamTask could fail to close during HandleNewAssignment

2020-03-24 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-9743. Resolution: Fixed > StreamTask could fail to close during HandleNewAssignment > ---

Re: request to be added to the contributor list

2020-03-24 Thread Matthias J. Sax
Luke, Thanks for your interest in Kafka. To get started, please check out https://kafka.apache.org/contributing About "contributor list": There is not really anything like this. (Only for Jira, we can grant contributor status. What is your Jira account ID?) -Matthias On 3/24/20 4:33 AM, Luke C

request to be added to the contributor list

2020-03-24 Thread Luke Chen
Hi Kafka, I'd like to become contributor for Apache Kafka project. Please help add me into the contributor list. If there's anything else I need to do, please let me know. Thank you very much. Luke

[DISCUSS] KIP-585: Conditional SMT

2020-03-24 Thread Tom Bentley
Hi, I've opened KIP-585 which is intended to provide a mechanism to conditionally apply SMTs in Kafka Connect. I'd be grateful for any feedback: https://cwiki.apache.org/confluence/display/KAFKA/KIP-585%3A+Conditional+SMT Many thanks, Tom

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

2020-03-24 Thread Kamal Chandraprakash
+1 (non-binding). Thanks for the KIP! On Mon, Mar 23, 2020 at 11:20 PM Sanjana Kaundinya wrote: > Hi Everyone, > > I’d like to start a vote for KIP-580: Exponential Backoff for Kafka > Clients. The link to the KIP can be found here: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-580%3A+

Re: [DISCUSS] KIP-519: Make SSL context/engine configuration extensible

2020-03-24 Thread Maulin Vasavada
Hi all, I resolved the challenge with having Class Type for the ssl.engine.factory.class configuration. Raised pull request to the trunk - https://github.com/apache/kafka/pull/8338. Updated on the JIRA - https://issues.apache.org/jira/browse/KAFKA-8890 Please review & Vote! Thanks Maulin On Mon