Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

2020-04-01 Thread Aneel Nazareth
Thanks everyone, It looks like we have 5 positive votes (3 binding, 2 non-binding) and no negative votes. I'll mark this KIP as accepted, and update the code for KAFKA-9612 to incorporate the recent changes. Cheers, Aneel https://issues.apache.org/jira/browse/KAFKA-9612 On Mon, Mar 30, 2020 at

[jira] [Created] (KAFKA-9799) Flaky Test ResetConsumerGroupOffsetTest#testResetOffsetsToLatest

2020-04-01 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9799: -- Summary: Flaky Test ResetConsumerGroupOffsetTest#testResetOffsetsToLatest Key: KAFKA-9799 URL: https://issues.apache.org/jira/browse/KAFKA-9799 Project: Kafka

[jira] [Resolved] (KAFKA-1368) Upgrade log4j

2020-04-01 Thread Tom Bentley (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Bentley resolved KAFKA-1368. Resolution: Duplicate > Upgrade log4j > - > > Key: KAFKA-1368 >

Re: [DISCUSS] KIP-585: Conditional SMT

2020-04-01 Thread Tom Bentley
Does anyone have any comments, feedback or thoughts about this? Thanks, Tom On Tue, Mar 24, 2020 at 11:56 AM Tom Bentley wrote: > Hi, > > I've opened KIP-585 which is intended to provide a mechanism to > conditionally apply SMTs in Kafka Connect. I'd be grateful for any > feedback: >

[jira] [Resolved] (KAFKA-2225) Allow fetching from ISR

2020-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-2225. - Fix Version/s: 2.4.0 Resolution: Duplicate I believe this functionality is covered by

Re: [DISCUSS] KIP-585: Conditional SMT

2020-04-01 Thread Sönke Liebau
Hi Tom, sounds useful to me, thanks for the KIP! The only thought that I had while reading was that this will probably raise questions about more involved conditions fairly quickly. For example the "has-header" will cause an appetite for conditions like "this-header-has-that-value". This would

[jira] [Resolved] (KAFKA-4912) Add check for topic name length

2020-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-4912. - Fix Version/s: 2.3.0 2.2.2 2.1.2 Resolution: Fixed

Jenkins build is back to normal : kafka-trunk-jdk8 #4390

2020-04-01 Thread Apache Jenkins Server
See

Jira Cleanup

2020-04-01 Thread Sönke Liebau
Hi all, I've spent some time with jira and identified a few tickets that might be worth looking at again / closing if there is no appetite for them. KAFKA-1906 & KAFKA-3925 - Both these ticket

[jira] [Created] (KAFKA-9796) Broker shutdown could be stuck forever under certain conditions

2020-04-01 Thread David Jacot (Jira)
David Jacot created KAFKA-9796: -- Summary: Broker shutdown could be stuck forever under certain conditions Key: KAFKA-9796 URL: https://issues.apache.org/jira/browse/KAFKA-9796 Project: Kafka

[jira] [Created] (KAFKA-9797) Fix flaky system test TestSecurityRollingUpgrade.test_enable_separate_interbroker_listener

2020-04-01 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-9797: - Summary: Fix flaky system test TestSecurityRollingUpgrade.test_enable_separate_interbroker_listener Key: KAFKA-9797 URL: https://issues.apache.org/jira/browse/KAFKA-9797

[jira] [Created] (KAFKA-9794) JMX metrics produce higher memory and CPU consumption in Kafka docker

2020-04-01 Thread Hariprasad (Jira)
Hariprasad created KAFKA-9794: - Summary: JMX metrics produce higher memory and CPU consumption in Kafka docker Key: KAFKA-9794 URL: https://issues.apache.org/jira/browse/KAFKA-9794 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #4389

2020-04-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9441: Cleanup Streams metrics for removed task commit latency -- [...truncated 5.97 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-04-01 Thread Kowshik Prakasam
Hey Boyang, Thanks for the feedback! Please find below my response to your latest comments. I have modified the KIP wherever possible to address the comments. > My point is that during a bootstrapping stage of a cluster, we could not > pick the desired feature version as no controller is

[jira] [Created] (KAFKA-9795) Add throttleTimeMs in logs

2020-04-01 Thread Igor Vavrzhin (Jira)
Igor Vavrzhin created KAFKA-9795: Summary: Add throttleTimeMs in logs Key: KAFKA-9795 URL: https://issues.apache.org/jira/browse/KAFKA-9795 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: kafka-trunk-jdk11 #1309

2020-04-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9441: Cleanup Streams metrics for removed task commit latency [github] MINOR: reduce garbage in operation and resource java conversions (#8391)

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-04-01 Thread Maulin Vasavada
HI all The summary of the vote: *Total 6 +ve* with *+4 Binding*, +2 non-Binding. I'll move the KIP to Accepted state. Thanks Maulin On Tue, Mar 31, 2020 at 10:32 PM Maulin Vasavada wrote: > Thanks Rajini and Jun. I'll update the shouldBeRebuilt() docs on what > happens to existing SSL

Re: [DISCUSS] KIP-585: Conditional SMT

2020-04-01 Thread Tom Bentley
Hi Sönke, Thanks for taking a look. Let me answer in reverse order, since I think it might make more sense that way... Also, while writing that, I noticed that you have a version with and > without "name" for your transformation in the KIP: > >

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

2020-04-01 Thread Aneel Nazareth
I have a PR that I think is ready for review here: https://github.com/apache/kafka/pull/8184 Feedback would be most welcome! On Mon, Mar 30, 2020 at 6:57 PM Colin McCabe wrote: > > Just as a note about whether we should support "-" as a synonym for STDIN... > I agree it's kind of

[DISCUSS] KIP-578: Add configuration to limit number of partitions

2020-04-01 Thread Gokul Ramanan Subramanian
Hi. I have opened KIP-578, intended to provide a mechanism to limit the number of partitions in a Kafka cluster. Kindly provide feedback on the KIP which you can find at https://cwiki.apache.org/confluence/display/KAFKA/KIP-578%3A+Add+configuration+to+limit+number+of+partitions I want to

[jira] [Created] (KAFKA-9798) org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses

2020-04-01 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-9798: -- Summary: org.apache.kafka.streams.integration.QueryableStateIntegrationTest.shouldAllowConcurrentAccesses Key: KAFKA-9798 URL: https://issues.apache.org/jira/browse/KAFKA-9798

Build failed in Jenkins: kafka-trunk-jdk11 #1310

2020-04-01 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix Scala 2.13 compiler warnings (#8390) -- [...truncated 2.97 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: Working on a contribution for suppressing exceptions from KafkaConnect

2020-04-01 Thread Connor Penhale
Hi John! I've added myself to the Wiki under cpenh...@perforce.com with the username cpenhale_openlogic. Let me know if you need anything else! Thanks! Connor4 On 3/31/20, 7:42 PM, "John Roesler" wrote: Hi Connor, Unfortunately, the wiki has a separate user list from the Jira

[jira] [Resolved] (KAFKA-8827) kafka brokers intermittent traffic

2020-04-01 Thread frid (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] frid resolved KAFKA-8827. - Resolution: Fixed > kafka brokers intermittent traffic > -- > >

Build failed in Jenkins: kafka-2.5-jdk8 #86

2020-04-01 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-9659: Add more log4j when updating static member mappings (#8269) [rajinisivaram] KAFKA-9233: Fix IllegalStateException in Fetcher retrieval of beginning

Re: Working on a contribution for suppressing exceptions from KafkaConnect

2020-04-01 Thread John Roesler
Ok, Connor, You should now be able to create your KIP, following the process at: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-Process Let us know if you have any questions! Thanks, -John On Wed, Apr 1, 2020, at 11:41, Connor Penhale

Re: [DISCUSS] KIP-585: Conditional SMT

2020-04-01 Thread Christopher Egerton
Hi Tom, This looks great and I'd love to see the out-of-the-box SMTs become even more powerful with the improvements you've proposed! Got a few remarks and would be interested in your thoughts: 1. Instead of the new "ConfigDef config(Map props)" method, what would you think about adopting a

[jira] [Created] (KAFKA-9800) [KIP-580] Admin Client Exponential Backoff Implementation

2020-04-01 Thread Cheng Tan (Jira)
Cheng Tan created KAFKA-9800: Summary: [KIP-580] Admin Client Exponential Backoff Implementation Key: KAFKA-9800 URL: https://issues.apache.org/jira/browse/KAFKA-9800 Project: Kafka Issue Type:

[DISCUSS] KIP-586: Deprecate commit records without record metadata

2020-04-01 Thread Mario Molina
Hi all, I'd like to use this thread to discuss KIP-586. You can see the detail at: https://cwiki.apache.org/confluence/display/KAFKA/KIP-586%3A+Deprecate+commit+records+without+record+metadata Best, Mario

Build failed in Jenkins: kafka-trunk-jdk11 #1311

2020-04-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9233: Fix IllegalStateException in Fetcher retrieval of beginning -- [...truncated 5.94 MB...]

[jira] [Created] (KAFKA-9802) Fix flaky system test `TransactionsTest.test_transactions`

2020-04-01 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-9802: -- Summary: Fix flaky system test `TransactionsTest.test_transactions` Key: KAFKA-9802 URL: https://issues.apache.org/jira/browse/KAFKA-9802 Project: Kafka

[jira] [Created] (KAFKA-9801) Static member could get empty assignment unexpectedly

2020-04-01 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9801: Summary: Static member could get empty assignment unexpectedly Key: KAFKA-9801 URL: https://issues.apache.org/jira/browse/KAFKA-9801 Project: Kafka Issue

[jira] [Created] (KAFKA-9803) Allow producers to recover gracefully from transaction timeouts

2020-04-01 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-9803: -- Summary: Allow producers to recover gracefully from transaction timeouts Key: KAFKA-9803 URL: https://issues.apache.org/jira/browse/KAFKA-9803 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #1312

2020-04-01 Thread Apache Jenkins Server
See Changes: [github] MINOR: Improve close tests of caching state store (#8386) [github] MINOR: Rename TopicCommandTest (#8398) [github] KAFKA-9748: extend EosIntegrationTest for EOS-beta (#8331)