Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #71

2021-03-18 Thread Apache Jenkins Server
See Changes: [A. Sophie Blee-Goldman] KAFKA-12503: inform threads to resize their cache instead of doing so for them (#10356) -- [...truncated 7.23 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #644

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10697: Remove ProduceResponse.responses (#10332) [github] KAFKA-12503: inform threads to resize their cache instead of doing so for them (#10356)

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #587

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12503: inform threads to resize their cache instead of doing so for them (#10356) -- [...truncated 3.67 MB...] LogValidatorTest

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #615

2021-03-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-12508) Emit-on-change tables may lose updates on error or restart in at_least_once

2021-03-18 Thread Nico Habermann (Jira)
Nico Habermann created KAFKA-12508: -- Summary: Emit-on-change tables may lose updates on error or restart in at_least_once Key: KAFKA-12508 URL: https://issues.apache.org/jira/browse/KAFKA-12508

Re: Kafka logos and branding

2021-03-18 Thread Justin Mclean
HI, > The high resolution logo is now available at > https://apache.org/logos/res/kafka/kafka_highres.png Thanks for that, but is that the correct logo? It's missing the word apache, the registered trademark symbol and the text "A distributed streaming platform". I guess the byline could be

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #586

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10697: Remove ProduceResponse.responses (#10332) -- [...truncated 3.67 MB...] LogValidatorTest >

[jira] [Resolved] (KAFKA-12503) Resizing the thread cache in a non thread safe way can cause records to be redirected throughout the topology

2021-03-18 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-12503. Resolution: Fixed > Resizing the thread cache in a non thread safe way

[jira] [Resolved] (KAFKA-10697) Remove ProduceResponse.responses

2021-03-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10697. Fix Version/s: 3.0.0 Resolution: Fixed > Remove ProduceResponse.responses >

[jira] [Created] (KAFKA-12507) java.lang.OutOfMemoryError: Direct buffer memory

2021-03-18 Thread diehu (Jira)
diehu created KAFKA-12507: - Summary: java.lang.OutOfMemoryError: Direct buffer memory Key: KAFKA-12507 URL: https://issues.apache.org/jira/browse/KAFKA-12507 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-12506) Expand AdjustStreamThreadCountTest

2021-03-18 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12506: -- Summary: Expand AdjustStreamThreadCountTest Key: KAFKA-12506 URL: https://issues.apache.org/jira/browse/KAFKA-12506 Project: Kafka Issue

[jira] [Created] (KAFKA-12505) Should kafka-storage.sh accept a non-UUID for its --cluster-id parameter?

2021-03-18 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-12505: - Summary: Should kafka-storage.sh accept a non-UUID for its --cluster-id parameter? Key: KAFKA-12505 URL: https://issues.apache.org/jira/browse/KAFKA-12505 Project:

Jenkins build is back to normal : Kafka » kafka-2.8-jdk8 #70

2021-03-18 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-03-18 Thread Randall Hauch
Hey, Chris. Thanks again for all your hard work figuring out this complicated problem. While there are still issues to iron out, at the moment it seems pretty sensible. Here's my follow up email with additional comments/questions. I've organized these by section to help provide context, and I've

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #585

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Exclude KIP-500.md from rat check (#10354) -- [...truncated 3.67 MB...] LogValidatorTest >

[jira] [Created] (KAFKA-12504) KafkaMetadataLog should check clean shutdown file

2021-03-18 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12504: --- Summary: KafkaMetadataLog should check clean shutdown file Key: KAFKA-12504 URL: https://issues.apache.org/jira/browse/KAFKA-12504 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #614

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Exclude KIP-500.md from rat check (#10354) -- [...truncated 3.69 MB...] KafkaZkClientTest > testDeleteTopicPathMethods()

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #643

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Exclude KIP-500.md from rat check (#10354) -- [...truncated 3.69 MB...] AuthorizerIntegrationTest >

[jira] [Created] (KAFKA-12503) Resizing the thread cache in a non thread safe way can cause records to be redirected throughout the topology

2021-03-18 Thread Walker Carlson (Jira)
Walker Carlson created KAFKA-12503: -- Summary: Resizing the thread cache in a non thread safe way can cause records to be redirected throughout the topology Key: KAFKA-12503 URL:

Jenkins build is back to normal : Kafka » kafka-2.7-jdk8 #135

2021-03-18 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-03-18 Thread Randall Hauch
Chris, Thanks for the well-written KIP and the more recent updates. It's exciting to envision EOS for Connect source connectors! I'll follow up this email with another that goes into specific comments and questions not already touched on by others. This email addresses comments and questions

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #584

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Move `configurations.all` to be a child of `allprojects` (#10349) -- [...truncated 3.67 MB...] UserClientIdQuotaTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #613

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Start the broker-to-controller channel for request forwarding (#10340) [github] MINOR: Remove use of `NoSuchElementException` in `KafkaMetadataLog` (#10344) [github]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #642

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10357: Add setup method to internal topics (#10317) [github] MINOR: Fix BaseHashTable sizing (#10334) [github] KAFKA-12382: add a README for KIP-500 (#10227) [github]

[jira] [Created] (KAFKA-12502) Quorum controller should return topic configs in CreateTopic response

2021-03-18 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-12502: --- Summary: Quorum controller should return topic configs in CreateTopic response Key: KAFKA-12502 URL: https://issues.apache.org/jira/browse/KAFKA-12502 Project:

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #583

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Start the broker-to-controller channel for request forwarding (#10340) [github] MINOR: Remove use of `NoSuchElementException` in `KafkaMetadataLog` (#10344)

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #69

2021-03-18 Thread Apache Jenkins Server
See Changes: [Colin McCabe] KAFKA-12382: add a README for KIP-500 (#10227) -- [...truncated 3.61 MB...] KafkaTest > testZkSslEnabledProtocols() PASSED

[jira] [Created] (KAFKA-12501) KafkaClusterTestKit should support mixed-mode testing

2021-03-18 Thread David Arthur (Jira)
David Arthur created KAFKA-12501: Summary: KafkaClusterTestKit should support mixed-mode testing Key: KAFKA-12501 URL: https://issues.apache.org/jira/browse/KAFKA-12501 Project: Kafka Issue

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #641

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: remove redundant null check when testing specified type (#10314) -- [...truncated 7.37 MB...] AclAuthorizerTest >

[jira] [Created] (KAFKA-12500) Cache memory is leaked after removing/replacing a StreamThread

2021-03-18 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12500: -- Summary: Cache memory is leaked after removing/replacing a StreamThread Key: KAFKA-12500 URL: https://issues.apache.org/jira/browse/KAFKA-12500

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #612

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: remove redundant null check when testing specified type (#10314) [github] KAFKA-10357: Add setup method to internal topics (#10317) [github] MINOR: Fix BaseHashTable

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #582

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12293: Remove JCenter from buildscript and delete buildscript.gradle [github] MINOR: remove redundant null check when testing specified type (#10314) [github]

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #68

2021-03-18 Thread Apache Jenkins Server
See Changes: [Colin McCabe] MINOR: Fix BaseHashTable sizing (#10334) -- [...truncated 3.60 MB...] ClientIdQuotaTest > testQuotaOverrideDelete() STARTED

[jira] [Resolved] (KAFKA-3813) Let SourceConnector implementations access the offset reader

2021-03-18 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-3813. -- Resolution: Duplicate > Let SourceConnector implementations access the offset reader >

[jira] [Reopened] (KAFKA-3813) Let SourceConnector implementations access the offset reader

2021-03-18 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch reopened KAFKA-3813: -- > Let SourceConnector implementations access the offset reader >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #611

2021-03-18 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-12376) Use scheduleAtomicAppend for records that need to be atomic

2021-03-18 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12376. -- Fix Version/s: 2.8.0 Resolution: Fixed > Use scheduleAtomicAppend for records that

[jira] [Resolved] (KAFKA-12382) Create KIP-500 README for the 2.8 release

2021-03-18 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12382. -- Fix Version/s: 2.8.0 Resolution: Fixed > Create KIP-500 README for the 2.8 release >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #581

2021-03-18 Thread Apache Jenkins Server
See

[GitHub] [kafka-site] agapic opened a new pull request #339: MINOR: Added Axon to powered-by page

2021-03-18 Thread GitBox
agapic opened a new pull request #339: URL: https://github.com/apache/kafka-site/pull/339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Created] (KAFKA-12499) Adjust transaction timeout according to commit interval on Streams EOS

2021-03-18 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-12499: --- Summary: Adjust transaction timeout according to commit interval on Streams EOS Key: KAFKA-12499 URL: https://issues.apache.org/jira/browse/KAFKA-12499 Project: Kafka

RE: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

2021-03-18 Thread Georg Friedrich
Hi Mickael, thanks for granting the rights. Right now this is exactly what I did for my local copy: I've deactivated the creation of the topics and the overall offset sync process once "emit.checkpoints.enabled" was set to false. Do you think of a separate configuration for running the offset

Re: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

2021-03-18 Thread Mickael Maison
Hi Georg, I've granted you contributor access, you should now be able to assign JIRAs to yourself. The offset-syncs topic is created and populated by the Source connector. I'm not sure if setting "emit.checkpoints.enabled" to false on that connector is the most intuitive. How would you disable

Re: Kafka logos and branding

2021-03-18 Thread Jun Rao
Hi, Justin, The high resolution logo is now available at https://apache.org/logos/res/kafka/kafka_highres.png. We will link it to the Apache Kafka website. Thanks, Jun On Wed, Mar 17, 2021 at 7:51 AM Jun Rao wrote: > Hi, Justin, > > Thanks for the suggestions. Will follow up. > > Jun > > On

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #640

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12491: Make rocksdb an `api` dependency for `streams` (#10341) [github] KAFKA-12293: Remove JCenter from buildscript and delete buildscript.gradle

[jira] [Created] (KAFKA-12498) Consumer Group is zero when MirrorMaker 2.0 is running

2021-03-18 Thread Olumide Ajiboye (Jira)
Olumide Ajiboye created KAFKA-12498: --- Summary: Consumer Group is zero when MirrorMaker 2.0 is running Key: KAFKA-12498 URL: https://issues.apache.org/jira/browse/KAFKA-12498 Project: Kafka

[jira] [Resolved] (KAFKA-10340) Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever

2021-03-18 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-10340. --- Reviewer: Randall Hauch Resolution: Fixed > Source connectors should report error

Re: [VOTE] KIP-699: Update FindCoordinator to resolve multiple Coordinators at a time

2021-03-18 Thread Tom Bentley
Hi Mickael, I'd like to re-cast my vote as +1 (binding) now I'm a committer. Thanks again, Tom On Tue, Mar 2, 2021 at 9:46 AM David Jacot wrote: > Thanks for the KIP, Mickael. +1 (binding) > > On Mon, Mar 1, 2021 at 11:53 AM Tom Bentley wrote: > > > +1 (non-binding), thanks Mickael. > > > >

[jira] [Created] (KAFKA-12497) Source task offset commits continue even after task has failed

2021-03-18 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-12497: - Summary: Source task offset commits continue even after task has failed Key: KAFKA-12497 URL: https://issues.apache.org/jira/browse/KAFKA-12497 Project: Kafka

Re: [DISCUSS] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

2021-03-18 Thread Ryanne Dolan
Looks good to me, I'll vote +1. Ryanne On Thu, Mar 18, 2021, 10:36 AM Mickael Maison wrote: > Hi, > > I've not seen any feedback on this KIP. > As it's relatively straight forward, I'll open a vote in the next few > days if I don't see anything. > > Thanks > > On Fri, Feb 26, 2021 at 6:20 PM

RE: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

2021-03-18 Thread Georg Friedrich
Ok, can anybody grant me access to the Kafka JIRA so I can work on the ticket I'm going to create. My username is "GFriedrich". Thanks in advance. Kind regards Georg Friedrich -Original Message- From: Ryanne Dolan Sent: Thursday, March 18, 2021 3:46 PM To: dev Subject: Re:

Re: [DISCUSS] KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2

2021-03-18 Thread Mickael Maison
Hi, I've not seen any feedback on this KIP. As it's relatively straight forward, I'll open a vote in the next few days if I don't see anything. Thanks On Fri, Feb 26, 2021 at 6:20 PM Mickael Maison wrote: > > Hi, > > I would like to start a discussion on KIP-716. This will allow > configuring

[jira] [Resolved] (KAFKA-3813) Let SourceConnector implementations access the offset reader

2021-03-18 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-3813. -- Resolution: Done > Let SourceConnector implementations access the offset reader >

Re: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

2021-03-18 Thread Ryanne Dolan
I am not certain, but I'd guess a KIP is not required. I think this would be considered a bug fix. Ryanne On Wed, Mar 17, 2021, 5:34 PM Georg Friedrich wrote: > Hi Ryanne, > > thank you for your response. > > 1) Yes, right - I've missed the condition that is part of the > PartitionState class.

Re: [DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-03-18 Thread Dongjin Lee
Great! If this KIP is merged first, I will update the PR accordingly. Thanks, Dongjin On Thu, Mar 18, 2021, 10:04 PM Randall Hauch wrote: > Thanks, Dongjin. > > We still have some time before this KIP might be approved, so I don’t want > to block any work on KIP-653. It’s fine for the KIP-653

Re: [DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-03-18 Thread Randall Hauch
Thanks, Dongjin. We still have some time before this KIP might be approved, so I don’t want to block any work on KIP-653. It’s fine for the KIP-653 PR to be merged first. I’ll just have to update my PR when this KIP passes. On Thu, Mar 18, 2021 at 1:30 AM Dongjin Lee wrote: > Hi Randall, > > I

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #610

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12454: Add ERROR logging on kafka-log-dirs when given brokerIds do not exist in current kafka cluster (#10304) --

[jira] [Created] (KAFKA-12496) Javadoc webpages should not be published to mirrors

2021-03-18 Thread Sebb (Jira)
Sebb created KAFKA-12496: Summary: Javadoc webpages should not be published to mirrors Key: KAFKA-12496 URL: https://issues.apache.org/jira/browse/KAFKA-12496 Project: Kafka Issue Type: Task

Re: [ANNOUNCE] New Kafka PMC Member: Chia-Ping Tsai

2021-03-18 Thread Satish Duggana
Congratulations Chia-Ping! On Thu, 18 Mar 2021 at 10:18, Kowshik Prakasam wrote: > Congrats Chia-Ping! > > On Tue, Mar 16, 2021, 6:16 PM Dongjin Lee wrote: > > > > > > > Best, > > Dongjin > > > > On Tue, Mar 16, 2021 at 2:20 PM Konstantine Karantasis > > wrote: > > > > > Congratulations

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #639

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12454: Add ERROR logging on kafka-log-dirs when given brokerIds do not exist in current kafka cluster (#10304) --

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

2021-03-18 Thread Levani Kokhreidze
Hello all, Thanks for the valuable feedback and interesting discussion. It seems like there’re no additional comments around the KIP, so I’d like to conclude the VOTING thread. The VOTING thread was open since the 8th of March, and the results are as follows: One non-binding vote (Bruno) Three

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #580

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12454: Add ERROR logging on kafka-log-dirs when given brokerIds do not exist in current kafka cluster (#10304) -- [...truncated

[jira] [Resolved] (KAFKA-12454) Add ERROR logging on kafka-log-dirs when given brokerIds do not exist in current kafka cluster

2021-03-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12454. Resolution: Fixed > Add ERROR logging on kafka-log-dirs when given brokerIds do not

Re: Inquiry about usage of Kafka Compression

2021-03-18 Thread Loren Abigail Sion
Hi Dongjin, Thank you for your very informative reply! Here's the answer to your questions: - What is the platform you are using? - We're currently using the following: Linux 4.4.0-89-generic #112-Ubuntu - Do you have enough space or permission for the temp directory?

[jira] [Created] (KAFKA-12495) Unbalanced connectors/tasks distribution will happen in Connect's incremental cooperative assignor

2021-03-18 Thread Luke Chen (Jira)
Luke Chen created KAFKA-12495: - Summary: Unbalanced connectors/tasks distribution will happen in Connect's incremental cooperative assignor Key: KAFKA-12495 URL: https://issues.apache.org/jira/browse/KAFKA-12495

Re: [DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

2021-03-18 Thread Dongjin Lee
Hi Randall, I am +1 for this proposal. Sure, changing this setting manually is so annoying. I think this proposal should be applied as soon as possible. However, I have a question: as you already know, the upgrade to Log4j2[^1] was already passed but not merged yet. Which one would be the right

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #638

2021-03-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-12459; Use property testing library for raft event simulation tests (#10323) -- [...truncated 3.68 MB...]