Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1615

See

[jira] [Created] (KAFKA-14757) Kafka Cooperative Sticky Assignor results in significant duplicate consumption

Siddharth Anand created KAFKA-14757: --- Summary: Kafka Cooperative Sticky Assignor results in significant duplicate consumption Key: KAFKA-14757 URL: https://issues.apache.org/jira/browse/KAFKA-14757

[jira] [Created] (KAFKA-14756) improve exactly-once-demo example and ExactlyOnceMessageProcessor

Luke Chen created KAFKA-14756: - Summary: improve exactly-once-demo example and ExactlyOnceMessageProcessor Key: KAFKA-14756 URL: https://issues.apache.org/jira/browse/KAFKA-14756 Project: Kafka

[jira] [Created] (KAFKA-14755) improve java-producer-consumer-demo

Luke Chen created KAFKA-14755: - Summary: improve java-producer-consumer-demo Key: KAFKA-14755 URL: https://issues.apache.org/jira/browse/KAFKA-14755 Project: Kafka Issue Type: Sub-task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1614

See

[jira] [Created] (KAFKA-14753) improve producer under example package

Luke Chen created KAFKA-14753: - Summary: improve producer under example package Key: KAFKA-14753 URL: https://issues.apache.org/jira/browse/KAFKA-14753 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14754) improve consumer under example package

Luke Chen created KAFKA-14754: - Summary: improve consumer under example package Key: KAFKA-14754 URL: https://issues.apache.org/jira/browse/KAFKA-14754 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14752) improve kafka examples under examples package

Luke Chen created KAFKA-14752: - Summary: improve kafka examples under examples package Key: KAFKA-14752 URL: https://issues.apache.org/jira/browse/KAFKA-14752 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-909: Allow clients to rebootstrap DNS lookup failure

Hey Ismael, Thanks for the feedback! The proposal is not to retry automatically but relies on the user polling the NetworkClient (basically, consumer.poll) to reattempt the bootstrap. If bootstrapping fails, a NetworkException (retriable) will be thrown. Thanks! P On Thu, Feb 23, 2023 at 1:34

[jira] [Created] (KAFKA-14751) Official website CONTACT page IRC channel link change

Koma Zhang created KAFKA-14751: -- Summary: Official website CONTACT page IRC channel link change Key: KAFKA-14751 URL: https://issues.apache.org/jira/browse/KAFKA-14751 Project: Kafka Issue

[jira] [Created] (KAFKA-14750) Sink connector fails if a source topic matching irs topics.regex gets deleted

Sergei Morozov created KAFKA-14750: -- Summary: Sink connector fails if a source topic matching irs topics.regex gets deleted Key: KAFKA-14750 URL: https://issues.apache.org/jira/browse/KAFKA-14750

[jira] [Created] (KAFKA-14749) Re-enable 'spotlessScalaCheck' task (in Jenkinsfile)

Dejan Stojadinović created KAFKA-14749: -- Summary: Re-enable 'spotlessScalaCheck' task (in Jenkinsfile) Key: KAFKA-14749 URL: https://issues.apache.org/jira/browse/KAFKA-14749 Project: Kafka

[jira] [Resolved] (KAFKA-14728) Remove 'spotlessScalaCheck' task (out of Jenkinsfile)

[ https://issues.apache.org/jira/browse/KAFKA-14728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejan Stojadinović resolved KAFKA-14728. Resolution: Fixed Solution is merged into trunk, hence resolvig as *fixed*. >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1613

See

Re: [DISCUSS] KIP-909: Allow clients to rebootstrap DNS lookup failure

Thanks for the KIP. Not sure if I missed it, but how long will we retry for and when do we give up and propagate the failure to the user? Ismael On Thu, Feb 23, 2023 at 9:30 AM Philip Nee wrote: > Hi all! > > I want to start a discussion thread about how we can handle client > bootstrap

Re: [DISCUSS] KIP-909: Allow clients to rebootstrap DNS lookup failure

Hey Ivan, (Also, thanks John!) Looping you in just for transparency. Let me know what do you think. Thanks! P On Thu, Feb 23, 2023 at 12:03 PM John Roesler wrote: > Thanks for the KIP, Philip! > > I think your proposal makes sense. I suspect the reason that we previously > did the DNS

Re: [DISCUSS] KIP-907: Add Boolean Serde to public interface

Hello Matthias, Thanks for looking into my first KIP. I’ve updated the confluence document and soon I will start voting. Kind regards Jakub > On Feb 23, 2023, at 8:23 AM, Matthias J. Sax wrote: > > Thanks for the KIP. > > Overall LGMT. > > One comment: Both `BooleanSerializer` and

Re: [DISCUSS] KIP-909: Allow clients to rebootstrap DNS lookup failure

Thanks for the KIP, Philip! I think your proposal makes sense. I suspect the reason that we previously did the DNS resolution in the constructor is to fail fast if the name is wrong. On the other hand, it's generally a hassle to do failure-prone or slow operations in a constructor, so I'm in

Re: [DISCUSS] KIP-907: Add Boolean Serde to public interface

Hello Matthias, Thanks for looking into my KIP and for an advice. I’ve added BooleanSerializer and BooleanDeserializer to the Public Interfaces. Kind regards Jakub > On Feb 23, 2023, at 8:23 AM, Matthias J. Sax wrote: > > Thanks for the KIP. > > Overall LGMT. > > One comment: Both

[jira] [Created] (KAFKA-14748) Relax non-null FK left-join requirement

Matthias J. Sax created KAFKA-14748: --- Summary: Relax non-null FK left-join requirement Key: KAFKA-14748 URL: https://issues.apache.org/jira/browse/KAFKA-14748 Project: Kafka Issue Type:

Re: [VOTE] KIP-890: Transactions Server Side Defense

Yup -- those are the main changes! On Thu, Feb 23, 2023 at 9:44 AM Guozhang Wang wrote: > Thanks Justine. I checked the diff between the two versions on wiki, > seems the major changes are: > > 1) Move the `verifyOnly` field of the request into each transaction > and hence we no longer have any

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1612

See

[jira] [Created] (KAFKA-14747) FK join should record discarded subscription responses

Matthias J. Sax created KAFKA-14747: --- Summary: FK join should record discarded subscription responses Key: KAFKA-14747 URL: https://issues.apache.org/jira/browse/KAFKA-14747 Project: Kafka

[jira] [Resolved] (KAFKA-14295) FetchMessageConversionsPerSec meter not recorded

[ https://issues.apache.org/jira/browse/KAFKA-14295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-14295. Fix Version/s: 3.5.0 Resolution: Fixed > FetchMessageConversionsPerSec meter not

Re: [VOTE] KIP-890: Transactions Server Side Defense

Thanks Justine. I checked the diff between the two versions on wiki, seems the major changes are: 1) Move the `verifyOnly` field of the request into each transaction and hence we no longer have any top-level primitive fields. 2) Add a top-level `errorCode` field in the response. Is that summary

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #158

See Changes: -- [...truncated 502534 lines...] [2023-02-23T17:28:35.077Z] [2023-02-23T17:28:35.077Z] 1: Task failed with an exception. [2023-02-23T17:28:35.077Z] ---

[jira] [Resolved] (KAFKA-14744) NPE while converting OffsetFetch from version < 8 to version >= 8

[ https://issues.apache.org/jira/browse/KAFKA-14744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14744. - Fix Version/s: 3.5.0 Resolution: Fixed > NPE while converting OffsetFetch from version <

[DISCUSS] KIP-909: Allow clients to rebootstrap DNS lookup failure

Hi all! I want to start a discussion thread about how we can handle client bootstrap failure due DNS lookup. This requires a bit of behavioral change, so a KIP is proposed and attached to this email. Let me know what you think! *A small remark here*: *As the title of this KIP might sound

Re: Hosting Kafka Videos on ASF YouTube channel

Actually adding Brian to CC now... On Thu, Feb 23, 2023 at 12:12 PM Joe Brockmeier wrote: > Hi Bill, > > On Thu, Feb 23, 2023 at 10:48 AM Bill Bejeck wrote: > >> It took a little time, but I have download links to share with you for >> the 4 Kafka Streams videos we want to host on the ASF

Re: Hosting Kafka Videos on ASF YouTube channel

Hi Bill, On Thu, Feb 23, 2023 at 10:48 AM Bill Bejeck wrote: > It took a little time, but I have download links to share with you for the > 4 Kafka Streams videos we want to host on the ASF Youtube channel, as > discussed on this thread >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #88

See Changes: -- [...truncated 523981 lines...] [2023-02-23T16:26:39.651Z] [2023-02-23T16:26:39.651Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 169 >

[jira] [Resolved] (KAFKA-5827) Allow configuring Kafka sink connectors to start processing records from the end of topics

[ https://issues.apache.org/jira/browse/KAFKA-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-5827. Resolution: Done > Allow configuring Kafka sink connectors to start processing records from the >

[jira] [Reopened] (KAFKA-5827) Allow configuring Kafka sink connectors to start processing records from the end of topics

[ https://issues.apache.org/jira/browse/KAFKA-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris reopened KAFKA-5827: > Allow configuring Kafka sink connectors to start processing records from the > end of topics >

[jira] [Created] (KAFKA-14746) Throwing in Connector.taskConfigs generates a lot of logs

Mickael Maison created KAFKA-14746: -- Summary: Throwing in Connector.taskConfigs generates a lot of logs Key: KAFKA-14746 URL: https://issues.apache.org/jira/browse/KAFKA-14746 Project: Kafka

Re: Hosting Kafka Videos on ASF YouTube channel

Joe, It took a little time, but I have download links to share with you for the 4 Kafka Streams videos we want to host on the ASF Youtube channel, as discussed on this thread . The "What is Apache Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1611

See Changes: -- [...truncated 523327 lines...] [2023-02-23T15:39:43.612Z] [INFO] Total time: 2.134 s [2023-02-23T15:39:43.612Z] [INFO] Finished at: 2023-02-23T15:39:43Z

[jira] [Created] (KAFKA-14745) MirrorSourceConnector keeps creating ReplicationPolicy instances

Mickael Maison created KAFKA-14745: -- Summary: MirrorSourceConnector keeps creating ReplicationPolicy instances Key: KAFKA-14745 URL: https://issues.apache.org/jira/browse/KAFKA-14745 Project: Kafka

Re: [VOTE] KIP-902: Upgrade Zookeeper to 3.8.1

Thanks for the KIP Christo. Having Zk 3.6 reach EOL in Dec 2022 is a good enough reason to upgrade, hence I completely agree with the motivation. Your experiments have demonstrated that the new version of Zk is stable at scale and the backward compatibility risks are acceptable since Apache Kafka

Re: Message conversion and TLS

My understanding of the produce message conversions metric is that the metric is specifically for message format up-conversion which is independent of TLS being enabled. It’s also worth noting that the zero-copy sendfile is not used on the produce path, only the fetch path. On Thu, Feb 23, 2023

Re: [VOTE] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

Thank you very much everyone! Regards, Tina On Wed, Feb 22, 2023 at 6:01 PM Mickael Maison wrote: > Thanks for the KIP! > > +1 binding > > On Wed, Feb 22, 2023 at 6:00 PM Chris Egerton > wrote: > > > > +1 (binding). Thanks again, Tina! > > > > On Wed, Feb 22, 2023 at 2:02 AM Luke Chen wrote:

[VOTE] KIP-902: Upgrade Zookeeper to 3.8.1

Hello! I would like to start the vote for KIP-902, which upgrades Zookeeper to version 3.8.1. The KIP can be found at https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240882784 The discussion thread is https://lists.apache.org/thread/5jbn2x0rtmqz5scyoygbdbj4vo0mpbw1 Thanks

Re: [DISCUSS] KIP-908: Add description field to connector configuration

Actually, I misspoke--a rebalance isn't triggered when an existing connector's config is updated. Assuming the set of workers remains stable, a rebalance is only necessary when a new connector is created, an existing one is deleted, or a new set of task configs is generated. This weakens the

[jira] [Resolved] (KAFKA-13690) Flaky test EosIntegrationTest.shouldWriteLatestOffsetsToCheckpointOnShutdown[at_least_once]

[ https://issues.apache.org/jira/browse/KAFKA-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov resolved KAFKA-13690. --- Resolution: Fixed > Flaky test >

[jira] [Resolved] (KAFKA-13966) Flaky test `QuorumControllerTest.testUnregisterBroker`

[ https://issues.apache.org/jira/browse/KAFKA-13966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov resolved KAFKA-13966. --- Resolution: Fixed > Flaky test `QuorumControllerTest.testUnregisterBroker` >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1610

See Changes: -- [...truncated 531321 lines...] [2023-02-23T12:56:17.038Z] [2023-02-23T12:56:17.038Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 176 >

Message conversion and TLS

Hey lads, I was thinking about message conversions and zero copy, as we know TLS will break the zero copy as the encrypt/decrypt happens in userland, correct? For example ProduceMessageConversionsPerSec will be triggered when a message must be converted (for example compressing at topic

Re: [DISCUSS] KIP-908: Add description field to connector configuration

Hi Mickael, Thanks for the KIP! While it's tempting to add this field to the out-of-the-box connector config def, I'm a little hesitant, for two reasons. 1. Adding this directly to the connector config could have unintended consequences on the actual data processing by the connector. Any time a

[jira] [Created] (KAFKA-14744) NPE while converting OffsetFetch from < 8 to >= 8

David Jacot created KAFKA-14744: --- Summary: NPE while converting OffsetFetch from < 8 to >= 8 Key: KAFKA-14744 URL: https://issues.apache.org/jira/browse/KAFKA-14744 Project: Kafka Issue Type:

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #87

See

[jira] [Created] (KAFKA-14743) MessageConversionsTimeMs metric is not updated

Luke Chen created KAFKA-14743: - Summary: MessageConversionsTimeMs metric is not updated Key: KAFKA-14743 URL: https://issues.apache.org/jira/browse/KAFKA-14743 Project: Kafka Issue Type: Bug

[DISCUSS] KIP-908: Add description field to connector configuration

Hi, I created a very small KIP to add a description field to connectors: https://cwiki.apache.org/confluence/display/KAFKA/KIP-908%3A+Add+description+field+to+connector+configuration Let me know if you have any feedback. Thanks, Mickael

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1609

See