[jira] [Created] (KAFKA-14494) Kafka Java client can't send data when behind SOCKS proxy - while native client can

Oleg Zhovtanyuk created KAFKA-14494: --- Summary: Kafka Java client can't send data when behind SOCKS proxy - while native client can Key: KAFKA-14494 URL: https://issues.apache.org/jira/browse/KAFKA-14494

Re: [ANNOUNCE] New committer: Ron Dagostino

Congratulations, Ron!! On Thu, 15 Dec 2022 at 07:48, ziming deng wrote: > Congratulations, Ron! > Well deserved! > > -- > Ziming > > > On Dec 15, 2022, at 09:16, Luke Chen wrote: > > > > Congratulations, Ron! > > Well deserved! > > > > Luke > >

[jira] [Reopened] (KAFKA-13602) Allow to broadcast a result record

[ https://issues.apache.org/jira/browse/KAFKA-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman reopened KAFKA-13602: Reverting in 3.4 due to logging-related perf/security issue, and some open

[jira] [Resolved] (KAFKA-13736) Flaky kafka.network.SocketServerTest.closingChannelWithBufferedReceives

[ https://issues.apache.org/jira/browse/KAFKA-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-13736. Resolution: Fixed > Flaky

[jira] [Resolved] (KAFKA-4852) ByteBufferSerializer not compatible with offsets

[ https://issues.apache.org/jira/browse/KAFKA-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-4852. --- Resolution: Fixed > ByteBufferSerializer not compatible with offsets >

[jira] [Resolved] (KAFKA-14291) KRaft: ApiVersionsResponse doesn't have finalizedFeatures and finalizedFeatureEpoch in KRaft mode

[ https://issues.apache.org/jira/browse/KAFKA-14291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-14291. Resolution: Duplicate Marking this as a duplicate of KAFKA-13990 as

[jira] [Created] (KAFKA-14493) Zk to KRaft migration state machine in KRaft controller

Akhilesh Chaganti created KAFKA-14493: - Summary: Zk to KRaft migration state machine in KRaft controller Key: KAFKA-14493 URL: https://issues.apache.org/jira/browse/KAFKA-14493 Project: Kafka

Re: [ANNOUNCE] New committer: Ron Dagostino

Congratulations, Ron! Well deserved! -- Ziming > On Dec 15, 2022, at 09:16, Luke Chen wrote: > > Congratulations, Ron! > Well deserved! > > Luke

[jira] [Created] (KAFKA-14492) Extract a method to create LogManager, in order to be overrided by subclass of KafkaServer

Phantom Ma created KAFKA-14492: -- Summary: Extract a method to create LogManager, in order to be overrided by subclass of KafkaServer Key: KAFKA-14492 URL: https://issues.apache.org/jira/browse/KAFKA-14492

Re: [DISCUSS] Apache Kafka 3.4.0 release

Hey Ron, sure, go ahead and merge this to 3.4 Thanks On Mon, Dec 12, 2022 at 12:25 PM Ron Dagostino wrote: > Hi Sophie. https://github.com/apache/kafka/pull/12856 "KAFKA-14392: > KRaft broker heartbeat timeout should not exceed > broker.session.timeout.ms" just merged to trunk and seems like a

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

Thanks Divij for the KIP. I wanted to clarify on a couple of points mentioned in your earlier reply. 1. RSM fetch interface already exposes a streaming interface and it also does not mandate reading the complete segment before serving the fetch request. Let me know if we are missing anything

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #137

See Changes: -- [...truncated 336428 lines...] [2022-12-14T22:42:20.395Z] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread

[jira] [Resolved] (KAFKA-14395) Add config to configure client supplier for KafkaStreams

[ https://issues.apache.org/jira/browse/KAFKA-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Li resolved KAFKA-14395. Resolution: Done > Add config to configure client supplier for KafkaStreams >

Re: [DISCUSS] Apache Kafka 3.3.2

Hey Chris, Here are the results of just running the upgrade system tests on the latest 3.3 branch:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1436

See Changes: -- [...truncated 521622 lines...] [2022-12-14T23:41:04.670Z] [2022-12-14T23:41:04.670Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 166 >

Re: [ANNOUNCE] New committer: Viktor Somogyi-Vass

Congrats, Viktor! On Wed, Dec 14, 2022, 18:10 Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Viktor > Somogyi-Vass. > > Viktor has been contributing to Kafka since 2018. He contributed 35 PRs and > reviewed 49 PRs. > > Congratulations,

Re: [ANNOUNCE] New committer: Ron Dagostino

Congrats, Ron! On Wed, Dec 14, 2022, 18:11 Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Ron > Dagostino. > > Ron has been contributing to Kafka since 2018. He has made significant > contributions including OAuth and Sasl

[ANNOUNCE] New committer: Ron Dagostino

Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Ron Dagostino. Ron has been contributing to Kafka since 2018. He has made significant contributions including OAuth and Sasl re-authentication. Congratulations, Ron! Thanks, Jun (on behalf of the Apache Kafka

[ANNOUNCE] New committer: Viktor Somogyi-Vass

Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Viktor Somogyi-Vass. Viktor has been contributing to Kafka since 2018. He contributed 35 PRs and reviewed 49 PRs. Congratulations, Viktor! Thanks, Jun (on behalf of the Apache Kafka PMC)

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #10

See

[jira] [Created] (KAFKA-14491) Introduce Versioned Key-Value Stores to Kafka Streams

Victoria Xia created KAFKA-14491: Summary: Introduce Versioned Key-Value Stores to Kafka Streams Key: KAFKA-14491 URL: https://issues.apache.org/jira/browse/KAFKA-14491 Project: Kafka Issue

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.2 #95

See Changes: -- [...truncated 225023 lines...] [2022-12-14T22:14:42.229Z] > Task :connect:api:jar UP-TO-DATE [2022-12-14T22:14:42.229Z] > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #139

See Changes: -- [...truncated 367453 lines...] [2022-12-14T21:48:43.662Z] Execution optimizations have been disabled for task ':streams:processMessages' to ensure

[jira] [Created] (KAFKA-14490) Consider using UncheckdIOException instead of IOException in the log layer

Ismael Juma created KAFKA-14490: --- Summary: Consider using UncheckdIOException instead of IOException in the log layer Key: KAFKA-14490 URL: https://issues.apache.org/jira/browse/KAFKA-14490 Project:

Re: [DISCUSS] KIP-890 Server Side Defense

Thanks Matthias, I think we are on the same page. The concern I had about your solution with the old clients is that we can't distinguish between a late message and a message intended for the new transaction on old clients -- basically any late message can turn into case 1. I chose to rely on

[jira] [Created] (KAFKA-14489) Adjust visibility of classes moved to storage module

Ismael Juma created KAFKA-14489: --- Summary: Adjust visibility of classes moved to storage module Key: KAFKA-14489 URL: https://issues.apache.org/jira/browse/KAFKA-14489 Project: Kafka Issue

[jira] [Created] (KAFKA-14487) Move LogManager to storage module

Ismael Juma created KAFKA-14487: --- Summary: Move LogManager to storage module Key: KAFKA-14487 URL: https://issues.apache.org/jira/browse/KAFKA-14487 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14488) Move log layer tests to storage module

Ismael Juma created KAFKA-14488: --- Summary: Move log layer tests to storage module Key: KAFKA-14488 URL: https://issues.apache.org/jira/browse/KAFKA-14488 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14486) Move LogCleanerManager to storage module

Ismael Juma created KAFKA-14486: --- Summary: Move LogCleanerManager to storage module Key: KAFKA-14486 URL: https://issues.apache.org/jira/browse/KAFKA-14486 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14485) Move LogCleaner to storage module

Ismael Juma created KAFKA-14485: --- Summary: Move LogCleaner to storage module Key: KAFKA-14485 URL: https://issues.apache.org/jira/browse/KAFKA-14485 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14484) Move UnifiedLog to storage module

Ismael Juma created KAFKA-14484: --- Summary: Move UnifiedLog to storage module Key: KAFKA-14484 URL: https://issues.apache.org/jira/browse/KAFKA-14484 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14483) Move LocalLog to storage module

Ismael Juma created KAFKA-14483: --- Summary: Move LocalLog to storage module Key: KAFKA-14483 URL: https://issues.apache.org/jira/browse/KAFKA-14483 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14482) Move LogLoader to storage module

Ismael Juma created KAFKA-14482: --- Summary: Move LogLoader to storage module Key: KAFKA-14482 URL: https://issues.apache.org/jira/browse/KAFKA-14482 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14481) Move LogSegment/LogSegments to storage

Ismael Juma created KAFKA-14481: --- Summary: Move LogSegment/LogSegments to storage Key: KAFKA-14481 URL: https://issues.apache.org/jira/browse/KAFKA-14481 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14480) Move ProducerStateManager to storage module

Ismael Juma created KAFKA-14480: --- Summary: Move ProducerStateManager to storage module Key: KAFKA-14480 URL: https://issues.apache.org/jira/browse/KAFKA-14480 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14478) Move LogConfig to storage module

Ismael Juma created KAFKA-14478: --- Summary: Move LogConfig to storage module Key: KAFKA-14478 URL: https://issues.apache.org/jira/browse/KAFKA-14478 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14479) Move CleanerConfig to storage

Ismael Juma created KAFKA-14479: --- Summary: Move CleanerConfig to storage Key: KAFKA-14479 URL: https://issues.apache.org/jira/browse/KAFKA-14479 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14477) Move LogValidator to storage module

Ismael Juma created KAFKA-14477: --- Summary: Move LogValidator to storage module Key: KAFKA-14477 URL: https://issues.apache.org/jira/browse/KAFKA-14477 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] Apache Kafka 3.3.2

Hi José, Thanks for your help! I was able to locally rerun two of the three failed tests and get passing results; the reports for them can be found at: https://home.apache.org/~cegerton/system_tests/2022-12-14--015/report.html (Connect REST test)

[jira] [Created] (KAFKA-14476) Move OffsetMap to storage module

Ismael Juma created KAFKA-14476: --- Summary: Move OffsetMap to storage module Key: KAFKA-14476 URL: https://issues.apache.org/jira/browse/KAFKA-14476 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14475) Move TimestampIndex/LazyIndex to storage module

Ismael Juma created KAFKA-14475: --- Summary: Move TimestampIndex/LazyIndex to storage module Key: KAFKA-14475 URL: https://issues.apache.org/jira/browse/KAFKA-14475 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14474) Move OffsetIndex to storage module

Ismael Juma created KAFKA-14474: --- Summary: Move OffsetIndex to storage module Key: KAFKA-14474 URL: https://issues.apache.org/jira/browse/KAFKA-14474 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14473) Move AbstractIndex to storage module

Ismael Juma created KAFKA-14473: --- Summary: Move AbstractIndex to storage module Key: KAFKA-14473 URL: https://issues.apache.org/jira/browse/KAFKA-14473 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14471) Move IndexEntry and related to storage module

Ismael Juma created KAFKA-14471: --- Summary: Move IndexEntry and related to storage module Key: KAFKA-14471 URL: https://issues.apache.org/jira/browse/KAFKA-14471 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-14472) Move TransactionIndex and related to storage module

Ismael Juma created KAFKA-14472: --- Summary: Move TransactionIndex and related to storage module Key: KAFKA-14472 URL: https://issues.apache.org/jira/browse/KAFKA-14472 Project: Kafka Issue

[jira] [Created] (KAFKA-14470) Move log layer to storage module

Ismael Juma created KAFKA-14470: --- Summary: Move log layer to storage module Key: KAFKA-14470 URL: https://issues.apache.org/jira/browse/KAFKA-14470 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1435

See Changes: -- [...truncated 435669 lines...] [2022-12-14T20:55:06.024Z] > Task :group-coordinator:testClasses UP-TO-DATE [2022-12-14T20:55:06.024Z] > Task

[VOTE] KIP-887 - Add ConfigProvider to make use of environment variables

Hi all, Thank you for the feedback so far. The KIP is rather straightforward and I'd like to start a vote on it. Please have a look at the KIP: https://cwiki.apache.org/confluence/x/15jGDQ Thanks, Roman

Re: [DISCUSS] KIP-889 Versioned State Stores

Thanks for clarifying about the null-question. SGTM. On 12/13/22 3:06 PM, Victoria Xia wrote: Hi Matthias, Thanks for chiming in! Barring objections from anyone on this thread, I will start the vote for this KIP on Thursday. That should be enough time to incorporate any lingering minor

Re: [DISCUSS] KIP-890 Server Side Defense

What I mean is the following: For both scenarios, late message or missing addPartitionToTxnRequest, a record r is written to partition X, but X is not registered at the TX-coordinator. Now there are two cases: (1) A follow up transaction writes more data to the same partition X, and r

[GitHub] [kafka-site] mjsax merged pull request #466: MINOR: add docs table entries for new metrics

mjsax merged PR #466: URL: https://github.com/apache/kafka-site/pull/466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka-site] mjsax opened a new pull request, #466: MINOR: add docs table entries for new metrics

mjsax opened a new pull request, #466: URL: https://github.com/apache/kafka-site/pull/466 Follow up PR to https://github.com/apache/kafka/pull/12934 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka-site] mjsax merged pull request #465: MINOR: update Streams upgrade guide for 3.1 release

mjsax merged PR #465: URL: https://github.com/apache/kafka-site/pull/465 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka-site] mjsax opened a new pull request, #465: MINOR: update Streams upgrade guide for 3.1 release

mjsax opened a new pull request, #465: URL: https://github.com/apache/kafka-site/pull/465 Follow up PR to https://github.com/apache/kafka/pull/12926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [DISCUSS] KIP-890 Server Side Defense

Matthias — thanks again for taking time to look a this. You said: > My proposal was only focusing to avoid dangling transactions if records are added without registered partition. -- Maybe you can add a few more details to the KIP about this scenario for better documentation purpose? I'm not

Re: [DISCUSS] Apache Kafka 3.3.2

Hey all, Here are the system test results for the 3.3 branch: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1670984851--apache--3.3--22af3f29ce/2022-12-13--001./2022-12-13--001./report.html The commit for that run is

Re: [DISCUSS] KIP-890 Server Side Defense

Hi, Justine, Thanks for the KIP. A couple of comments. 70. Currently, the producer epoch is an int. I am not sure if it's enough to accommodate all transactions in the lifetime of a producer. Should we change that to a long or add a new long field like txnId? 71. "it will write the prepare

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1434

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1433

See

[jira] [Created] (KAFKA-14469) Fix inconsistency in config name between code and KIP-405

Divij Vaidya created KAFKA-14469: Summary: Fix inconsistency in config name between code and KIP-405 Key: KAFKA-14469 URL: https://issues.apache.org/jira/browse/KAFKA-14469 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #9

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #136

See

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

> Is the new method enough for doing size-based retention? Yes. You are right in assuming that this API only provides the Remote storage size (for current epoch chain). We would use this API for size based retention along with a value of localOnlyLogSegmentSize which is computed as