[GitHub] [kafka] justinrlee commented on pull request #12797: MINOR: Remove requirement to specify --bootstrap-server in utility scripts if specified in property file

2023-01-06 Thread GitBox
justinrlee commented on PR #12797: URL: https://github.com/apache/kafka/pull/12797#issuecomment-1374119222 Give me a little bit, will add sample outputs for different scenarios shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [kafka] michaeljmarshall commented on a diff in pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2023-01-06 Thread GitBox
michaeljmarshall commented on code in PR #13032: URL: https://github.com/apache/kafka/pull/13032#discussion_r1063786426 ## clients/src/test/java/org/apache/kafka/common/protocol/DataOutputStreamWritableTest.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] michaeljmarshall commented on pull request #13032: KAFKA-14540: Fix DataOutputStreamWritable#writeByteBuffer

2023-01-06 Thread GitBox
michaeljmarshall commented on PR #13032: URL: https://github.com/apache/kafka/pull/13032#issuecomment-1374113532 Thanks for catching my mistake @viktorsomogyi. My mistake was trusting IntelliJ to run the test. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] chia7712 commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-06 Thread GitBox
chia7712 commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063758284 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,63 @@ class ReplicaManagerTest {

[GitHub] [kafka] chia7712 commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-06 Thread GitBox
chia7712 commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063756861 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063733019 ## core/src/test/scala/unit/kafka/log/ProducerStateManagerTest.scala: ## @@ -255,15 +259,28 @@ class ProducerStateManagerTest { appendData(30L, 31L, secondAppend)

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063726604 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerAppendInfo.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063725076 ## core/src/main/scala/kafka/log/LogCleaner.scala: ## @@ -174,7 +174,8 @@ class LogCleaner(initialConfig: CleanerConfig, } override def

[GitHub] [kafka] gharris1727 commented on pull request #13087: KAFKA-14600: Reduce flakiness in ProducerIdExpirationTest

2023-01-06 Thread GitBox
gharris1727 commented on PR #13087: URL: https://github.com/apache/kafka/pull/13087#issuecomment-1374038135 @jolshan could you take a look at this as well? I didn't realize these two tests were failing in a similar fashion. -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] gharris1727 opened a new pull request, #13087: KAFKA-14600: Reduce flakiness in ProducerIdExpirationTest

2023-01-06 Thread GitBox
gharris1727 opened a new pull request, #13087: URL: https://github.com/apache/kafka/pull/13087 The broker appears to be timing out the producer ID before the test can see it. Increase the timeouts to compensate for slower CI environments. Similar to the fix applied in #13036

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063722024 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063720614 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,148 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063720614 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,148 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063714637 ## storage/src/main/java/org/apache/kafka/server/log/internals/TxnMetadata.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] ijuma commented on pull request #13046: KAFKA-14551 Move LeaderEpochFileCache and its dependencies to the storage module.

2023-01-06 Thread GitBox
ijuma commented on PR #13046: URL: https://github.com/apache/kafka/pull/13046#issuecomment-1374023466 I have a few more comments on this PR, will get back to it soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move LeaderEpochFileCache and its dependencies to the storage module.

2023-01-06 Thread GitBox
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1063709428 ## storage/src/main/java/org/apache/kafka/server/log/internals/LeaderEpochFileCache.java: ## @@ -0,0 +1,380 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move LeaderEpochFileCache and its dependencies to the storage module.

2023-01-06 Thread GitBox
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1063708632 ## core/src/main/scala/kafka/server/checkpoints/OffsetCheckpointFile.scala: ## @@ -65,9 +65,14 @@ class OffsetCheckpointFile(val file: File, logDirFailureChannel:

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move LeaderEpochFileCache and its dependencies to the storage module.

2023-01-06 Thread GitBox
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1063705498 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -995,11 +994,12 @@ class UnifiedLog(@volatile var logStartOffset: Long, } } - def latestEpoch:

[GitHub] [kafka] gharris1727 commented on pull request #13086: KAFKA-14535: Fix flaky EndToEndAuthorization tests which were sensitive to ACL change reordering

2023-01-06 Thread GitBox
gharris1727 commented on PR #13086: URL: https://github.com/apache/kafka/pull/13086#issuecomment-1374008851 The last people working in this area were @pprovenzano @omkreddy and @soarez, if any of you have some time i'd appreciate a review on this test which flakes ~10-20% of the time.

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063688608 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] gharris1727 opened a new pull request, #13086: KAFKA-14535: Fix flaky EndToEndAuthorization tests which were sensitive to ACL change reordering

2023-01-06 Thread GitBox
gharris1727 opened a new pull request, #13086: URL: https://github.com/apache/kafka/pull/13086 The ACL change methods (create, delete) are eventually consistent across a Kafka cluster. As part of that, changes to the same resource made to different brokers may be reordered. In this test, a

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063687740 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1249,12 +1249,10 @@ class UnifiedLog(@volatile var logStartOffset: Long, isolation: FetchIsolation,

[GitHub] [kafka] junrao commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-06 Thread GitBox
junrao commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063679649 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] satishd commented on pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
satishd commented on PR #13043: URL: https://github.com/apache/kafka/pull/13043#issuecomment-1373959751 Thanks @ijuma for the review. I address them in the code and replied to your comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] chia7712 commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-06 Thread GitBox
chia7712 commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063654698 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] chia7712 commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-06 Thread GitBox
chia7712 commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063654318 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] fvaleri commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
fvaleri commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063631875 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063613984 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063613984 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] fvaleri commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
fvaleri commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063609877 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063598351 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] fvaleri commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
fvaleri commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063594153 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] emilnkrastev commented on a diff in pull request #11818: KAFKA-12558: Do not prematurely mutate partiton state and provide con…

2023-01-06 Thread GitBox
emilnkrastev commented on code in PR #11818: URL: https://github.com/apache/kafka/pull/11818#discussion_r1063563770 ## connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceTask.java: ## @@ -69,14 +69,19 @@ public MirrorSourceTask() {} // for testing

[GitHub] [kafka] emilnkrastev commented on a diff in pull request #11818: KAFKA-12558: Do not prematurely mutate partiton state and provide con…

2023-01-06 Thread GitBox
emilnkrastev commented on code in PR #11818: URL: https://github.com/apache/kafka/pull/11818#discussion_r1063558786 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/MirrorSourceTaskTest.java: ## @@ -81,15 +88,25 @@ public void testOffsetSync() {

[GitHub] [kafka] emilnkrastev commented on a diff in pull request #11818: KAFKA-12558: Do not prematurely mutate partiton state and provide con…

2023-01-06 Thread GitBox
emilnkrastev commented on code in PR #11818: URL: https://github.com/apache/kafka/pull/11818#discussion_r1063558786 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/MirrorSourceTaskTest.java: ## @@ -81,15 +88,25 @@ public void testOffsetSync() {

[GitHub] [kafka] ijuma commented on a diff in pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
ijuma commented on code in PR #13085: URL: https://github.com/apache/kafka/pull/13085#discussion_r1063544116 ## storage/src/main/java/org/apache/kafka/server/log/internals/FetchIsolation.java: ## @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] fvaleri commented on pull request #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
fvaleri commented on PR #13085: URL: https://github.com/apache/kafka/pull/13085#issuecomment-1373794678 @ijuma @satishd fyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [kafka] fvaleri opened a new pull request, #13085: KAFKA-14568: Move FetchDataInfo and related to storage module

2023-01-06 Thread GitBox
fvaleri opened a new pull request, #13085: URL: https://github.com/apache/kafka/pull/13085 Part of KAFKA-14470: Move log layer to storage module. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] vladimirdyuzhev commented on a diff in pull request #13081: Re-using callbackHandler for refreshing Kerberos TGT when keytab is not used

2023-01-06 Thread GitBox
vladimirdyuzhev commented on code in PR #13081: URL: https://github.com/apache/kafka/pull/13081#discussion_r1063475320 ## clients/src/main/java/org/apache/kafka/common/security/kerberos/KerberosLogin.java: ## @@ -90,6 +91,7 @@ public void configure(Map configs, String

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-06 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063467329 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerAppendInfo.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] calmera commented on pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on PR #12742: URL: https://github.com/apache/kafka/pull/12742#issuecomment-1373454834 I agree we need to have some tests for that but that will require a bit more time and effort. I'll try to allocate some time to get that done, but if there is someone else who wants to

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063323844 ## streams/src/main/java/org/apache/kafka/streams/Topology.java: ## @@ -737,6 +737,91 @@ public synchronized Topology addStateStore(final StoreBuilder storeBuilder,

[GitHub] [kafka] tombentley merged pull request #13071: MINOR: doc: note how JDK-8136913 can affect client SASL

2023-01-06 Thread GitBox
tombentley merged PR #13071: URL: https://github.com/apache/kafka/pull/13071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063316877 ## docs/streams/developer-guide/processor-api.html: ## @@ -396,6 +397,21 @@ + +ReadOnly

[GitHub] [kafka] ashwinpankaj opened a new pull request, #13084: KAFKA-14598: Fix flaky ConnectRestApiTest

2023-01-06 Thread GitBox
ashwinpankaj opened a new pull request, #13084: URL: https://github.com/apache/kafka/pull/13084 https://issues.apache.org/jira/browse/KAFKA-14598 ConnectRestApiTest sometimes fails with the message ``` ConnectRestError(404, '\n\n\nError 404 Not Found\n\nHTTP ERROR 404 Not

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063310192 ## docs/streams/developer-guide/processor-api.html: ## @@ -396,6 +397,21 @@ + +ReadOnly

[GitHub] [kafka] rajinisivaram commented on a diff in pull request #13081: Re-using callbackHandler for refreshing Kerberos TGT when keytab is not used

2023-01-06 Thread GitBox
rajinisivaram commented on code in PR #13081: URL: https://github.com/apache/kafka/pull/13081#discussion_r1063281046 ## clients/src/main/java/org/apache/kafka/common/security/kerberos/KerberosLogin.java: ## @@ -90,6 +91,7 @@ public void configure(Map configs, String

[GitHub] [kafka] rajinisivaram commented on pull request #13081: Re-using callbackHandler for refreshing Kerberos TGT when keytab is not used

2023-01-06 Thread GitBox
rajinisivaram commented on PR #13081: URL: https://github.com/apache/kafka/pull/13081#issuecomment-1373402351 @vladimirdyuzhev Thanks for the PR. Since this is a security-related change, can we create a JIRA with the details from the PR description and include the ticket in the PR title?

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063273259 ## streams/src/test/java/org/apache/kafka/test/MockProcessor.java: ## @@ -28,9 +29,11 @@ import java.util.List; import java.util.Map;

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063271295 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamBranchTest.java: ## @@ -59,7 +59,7 @@ public void testKStreamBranch() {

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063270375 ## streams/src/main/java/org/apache/kafka/streams/Topology.java: ## @@ -737,6 +737,91 @@ public synchronized Topology addStateStore(final StoreBuilder storeBuilder,

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-06 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1063269411 ## streams/src/main/java/org/apache/kafka/streams/Topology.java: ## @@ -737,6 +737,91 @@ public synchronized Topology addStateStore(final StoreBuilder storeBuilder,

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063066837 ## storage/src/main/java/org/apache/kafka/server/log/internals/TxnMetadata.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063066837 ## storage/src/main/java/org/apache/kafka/server/log/internals/TxnMetadata.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063147960 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerAppendInfo.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063066837 ## storage/src/main/java/org/apache/kafka/server/log/internals/TxnMetadata.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063072191 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerAppendInfo.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063071578 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerAppendInfo.java: ## @@ -0,0 +1,238 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063070497 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063068193 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063067653 ## storage/src/main/java/org/apache/kafka/server/log/internals/LastRecord.java: ## @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063067362 ## core/src/test/scala/unit/kafka/log/LogSegmentTest.scala: ## @@ -354,9 +356,10 @@ class LogSegmentTest { // recover again, but this time assuming the

[GitHub] [kafka] satishd commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
satishd commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1063066837 ## storage/src/main/java/org/apache/kafka/server/log/internals/TxnMetadata.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] showuon commented on pull request #13083: MINOR: bump year in NOTICE

2023-01-05 Thread GitBox
showuon commented on PR #13083: URL: https://github.com/apache/kafka/pull/13083#issuecomment-1373098778 Happy new year! :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [kafka] ijuma commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
ijuma commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063058965 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] ableegoldman merged pull request #13083: MINOR: bump year in NOTICE

2023-01-05 Thread GitBox
ableegoldman merged PR #13083: URL: https://github.com/apache/kafka/pull/13083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] ableegoldman opened a new pull request, #13083: MINOR: bump year in NOTICE

2023-01-05 Thread GitBox
ableegoldman opened a new pull request, #13083: URL: https://github.com/apache/kafka/pull/13083 It's 2023 now y'all -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka] ableegoldman closed pull request #7824: MINOR: flush only the evicted dirty entry

2023-01-05 Thread GitBox
ableegoldman closed pull request #7824: MINOR: flush only the evicted dirty entry URL: https://github.com/apache/kafka/pull/7824 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka] jolshan commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
jolshan commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063013207 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] jolshan commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
jolshan commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063013207 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] jolshan commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
jolshan commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063012777 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] junrao commented on a diff in pull request #13046: KAFKA-14551 Move LeaderEpochFileCache and its dependencies to the storage module.

2023-01-05 Thread GitBox
junrao commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1063005106 ## core/src/test/scala/unit/kafka/server/epoch/LeaderEpochFileCacheTest.scala: ## @@ -243,282 +245,287 @@ class LeaderEpochFileCacheTest { //Given val cache

[GitHub] [kafka] chia7712 commented on a diff in pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
chia7712 commented on code in PR #13075: URL: https://github.com/apache/kafka/pull/13075#discussion_r1063007860 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -205,6 +205,61 @@ class ReplicaManagerTest {

[GitHub] [kafka] littlehorse-eng commented on a diff in pull request #13082: MINOR: Clarify docs for Streams config max.warmup.replicas.

2023-01-05 Thread GitBox
littlehorse-eng commented on code in PR #13082: URL: https://github.com/apache/kafka/pull/13082#discussion_r1062979323 ## docs/streams/developer-guide/config-streams.html: ## @@ -778,10 +778,21 @@ rack.aware.assignment.tagsmax.warmup.replicas -

[GitHub] [kafka] littlehorse-eng opened a new pull request, #13082: MINOR: Clarify docs for Streams config max.warmup.replicas.

2023-01-05 Thread GitBox
littlehorse-eng opened a new pull request, #13082: URL: https://github.com/apache/kafka/pull/13082 Documentation only—Minor clarification on how max.warmup.replicas works; specifically, that one "warmup replica" corresponds to a Task that is restoring its state. Also clarifies how

[GitHub] [kafka] chia7712 commented on pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
chia7712 commented on PR #13075: URL: https://github.com/apache/kafka/pull/13075#issuecomment-1372912104 > is this because the log's highwatermark is lower or higher than the futureLog's? higher, and thanks to @junrao for the great explanation. -- This is an automated

[GitHub] [kafka] vladimirdyuzhev commented on pull request #13081: Re-using callbackHandler for refreshing Kerberos TGT when keytab is not used

2023-01-05 Thread GitBox
vladimirdyuzhev commented on PR #13081: URL: https://github.com/apache/kafka/pull/13081#issuecomment-1372892329 Some tests are failed, but apparently it has nothing to do with Kerberos: ``` testSendNonCompressedMessageWithCreateTime(String) >

[GitHub] [kafka] jolshan commented on pull request #13075: KAFKA-9087 Replace log high watermark by future log high watermark wh…

2023-01-05 Thread GitBox
jolshan commented on PR #13075: URL: https://github.com/apache/kafka/pull/13075#issuecomment-1372876700 So the error occurs when the fetch offset is not the futureLog's log end offset. Just curious -- is this because the log's highwatermark is lower or higher than the futureLog's?

[GitHub] [kafka] jsancio commented on pull request #13077: KAFKA-14279; Add 3.3.x streams system tests

2023-01-05 Thread GitBox
jsancio commented on PR #13077: URL: https://github.com/apache/kafka/pull/13077#issuecomment-1372724189 Same failure again:

[GitHub] [kafka] mjsax commented on a diff in pull request #13077: KAFKA-14279; Add 3.3.x streams system tests

2023-01-05 Thread GitBox
mjsax commented on code in PR #13077: URL: https://github.com/apache/kafka/pull/13077#discussion_r1062838773 ## streams/upgrade-system-tests-33/src/test/java/org/apache/kafka/streams/tests/StreamsUpgradeTest.java: ## @@ -0,0 +1,121 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] jsancio merged pull request #13076: KAFKA-14279; Add 3.3.x to core compatibility tests

2023-01-05 Thread GitBox
jsancio merged PR #13076: URL: https://github.com/apache/kafka/pull/13076 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] vladimirdyuzhev opened a new pull request, #13081: Re-using callbackHandler for refreshing Kerberos TGT when keytab is not used

2023-01-05 Thread GitBox
vladimirdyuzhev opened a new pull request, #13081: URL: https://github.com/apache/kafka/pull/13081 When keytab file is not used, and the necessary configuration data are provided by the SASL callback handler, the Kerberos TGT renewal fails because the code is not re-using the configured

[GitHub] [kafka] philipnee commented on a diff in pull request #13021: KAFKA-14468: Implement CommitRequestManager to manage the commit and autocommit requests

2023-01-05 Thread GitBox
philipnee commented on code in PR #13021: URL: https://github.com/apache/kafka/pull/13021#discussion_r1062809110 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -0,0 +1,273 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] junrao commented on a diff in pull request #13049: KAFKA-14478: Move LogConfig/CleanerConfig and related to storage module

2023-01-05 Thread GitBox
junrao commented on code in PR #13049: URL: https://github.com/apache/kafka/pull/13049#discussion_r1062797781 ## server-common/src/main/java/org/apache/kafka/server/config/ServerTopicConfigSynonyms.java: ## @@ -0,0 +1,140 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] jsancio commented on pull request #13077: KAFKA-14545; Add 3.3.x streams system tests

2023-01-05 Thread GitBox
jsancio commented on PR #13077: URL: https://github.com/apache/kafka/pull/13077#issuecomment-1372590378 Here are the system test results:

[GitHub] [kafka] jsancio commented on pull request #13076: KAFKA-14279; Add 3.3.x to core compatibility tests

2023-01-05 Thread GitBox
jsancio commented on PR #13076: URL: https://github.com/apache/kafka/pull/13076#issuecomment-1372586923 Thanks for the review @ijuma. Here are the results:

[GitHub] [kafka] gharris1727 commented on a diff in pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-01-05 Thread GitBox
gharris1727 commented on code in PR #12984: URL: https://github.com/apache/kafka/pull/12984#discussion_r1062744806 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java: ## @@ -723,7 +752,11 @@ private void sendPrivileged(String key,

[GitHub] [kafka] gharris1727 commented on a diff in pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-01-05 Thread GitBox
gharris1727 commented on code in PR #12984: URL: https://github.com/apache/kafka/pull/12984#discussion_r1062726003 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java: ## @@ -712,8 +733,16 @@ KafkaBasedLog

[GitHub] [kafka] mimaison opened a new pull request, #13080: KAFKA-14575: Move ClusterTool to tools module

2023-01-05 Thread GitBox
mimaison opened a new pull request, #13080: URL: https://github.com/apache/kafka/pull/13080 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062646329 ## metadata/src/main/java/org/apache/kafka/controller/MigrationControlManager.java: ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062645398 ## metadata/src/main/java/org/apache/kafka/metadata/migration/BrokersRpcClient.java: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062640868 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -348,7 +345,7 @@ class KafkaServer( time = time, metrics = metrics,

[GitHub] [kafka] ijuma commented on a diff in pull request #13043: KAFKA-14558: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module

2023-01-05 Thread GitBox
ijuma commented on code in PR #13043: URL: https://github.com/apache/kafka/pull/13043#discussion_r1062635407 ## storage/src/main/java/org/apache/kafka/server/log/internals/ProducerStateEntry.java: ## @@ -0,0 +1,149 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062634566 ## core/src/main/scala/kafka/server/BrokerLifecycleManager.scala: ## @@ -292,7 +292,7 @@ class BrokerLifecycleManager( } val data = new

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062634160 ## core/src/main/scala/kafka/server/BrokerLifecycleManager.scala: ## @@ -55,7 +55,7 @@ class BrokerLifecycleManager( val config: KafkaConfig, val time: Time,

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062628793 ## core/src/main/scala/kafka/server/BrokerEpochManager.scala: ## @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] cmccabe commented on a diff in pull request #12998: KAFKA-14493: Introduce Zk to KRaft migration state machine STUBs in KRaft controller.

2023-01-05 Thread GitBox
cmccabe commented on code in PR #12998: URL: https://github.com/apache/kafka/pull/12998#discussion_r1062627093 ## clients/src/main/resources/common/message/BrokerRegistrationRequest.json: ## @@ -51,7 +51,7 @@ }, { "name": "Rack", "type": "string", "versions": "0+",

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-05 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1062611257 ## docs/streams/developer-guide/processor-api.html: ## @@ -396,6 +397,21 @@ + +ReadOnly

[GitHub] [kafka] calmera commented on a diff in pull request #12742: KAFKA-10892: Shared Readonly State Stores ( revisited )

2023-01-05 Thread GitBox
calmera commented on code in PR #12742: URL: https://github.com/apache/kafka/pull/12742#discussion_r1062606439 ## streams/src/main/java/org/apache/kafka/streams/Topology.java: ## @@ -737,6 +737,91 @@ public synchronized Topology addStateStore(final StoreBuilder storeBuilder,

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13078: KAFKA-13999: Add ProducerCount metrics (KIP-847)

2023-01-05 Thread GitBox
divijvaidya commented on code in PR #13078: URL: https://github.com/apache/kafka/pull/13078#discussion_r1062290508 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -576,6 +576,13 @@ class UnifiedLog(@volatile var logStartOffset: Long, } }, period =

<    3   4   5   6   7   8   9   10   11   12   >