Re: Remaining tests that need to support KRaft

2023-10-29 Thread ziming deng
Hello Sameer, I have created a PR for some test in `kafka.api` and 
`kafka.network`, you can take a review when you are free, thanks.


https://github.com/apache/kafka/pull/14595
MINOR: Enable kraft test in kafka.api and kafka.network by dengziming · Pull 
Request #14595 · apache/kafka
github.com


> On Oct 30, 2023, at 07:26, Sameer Tejani  wrote:
> 
> Hi everyone,
> 
> I worked with Colin who had taken an initial pass at tests that still need
> to be converted to support KRaft.  I created individual Jiras
> 
> for them and have marked them with labels kraft-test.  Some of them should
> be simple enough to implement.  We will need to have them all converted
> before AK 4.0 is released.
> 
> Thx
> 
> -- 
> - Sameer



Re: Remaining tests that need to support KRaft

2023-10-29 Thread Ismael Juma
Thanks Sameer. My take is that we're better off waiting until after the 3.7
branch is created so that we can simply replace the zk mode with kraft mode
for each of these tests. We're only 1.5 months away from that.

Ismael

On Sun, Oct 29, 2023 at 4:27 PM Sameer Tejani 
wrote:

> Hi everyone,
>
> I worked with Colin who had taken an initial pass at tests that still need
> to be converted to support KRaft.  I created individual Jiras
> <
> https://issues.apache.org/jira/issues/?filter=-4=labels%20in%20(kraft-test)
> >
> for them and have marked them with labels kraft-test.  Some of them should
> be simple enough to implement.  We will need to have them all converted
> before AK 4.0 is released.
>
> Thx
>
> --
> - Sameer
>


Remaining tests that need to support KRaft

2023-10-29 Thread Sameer Tejani
Hi everyone,

I worked with Colin who had taken an initial pass at tests that still need
to be converted to support KRaft.  I created individual Jiras

for them and have marked them with labels kraft-test.  Some of them should
be simple enough to implement.  We will need to have them all converted
before AK 4.0 is released.

Thx

-- 
- Sameer


[jira] [Created] (KAFKA-15753) KRaft support in BrokerApiVersionsCommandTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15753:
-

 Summary: KRaft support in BrokerApiVersionsCommandTest
 Key: KAFKA-15753
 URL: https://issues.apache.org/jira/browse/KAFKA-15753
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in SaslSslAdminIntegrationTest in 
core/src/test/scala/integration/kafka/api/SaslSslAdminIntegrationTest.scala 
need to be updated to support KRaft

95 : def testAclOperations(): Unit = {

116 : def testAclOperations2(): Unit = {

142 : def testAclDescribe(): Unit = {

169 : def testAclDelete(): Unit = {

219 : def testLegacyAclOpsNeverAffectOrReturnPrefixed(): Unit = {

256 : def testAttemptToCreateInvalidAcls(): Unit = {

351 : def testAclAuthorizationDenied(): Unit = {

383 : def testCreateTopicsResponseMetadataAndConfig(): Unit = {

Scanned 527 lines. Found 0 KRaft tests out of 8 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15749) KRaft support in KafkaMetricReporterClusterIdTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15749:
-

 Summary: KRaft support in KafkaMetricReporterClusterIdTest
 Key: KAFKA-15749
 URL: https://issues.apache.org/jira/browse/KAFKA-15749
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in MetricsDuringTopicCreationDeletionTest in 
core/src/test/scala/unit/kafka/integration/MetricsDuringTopicCreationDeletionTest.scala
 need to be updated to support KRaft

71 : def testMetricsDuringTopicCreateDelete(): Unit = {

Scanned 154 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15751) KRaft support in BaseAdminIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15751:
-

 Summary: KRaft support in BaseAdminIntegrationTest
 Key: KAFKA-15751
 URL: https://issues.apache.org/jira/browse/KAFKA-15751
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in KafkaMetricReporterExceptionHandlingTest in 
core/src/test/scala/unit/kafka/server/KafkaMetricReporterExceptionHandlingTest.scala
 need to be updated to support KRaft

65 : def testBothReportersAreInvoked(): Unit = {

Scanned 120 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15752) KRaft support in SaslSslAdminIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15752:
-

 Summary: KRaft support in SaslSslAdminIntegrationTest
 Key: KAFKA-15752
 URL: https://issues.apache.org/jira/browse/KAFKA-15752
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in BaseAdminIntegrationTest in 
core/src/test/scala/integration/kafka/api/BaseAdminIntegrationTest.scala need 
to be updated to support KRaft

70 : def testCreateDeleteTopics(): Unit = {

163 : def testAuthorizedOperations(): Unit = {

Scanned 259 lines. Found 0 KRaft tests out of 2 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15750) KRaft support in KafkaMetricReporterExceptionHandlingTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15750:
-

 Summary: KRaft support in KafkaMetricReporterExceptionHandlingTest
 Key: KAFKA-15750
 URL: https://issues.apache.org/jira/browse/KAFKA-15750
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in KafkaMetricReporterClusterIdTest in 
core/src/test/scala/unit/kafka/server/KafkaMetricReporterClusterIdTest.scala 
need to be updated to support KRaft

96 : def testClusterIdPresent(): Unit = {

Scanned 119 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15748) KRaft support in MetricsDuringTopicCreationDeletionTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15748:
-

 Summary: KRaft support in MetricsDuringTopicCreationDeletionTest
 Key: KAFKA-15748
 URL: https://issues.apache.org/jira/browse/KAFKA-15748
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DynamicConnectionQuotaTest in 
core/src/test/scala/integration/kafka/network/DynamicConnectionQuotaTest.scala 
need to be updated to support KRaft

77 : def testDynamicConnectionQuota(): Unit = {

104 : def testDynamicListenerConnectionQuota(): Unit = {

175 : def testDynamicListenerConnectionCreationRateQuota(): Unit = {

237 : def testDynamicIpConnectionRateQuota(): Unit = {

Scanned 416 lines. Found 0 KRaft tests out of 4 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15747) KRaft support in DynamicConnectionQuotaTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15747:
-

 Summary: KRaft support in DynamicConnectionQuotaTest
 Key: KAFKA-15747
 URL: https://issues.apache.org/jira/browse/KAFKA-15747
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ControllerMutationQuotaTest in 
core/src/test/scala/unit/kafka/server/ControllerMutationQuotaTest.scala need to 
be updated to support KRaft

117 : def testSetUnsetQuota(): Unit = {

133 : def testQuotaMetric(): Unit = {

155 : def testStrictCreateTopicsRequest(): Unit = {

178 : def testPermissiveCreateTopicsRequest(): Unit = {

191 : def testUnboundedCreateTopicsRequest(): Unit = {

202 : def testStrictDeleteTopicsRequest(): Unit = {

229 : def testPermissiveDeleteTopicsRequest(): Unit = {

246 : def testUnboundedDeleteTopicsRequest(): Unit = {

259 : def testStrictCreatePartitionsRequest(): Unit = {

286 : def testPermissiveCreatePartitionsRequest(): Unit = {

303 : def testUnboundedCreatePartitionsRequest(): Unit = {

Scanned 420 lines. Found 0 KRaft tests out of 11 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15746) KRaft support in ControllerMutationQuotaTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15746:
-

 Summary: KRaft support in ControllerMutationQuotaTest
 Key: KAFKA-15746
 URL: https://issues.apache.org/jira/browse/KAFKA-15746
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in RequestQuotaTest in 
core/src/test/scala/unit/kafka/server/RequestQuotaTest.scala need to be updated 
to support KRaft

132 : def testResponseThrottleTime(): Unit = {

140 : def testResponseThrottleTimeWhenBothProduceAndRequestQuotasViolated(): 
Unit = {

146 : def testResponseThrottleTimeWhenBothFetchAndRequestQuotasViolated(): Unit 
= {

152 : def testUnthrottledClient(): Unit = {

161 : def testExemptRequestTime(): Unit = {

171 : def testUnauthorizedThrottle(): Unit = {

Scanned 801 lines. Found 0 KRaft tests out of 6 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15745) KRaft support in RequestQuotaTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15745:
-

 Summary: KRaft support in RequestQuotaTest
 Key: KAFKA-15745
 URL: https://issues.apache.org/jira/browse/KAFKA-15745
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in CustomQuotaCallbackTest in 
core/src/test/scala/integration/kafka/api/CustomQuotaCallbackTest.scala need to 
be updated to support KRaft

90 : def testCustomQuotaCallback(): Unit = {

Scanned 468 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15744) KRaft support in CustomQuotaCallbackTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15744:
-

 Summary: KRaft support in CustomQuotaCallbackTest
 Key: KAFKA-15744
 URL: https://issues.apache.org/jira/browse/KAFKA-15744
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ReplicationQuotasTest in 
core/src/test/scala/unit/kafka/server/ReplicationQuotasTest.scala need to be 
updated to support KRaft

59 : def shouldBootstrapTwoBrokersWithLeaderThrottle(): Unit = {

64 : def shouldBootstrapTwoBrokersWithFollowerThrottle(): Unit = {

171 : def shouldThrottleOldSegments(): Unit = {

Scanned 240 lines. Found 0 KRaft tests out of 3 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15743) KRaft support in ReplicationQuotasTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15743:
-

 Summary: KRaft support in ReplicationQuotasTest
 Key: KAFKA-15743
 URL: https://issues.apache.org/jira/browse/KAFKA-15743
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in GroupCoordinatorIntegrationTest in 
core/src/test/scala/integration/kafka/api/GroupCoordinatorIntegrationTest.scala 
need to be updated to support KRaft

41 : def testGroupCoordinatorPropagatesOffsetsTopicCompressionCodec(): Unit = {

Scanned 63 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15742) KRaft support in GroupCoordinatorIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15742:
-

 Summary: KRaft support in GroupCoordinatorIntegrationTest
 Key: KAFKA-15742
 URL: https://issues.apache.org/jira/browse/KAFKA-15742
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DescribeConsumerGroupTest in 
core/src/test/scala/unit/kafka/admin/DescribeConsumerGroupTest.scala need to be 
updated to support KRaft

39 : def testDescribeNonExistingGroup(): Unit = {

55 : def testDescribeWithMultipleSubActions(): Unit = {

76 : def testDescribeWithStateValue(): Unit = {

97 : def testDescribeOffsetsOfNonExistingGroup(): Unit = {

113 : def testDescribeMembersOfNonExistingGroup(): Unit = {

133 : def testDescribeStateOfNonExistingGroup(): Unit = {

151 : def testDescribeExistingGroup(): Unit = {

169 : def testDescribeExistingGroups(): Unit = {

194 : def testDescribeAllExistingGroups(): Unit = {

218 : def testDescribeOffsetsOfExistingGroup(): Unit = {

239 : def testDescribeMembersOfExistingGroup(): Unit = {

272 : def testDescribeStateOfExistingGroup(): Unit = {

291 : def testDescribeStateOfExistingGroupWithRoundRobinAssignor(): Unit = {

310 : def testDescribeExistingGroupWithNoMembers(): Unit = {

334 : def testDescribeOffsetsOfExistingGroupWithNoMembers(): Unit = {

366 : def testDescribeMembersOfExistingGroupWithNoMembers(): Unit = {

390 : def testDescribeStateOfExistingGroupWithNoMembers(): Unit = {

417 : def testDescribeWithConsumersWithoutAssignedPartitions(): Unit = {

436 : def testDescribeOffsetsWithConsumersWithoutAssignedPartitions(): Unit = {

455 : def testDescribeMembersWithConsumersWithoutAssignedPartitions(): Unit = {

480 : def testDescribeStateWithConsumersWithoutAssignedPartitions(): Unit = {

496 : def testDescribeWithMultiPartitionTopicAndMultipleConsumers(): Unit = {

517 : def testDescribeOffsetsWithMultiPartitionTopicAndMultipleConsumers(): 
Unit = {

539 : def testDescribeMembersWithMultiPartitionTopicAndMultipleConsumers(): 
Unit = {

565 : def testDescribeStateWithMultiPartitionTopicAndMultipleConsumers(): Unit 
= {

583 : def testDescribeSimpleConsumerGroup(): Unit = {

601 : def testDescribeGroupWithShortInitializationTimeout(): Unit = {

618 : def testDescribeGroupOffsetsWithShortInitializationTimeout(): Unit = {

634 : def testDescribeGroupMembersWithShortInitializationTimeout(): Unit = {

652 : def testDescribeGroupStateWithShortInitializationTimeout(): Unit = {

668 : def testDescribeWithUnrecognizedNewConsumerOption(): Unit = {

674 : def testDescribeNonOffsetCommitGroup(): Unit = {

Scanned 699 lines. Found 0 KRaft tests out of 32 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15740) KRaft support in DeleteOffsetsConsumerGroupCommandIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15740:
-

 Summary: KRaft support in 
DeleteOffsetsConsumerGroupCommandIntegrationTest
 Key: KAFKA-15740
 URL: https://issues.apache.org/jira/browse/KAFKA-15740
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ResetConsumerGroupOffsetTest in 
core/src/test/scala/unit/kafka/admin/ResetConsumerGroupOffsetTest.scala need to 
be updated to support KRaft

75 : def testResetOffsetsNotExistingGroup(): Unit = {

89 : def testResetOffsetsExistingTopic(): Unit = {

99 : def testResetOffsetsExistingTopicSelectedGroups(): Unit = {

116 : def testResetOffsetsExistingTopicAllGroups(): Unit = {

130 : def testResetOffsetsAllTopicsAllGroups(): Unit = {

149 : def testResetOffsetsToLocalDateTime(): Unit = {

165 : def testResetOffsetsToZonedDateTime(): Unit = {

181 : def testResetOffsetsByDuration(): Unit = {

188 : def testResetOffsetsByDurationToEarliest(): Unit = {

195 : def testResetOffsetsByDurationFallbackToLatestWhenNoRecords(): Unit = {

205 : def testResetOffsetsToEarliest(): Unit = {

212 : def testResetOffsetsToLatest(): Unit = {

220 : def testResetOffsetsToCurrentOffset(): Unit = {

228 : def testResetOffsetsToSpecificOffset(): Unit = {

235 : def testResetOffsetsShiftPlus(): Unit = {

243 : def testResetOffsetsShiftMinus(): Unit = {

251 : def testResetOffsetsShiftByLowerThanEarliest(): Unit = {

259 : def testResetOffsetsShiftByHigherThanLatest(): Unit = {

267 : def testResetOffsetsToEarliestOnOneTopic(): Unit = {

274 : def testResetOffsetsToEarliestOnOneTopicAndPartition(): Unit = {

293 : def testResetOffsetsToEarliestOnTopics(): Unit = {

318 : def testResetOffsetsToEarliestOnTopicsAndPartitions(): Unit = {

348 : def testResetOffsetsExportImportPlanSingleGroupArg(): Unit = {

378 : def testResetOffsetsExportImportPlan(): Unit = {

425 : def testResetWithUnrecognizedNewConsumerOption(): Unit = {

Scanned 515 lines. Found 0 KRaft tests out of 25 tests

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15741) KRaft support in DescribeConsumerGroupTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15741:
-

 Summary: KRaft support in DescribeConsumerGroupTest
 Key: KAFKA-15741
 URL: https://issues.apache.org/jira/browse/KAFKA-15741
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DeleteOffsetsConsumerGroupCommandIntegrationTest in 
core/src/test/scala/unit/kafka/admin/DeleteOffsetsConsumerGroupCommandIntegrationTest.scala
 need to be updated to support KRaft

49 : def testDeleteOffsetsNonExistingGroup(): Unit = {

59 : def testDeleteOffsetsOfStableConsumerGroupWithTopicPartition(): Unit = {

64 : def testDeleteOffsetsOfStableConsumerGroupWithTopicOnly(): Unit = {

69 : def testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicPartition(): 
Unit = {

74 : def testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicOnly(): Unit = {

79 : def testDeleteOffsetsOfEmptyConsumerGroupWithTopicPartition(): Unit = {

84 : def testDeleteOffsetsOfEmptyConsumerGroupWithTopicOnly(): Unit = {

89 : def testDeleteOffsetsOfEmptyConsumerGroupWithUnknownTopicPartition(): Unit 
= {

94 : def testDeleteOffsetsOfEmptyConsumerGroupWithUnknownTopicOnly(): Unit = {

Scanned 198 lines. Found 0 KRaft tests out of 9 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15739) KRaft support in ResetConsumerGroupOffsetTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15739:
-

 Summary: KRaft support in ResetConsumerGroupOffsetTest
 Key: KAFKA-15739
 URL: https://issues.apache.org/jira/browse/KAFKA-15739
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ConsumerWithLegacyMessageFormatIntegrationTest in 
core/src/test/scala/integration/kafka/api/ConsumerWithLegacyMessageFormatIntegrationTest.scala
 need to be updated to support KRaft

0 : def testOffsetsForTimes(): Unit = {

102 : def testEarliestOrLatestOffsets(): Unit = {

Scanned 132 lines. Found 0 KRaft tests out of 2 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15737) KRaft support in ConsumerBounceTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15737:
-

 Summary: KRaft support in ConsumerBounceTest
 Key: KAFKA-15737
 URL: https://issues.apache.org/jira/browse/KAFKA-15737
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in PlaintextConsumerTest in 
core/src/test/scala/integration/kafka/api/PlaintextConsumerTest.scala need to 
be updated to support KRaft

49 : def testHeaders(): Unit = {

136 : def testDeprecatedPollBlocksForAssignment(): Unit = {

144 : def testHeadersSerializerDeserializer(): Unit = {

153 : def testMaxPollRecords(): Unit = {

169 : def testMaxPollIntervalMs(): Unit = {

194 : def testMaxPollIntervalMsDelayInRevocation(): Unit = {

234 : def testMaxPollIntervalMsDelayInAssignment(): Unit = {

258 : def testAutoCommitOnClose(): Unit = {

281 : def testAutoCommitOnCloseAfterWakeup(): Unit = {

308 : def testAutoOffsetReset(): Unit = {

319 : def testGroupConsumption(): Unit = {

339 : def testPatternSubscription(): Unit = {

396 : def testSubsequentPatternSubscription(): Unit = {

447 : def testPatternUnsubscription(): Unit = {

473 : def testCommitMetadata(): Unit = {

494 : def testAsyncCommit(): Unit = {

513 : def testExpandingTopicSubscriptions(): Unit = {

527 : def testShrinkingTopicSubscriptions(): Unit = {

541 : def testPartitionsFor(): Unit = {

551 : def testPartitionsForAutoCreate(): Unit = {

560 : def testPartitionsForInvalidTopic(): Unit = {

566 : def testSeek(): Unit = {

621 : def testPositionAndCommit(): Unit = {

653 : def testPartitionPauseAndResume(): Unit = {

671 : def testFetchInvalidOffset(): Unit = {

696 : def testFetchOutOfRangeOffsetResetConfigEarliest(): Unit = {

717 : def testFetchOutOfRangeOffsetResetConfigLatest(): Unit = {

743 : def testFetchRecordLargerThanFetchMaxBytes(): Unit = {

772 : def testFetchHonoursFetchSizeIfLargeRecordNotFirst(): Unit = {

804 : def testFetchHonoursMaxPartitionFetchBytesIfLargeRecordNotFirst(): Unit = 
{

811 : def testFetchRecordLargerThanMaxPartitionFetchBytes(): Unit = {

819 : def testLowMaxFetchSizeForRequestAndPartition(): Unit = {

867 : def testRoundRobinAssignment(): Unit = {

903 : def testMultiConsumerRoundRobinAssignor(): Unit = {

940 : def testMultiConsumerStickyAssignor(): Unit = {

986 : def testMultiConsumerDefaultAssignor(): Unit = {

1024 : def testRebalanceAndRejoin(assignmentStrategy: String): Unit = {

1109 : def testMultiConsumerDefaultAssignorAndVerifyAssignment(): Unit = {

1141 : def testMultiConsumerSessionTimeoutOnStopPolling(): Unit = {

1146 : def testMultiConsumerSessionTimeoutOnClose(): Unit = {

1151 : def testInterceptors(): Unit = {

1210 : def testAutoCommitIntercept(): Unit = {

1260 : def testInterceptorsWithWrongKeyValue(): Unit = {

1286 : def testConsumeMessagesWithCreateTime(): Unit = {

1303 : def testConsumeMessagesWithLogAppendTime(): Unit = {

1331 : def testListTopics(): Unit = {

1351 : def testUnsubscribeTopic(): Unit = {

1367 : def testPauseStateNotPreservedByRebalance(): Unit = {

1388 : def testCommitSpecifiedOffsets(): Unit = {

1415 : def testAutoCommitOnRebalance(): Unit = {

1454 : def testPerPartitionLeadMetricsCleanUpWithSubscribe(): Unit = {

1493 : def testPerPartitionLagMetricsCleanUpWithSubscribe(): Unit = {

1533 : def testPerPartitionLeadMetricsCleanUpWithAssign(): Unit = {

1562 : def testPerPartitionLagMetricsCleanUpWithAssign(): Unit = {

1593 : def testPerPartitionLagMetricsWhenReadCommitted(): Unit = {

1616 : def testPerPartitionLeadWithMaxPollRecords(): Unit = {

1638 : def testPerPartitionLagWithMaxPollRecords(): Unit = {

1661 : def testQuotaMetricsNotCreatedIfNoQuotasConfigured(): Unit = {

1809 : def testConsumingWithNullGroupId(): Unit = {

1874 : def testConsumingWithEmptyGroupId(): Unit = {

1923 : def testStaticConsumerDetectsNewPartitionCreatedAfterRestart(): Unit = {

Scanned 1951 lines. Found 0 KRaft tests out of 61 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15738) KRaft support in ConsumerWithLegacyMessageFormatIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15738:
-

 Summary: KRaft support in 
ConsumerWithLegacyMessageFormatIntegrationTest
 Key: KAFKA-15738
 URL: https://issues.apache.org/jira/browse/KAFKA-15738
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ConsumerBounceTest in 
core/src/test/scala/integration/kafka/api/ConsumerBounceTest.scala need to be 
updated to support KRaft

81 : def testConsumptionWithBrokerFailures(): Unit = 
consumeWithBrokerFailures(10)

122 : def testSeekAndCommitWithBrokerFailures(): Unit = 
seekAndCommitWithBrokerFailures(5)

161 : def testSubscribeWhenTopicUnavailable(): Unit = {

212 : def testClose(): Unit = {

297 : def 
testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup(): Unit 
= {

337 : def testConsumerReceivesFatalExceptionWhenGroupPassesMaxSize(): Unit = {

370 : def testCloseDuringRebalance(): Unit = {

Scanned 535 lines. Found 0 KRaft tests out of 7 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15736) KRaft support in PlaintextConsumerTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15736:
-

 Summary: KRaft support in PlaintextConsumerTest
 Key: KAFKA-15736
 URL: https://issues.apache.org/jira/browse/KAFKA-15736
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in SaslMultiMechanismConsumerTest in 
core/src/test/scala/integration/kafka/api/SaslMultiMechanismConsumerTest.scala 
need to be updated to support KRaft

45 : def testMultipleBrokerMechanisms(): Unit = {

Scanned 94 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15734) KRaft support in BaseConsumerTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15734:
-

 Summary: KRaft support in BaseConsumerTest
 Key: KAFKA-15734
 URL: https://issues.apache.org/jira/browse/KAFKA-15734
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in FetchRequestMaxBytesTest in 
core/src/test/scala/unit/kafka/server/FetchRequestMaxBytesTest.scala need to be 
updated to support KRaft

105 : def testConsumeMultipleRecords(): Unit = {

Scanned 134 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15735) KRaft support in SaslMultiMechanismConsumerTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15735:
-

 Summary: KRaft support in SaslMultiMechanismConsumerTest
 Key: KAFKA-15735
 URL: https://issues.apache.org/jira/browse/KAFKA-15735
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in BaseConsumerTest in 
core/src/test/scala/integration/kafka/api/BaseConsumerTest.scala need to be 
updated to support KRaft

38 : def testSimpleConsumption(): Unit = {

57 : def testClusterResourceListener(): Unit = {

78 : def testCoordinatorFailover(): Unit = {

Scanned 125 lines. Found 0 KRaft tests out of 3 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15733) KRaft support in FetchRequestMaxBytesTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15733:
-

 Summary: KRaft support in FetchRequestMaxBytesTest
 Key: KAFKA-15733
 URL: https://issues.apache.org/jira/browse/KAFKA-15733
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in LogAppendTimeTest in 
core/src/test/scala/integration/kafka/api/LogAppendTimeTest.scala need to be 
updated to support KRaft

50 : def testProduceConsume(): Unit = {

Scanned 78 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15732) KRaft support in LogAppendTimeTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15732:
-

 Summary: KRaft support in LogAppendTimeTest
 Key: KAFKA-15732
 URL: https://issues.apache.org/jira/browse/KAFKA-15732
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ListOffsetsIntegrationTest in 
core/src/test/scala/integration/kafka/admin/ListOffsetsIntegrationTest.scala 
need to be updated to support KRaft

55 : def testEarliestOffset(): Unit = {

61 : def testLatestOffset(): Unit = {

67 : def testMaxTimestampOffset(): Unit = {

Scanned 96 lines. Found 0 KRaft tests out of 3 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15730) KRaft support in ProducerFailureHandlingTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15730:
-

 Summary: KRaft support in ProducerFailureHandlingTest
 Key: KAFKA-15730
 URL: https://issues.apache.org/jira/browse/KAFKA-15730
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in GetOffsetShellTest in 
tools/src/test/java/org/apache/kafka/tools/GetOffsetShellTest.java need to be 
updated to support KRaft

62 : def testNoFilterOptions(): Unit = {

68 : def testInternalExcluded(): Unit = {

74 : def testTopicNameArg(): Unit = {

82 : def testTopicPatternArg(): Unit = {

88 : def testPartitionsArg(): Unit = {

94 : def testTopicPatternArgWithPartitionsArg(): Unit = {

100 : def testTopicPartitionsArg(): Unit = {

116 : def testGetLatestOffsets(time: String): Unit = {

131 : def testGetEarliestOffsets(time: String): Unit = {

146 : def testGetOffsetsByMaxTimestamp(time: String): Unit = {

155 : def testGetOffsetsByTimestamp(): Unit = {

170 : def testNoOffsetIfTimestampGreaterThanLatestRecord(): Unit = {

177 : def testTopicPartitionsArgWithInternalExcluded(): Unit = {

192 : def testTopicPartitionsArgWithInternalIncluded(): Unit = {

198 : def testTopicPartitionsNotFoundForNonExistentTopic(): Unit = {

203 : def testTopicPartitionsNotFoundForExcludedInternalTopic(): Unit = {

208 : def testTopicPartitionsNotFoundForNonMatchingTopicPartitionPattern(): 
Unit = {

213 : def testTopicPartitionsFlagWithTopicFlagCauseExit(): Unit = {

218 : def testTopicPartitionsFlagWithPartitionsFlagCauseExit(): Unit = {

Scanned 279 lines. Found 0 KRaft tests out of 19 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15731) KRaft support in ListOffsetsIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15731:
-

 Summary: KRaft support in ListOffsetsIntegrationTest
 Key: KAFKA-15731
 URL: https://issues.apache.org/jira/browse/KAFKA-15731
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ProducerFailureHandlingTest in 
core/src/test/scala/integration/kafka/api/ProducerFailureHandlingTest.scala 
need to be updated to support KRaft

87 : def testTooLargeRecordWithAckZero(): Unit = {

104 : def testTooLargeRecordWithAckOne(): Unit = {

133 : def testPartitionTooLargeForReplicationWithAckAll(): Unit = {

139 : def testResponseTooLargeForReplicationWithAckAll(): Unit = {

147 : def testNonExistentTopic(): Unit = {

164 : def testWrongBrokerList(): Unit = {

181 : def testInvalidPartition(): Unit = {

195 : def testSendAfterClosed(): Unit = {

215 : def testCannotSendToInternalTopic(): Unit = {

223 : def testNotEnoughReplicas(): Unit = {

236 : def testNotEnoughReplicasAfterBrokerShutdown(): Unit = {

Scanned 260 lines. Found 0 KRaft tests out of 11 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15729) KRaft support in GetOffsetShellTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15729:
-

 Summary: KRaft support in GetOffsetShellTest
 Key: KAFKA-15729
 URL: https://issues.apache.org/jira/browse/KAFKA-15729
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DescribeUserScramCredentialsRequestNotAuthorizedTest in 
core/src/test/scala/unit/kafka/server/DescribeUserScramCredentialsRequestNotAuthorizedTest.scala
 need to be updated to support KRaft

39 : def testDescribeNotAuthorized(): Unit = {

Scanned 52 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15728) KRaft support in DescribeUserScramCredentialsRequestNotAuthorizedTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15728:
-

 Summary: KRaft support in 
DescribeUserScramCredentialsRequestNotAuthorizedTest
 Key: KAFKA-15728
 URL: https://issues.apache.org/jira/browse/KAFKA-15728
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in AlterUserScramCredentialsRequestNotAuthorizedTest in 
core/src/test/scala/unit/kafka/server/AlterUserScramCredentialsRequestNotAuthorizedTest.scala
 need to be updated to support KRaft

47 : def testAlterNothingNotAuthorized(): Unit = {

59 : def testAlterSomethingNotAuthorized(): Unit = {

Scanned 80 lines. Found 0 KRaft tests out of 2 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15726) KRaft support in ProduceRequestTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15726:
-

 Summary: KRaft support in ProduceRequestTest
 Key: KAFKA-15726
 URL: https://issues.apache.org/jira/browse/KAFKA-15726
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in FetchRequestTest in 
core/src/test/scala/unit/kafka/server/FetchRequestTest.scala need to be updated 
to support KRaft

45 : def testBrokerRespectsPartitionsOrderAndSizeLimits(): Unit = {

147 : def testFetchRequestV4WithReadCommitted(): Unit = {

165 : def testFetchRequestToNonReplica(): Unit = {

195 : def testLastFetchedEpochValidation(): Unit = {

200 : def testLastFetchedEpochValidationV12(): Unit = {

247 : def testCurrentEpochValidation(): Unit = {

252 : def testCurrentEpochValidationV12(): Unit = {

295 : def testEpochValidationWithinFetchSession(): Unit = {

300 : def testEpochValidationWithinFetchSessionV12(): Unit = {

361 : def testDownConversionWithConnectionFailure(): Unit = {

428 : def testDownConversionFromBatchedToUnbatchedRespectsOffset(): Unit = {

509 : def testCreateIncrementalFetchWithPartitionsInErrorV12(): Unit = {

568 : def testFetchWithPartitionsWithIdError(): Unit = {

610 : def testZStdCompressedTopic(): Unit = {

657 : def testZStdCompressedRecords(): Unit = {

Scanned 783 lines. Found 0 KRaft tests out of 15 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15727) KRaft support in AlterUserScramCredentialsRequestNotAuthorizedTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15727:
-

 Summary: KRaft support in 
AlterUserScramCredentialsRequestNotAuthorizedTest
 Key: KAFKA-15727
 URL: https://issues.apache.org/jira/browse/KAFKA-15727
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ProduceRequestTest in 
core/src/test/scala/unit/kafka/server/ProduceRequestTest.scala need to be 
updated to support KRaft

45 : def testSimpleProduceRequest(): Unit = {

82 : def testProduceWithInvalidTimestamp(): Unit = {

128 : def testProduceToNonReplica(): Unit = {

170 : def testCorruptLz4ProduceRequest(): Unit = {

204 : def testZSTDProduceRequest(): Unit = {

Scanned 253 lines. Found 0 KRaft tests out of 5 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15725) KRaft support in FetchRequestTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15725:
-

 Summary: KRaft support in FetchRequestTest
 Key: KAFKA-15725
 URL: https://issues.apache.org/jira/browse/KAFKA-15725
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in OffsetFetchRequestTest in 
core/src/test/scala/unit/kafka/server/OffsetFetchRequestTest.scala need to be 
updated to support KRaft

83 : def testOffsetFetchRequestSingleGroup(): Unit = {

130 : def testOffsetFetchRequestAllOffsetsSingleGroup(): Unit = {

180 : def testOffsetFetchRequestWithMultipleGroups(): Unit = {

Scanned 246 lines. Found 0 KRaft tests out of 3 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15724) KRaft support in OffsetFetchRequestTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15724:
-

 Summary: KRaft support in OffsetFetchRequestTest
 Key: KAFKA-15724
 URL: https://issues.apache.org/jira/browse/KAFKA-15724
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ListOffsetsRequestTest in 
core/src/test/scala/unit/kafka/server/ListOffsetsRequestTest.scala need to be 
updated to support KRaft

37 : def testListOffsetsErrorCodes(): Unit = {

84 : def testListOffsetsMaxTimeStampOldestVersion(): Unit = {

112 : def testCurrentEpochValidation(): Unit = {

173 : def testResponseIncludesLeaderEpoch(): Unit = {

210 : def testResponseDefaultOffsetAndLeaderEpochForAllVersions(): Unit = {

Scanned 261 lines. Found 0 KRaft tests out of 5 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15723) KRaft support in ListOffsetsRequestTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15723:
-

 Summary: KRaft support in ListOffsetsRequestTest
 Key: KAFKA-15723
 URL: https://issues.apache.org/jira/browse/KAFKA-15723
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in RackAwareAutoTopicCreationTest in 
core/src/test/scala/integration/kafka/api/RackAwareAutoTopicCreationTest.scala 
need to be updated to support KRaft

46 : def testAutoCreateTopic(): Unit = {

Scanned 66 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15722) KRaft support in RackAwareAutoTopicCreationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15722:
-

 Summary: KRaft support in RackAwareAutoTopicCreationTest
 Key: KAFKA-15722
 URL: https://issues.apache.org/jira/browse/KAFKA-15722
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DeleteTopicsRequestWithDeletionDisabledTest in 
core/src/test/scala/unit/kafka/server/DeleteTopicsRequestWithDeletionDisabledTest.scala
 need to be updated to support KRaft

43 : def testDeleteRecordsRequest(): Unit = {

Scanned 65 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15721) KRaft support in DeleteTopicsRequestWithDeletionDisabledTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15721:
-

 Summary: KRaft support in 
DeleteTopicsRequestWithDeletionDisabledTest
 Key: KAFKA-15721
 URL: https://issues.apache.org/jira/browse/KAFKA-15721
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DeleteTopicTest in 
core/src/test/scala/unit/kafka/admin/DeleteTopicTest.scala need to be updated 
to support KRaft

53 : def testDeleteTopicWithAllAliveReplicas(): Unit = {

62 : def testResumeDeleteTopicWithRecoveredFollower(): Unit = {

86 : def testResumeDeleteTopicOnControllerFailover(): Unit = {

112 : def testPartitionReassignmentDuringDeleteTopic(): Unit = {

191 : def testIncreasePartitionCountDuringDeleteTopic(): Unit = {

253 : def testDeleteTopicDuringAddPartition(): Unit = {

281 : def testAddPartitionDuringDeleteTopic(): Unit = {

298 : def testRecreateTopicAfterDeletion(): Unit = {

314 : def testDeleteNonExistingTopic(): Unit = {

332 : def testDeleteTopicWithCleaner(): Unit = {

362 : def testDeleteTopicAlreadyMarkedAsDeleted(): Unit = {

403 : def testDisableDeleteTopic(): Unit = {

421 : def testDeletingPartiallyDeletedTopic(): Unit = {

Scanned 451 lines. Found 0 KRaft tests out of 13 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15720) KRaft support in DeleteTopicTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15720:
-

 Summary: KRaft support in DeleteTopicTest
 Key: KAFKA-15720
 URL: https://issues.apache.org/jira/browse/KAFKA-15720
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in OffsetsForLeaderEpochRequestTest in 
core/src/test/scala/unit/kafka/server/OffsetsForLeaderEpochRequestTest.scala 
need to be updated to support KRaft

37 : def testOffsetsForLeaderEpochErrorCodes(): Unit = {

60 : def testCurrentEpochValidation(): Unit = {

Scanned 127 lines. Found 0 KRaft tests out of 2 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15719) KRaft support in OffsetsForLeaderEpochRequestTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15719:
-

 Summary: KRaft support in OffsetsForLeaderEpochRequestTest
 Key: KAFKA-15719
 URL: https://issues.apache.org/jira/browse/KAFKA-15719
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in UncleanLeaderElectionTest in 
core/src/test/scala/unit/kafka/integration/UncleanLeaderElectionTest.scala need 
to be updated to support KRaft

103 : def testUncleanLeaderElectionEnabled(): Unit = {

116 : def testUncleanLeaderElectionDisabled(): Unit = {

127 : def testUncleanLeaderElectionEnabledByTopicOverride(): Unit = {

142 : def testUncleanLeaderElectionDisabledByTopicOverride(): Unit = {

157 : def testUncleanLeaderElectionInvalidTopicOverride(): Unit = {

286 : def testTopicUncleanLeaderElectionEnable(): Unit = {

Scanned 358 lines. Found 0 KRaft tests out of 6 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15718) KRaft support in UncleanLeaderElectionTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15718:
-

 Summary: KRaft support in UncleanLeaderElectionTest
 Key: KAFKA-15718
 URL: https://issues.apache.org/jira/browse/KAFKA-15718
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in LeaderEpochIntegrationTest in 
core/src/test/scala/unit/kafka/server/epoch/LeaderEpochIntegrationTest.scala 
need to be updated to support KRaft

67 : def shouldAddCurrentLeaderEpochToMessagesAsTheyAreWrittenToLeader(): Unit 
= {

99 : def shouldSendLeaderEpochRequestAndGetAResponse(): Unit = {

144 : def shouldIncreaseLeaderEpochBetweenLeaderRestarts(): Unit = {

Scanned 305 lines. Found 0 KRaft tests out of 3 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15717) KRaft support in LeaderEpochIntegrationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15717:
-

 Summary: KRaft support in LeaderEpochIntegrationTest
 Key: KAFKA-15717
 URL: https://issues.apache.org/jira/browse/KAFKA-15717
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in EpochDrivenReplicationProtocolAcceptanceTest in 
core/src/test/scala/unit/kafka/server/epoch/EpochDrivenReplicationProtocolAcceptanceTest.scala
 need to be updated to support KRaft

74 : def shouldFollowLeaderEpochBasicWorkflow(): Unit = {

135 : def shouldNotAllowDivergentLogs(): Unit = {

183 : def offsetsShouldNotGoBackwards(): Unit = {

257 : def shouldSurviveFastLeaderChange(): Unit = {

298 : def logsShouldNotDivergeOnUncleanLeaderElections(): Unit = {

Scanned 473 lines. Found 0 KRaft tests out of 5 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15716) KRaft support in EpochDrivenReplicationProtocolAcceptanceTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15716:
-

 Summary: KRaft support in 
EpochDrivenReplicationProtocolAcceptanceTest
 Key: KAFKA-15716
 URL: https://issues.apache.org/jira/browse/KAFKA-15716
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in UpdateFeaturesTest in 
core/src/test/scala/unit/kafka/server/UpdateFeaturesTest.scala need to be 
updated to support KRaft

176 : def testShouldFailRequestIfNotController(): Unit = {

210 : def testShouldFailRequestWhenDowngradeFlagIsNotSetDuringDowngrade(): Unit 
= {

223 : def testShouldFailRequestWhenDowngradeToHigherVersionLevelIsAttempted(): 
Unit = {

236 : def 
testShouldFailRequestInServerWhenDowngradeFlagIsNotSetDuringDeletion(): Unit = {

280 : def testShouldFailRequestDuringDeletionOfNonExistingFeature(): Unit = {

292 : def testShouldFailRequestWhenUpgradingToSameVersionLevel(): Unit = {

354 : def 
testShouldFailRequestDuringBrokerMaxVersionLevelIncompatibilityForExistingFinalizedFeature():
 Unit = {

368 : def 
testShouldFailRequestDuringBrokerMaxVersionLevelIncompatibilityWithNoExistingFinalizedFeature():
 Unit = {

381 : def testSuccessfulFeatureUpgradeAndWithNoExistingFinalizedFeatures(): 
Unit = {

417 : def testSuccessfulFeatureUpgradeAndDowngrade(): Unit = {

459 : def testPartialSuccessDuringValidFeatureUpgradeAndInvalidDowngrade(): 
Unit = {

509 : def testPartialSuccessDuringInvalidFeatureUpgradeAndValidDowngrade(): 
Unit = {

Scanned 567 lines. Found 0 KRaft tests out of 12 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15715) KRaft support in UpdateFeaturesTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15715:
-

 Summary: KRaft support in UpdateFeaturesTest
 Key: KAFKA-15715
 URL: https://issues.apache.org/jira/browse/KAFKA-15715
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DynamicNumNetworkThreadsTest in 
core/src/test/scala/integration/kafka/network/DynamicNumNetworkThreadsTest.scala
 need to be updated to support KRaft

58 : def testDynamicNumNetworkThreads(): Unit = {

Scanned 103 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15714) KRaft support in DynamicNumNetworkThreadsTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15714:
-

 Summary: KRaft support in DynamicNumNetworkThreadsTest
 Key: KAFKA-15714
 URL: https://issues.apache.org/jira/browse/KAFKA-15714
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in SaslClientsWithInvalidCredentialsTest in 
core/src/test/scala/integration/kafka/api/SaslClientsWithInvalidCredentialsTest.scala
 need to be updated to support KRaft

125 : def testAclCliWithAuthorizer(): Unit = {

130 : def testAclCliWithAdminAPI(): Unit = {

186 : def testProducerConsumerCliWithAuthorizer(): Unit = {

191 : def testProducerConsumerCliWithAdminAPI(): Unit = {

197 : def testAclCliWithClientId(): Unit = {

236 : def testAclsOnPrefixedResourcesWithAuthorizer(): Unit = {

241 : def testAclsOnPrefixedResourcesWithAdminAPI(): Unit = {

268 : def testInvalidAuthorizerProperty(): Unit = {

276 : def testPatternTypes(): Unit = {

Scanned 336 lines. Found 0 KRaft tests out of 9 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15713) KRaft support in SaslClientsWithInvalidCredentialsTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15713:
-

 Summary: KRaft support in SaslClientsWithInvalidCredentialsTest
 Key: KAFKA-15713
 URL: https://issues.apache.org/jira/browse/KAFKA-15713
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in MultipleListenersWithSameSecurityProtocolBaseTest in 
core/src/test/scala/integration/kafka/server/MultipleListenersWithSameSecurityProtocolBaseTest.scala
 need to be updated to support KRaft

162 : def testProduceConsume(): Unit = {

Scanned 190 lines. Found 0 KRaft tests out of 1 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15711) KRaft support in LogRecoveryTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15711:
-

 Summary: KRaft support in LogRecoveryTest
 Key: KAFKA-15711
 URL: https://issues.apache.org/jira/browse/KAFKA-15711
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ServerShutdownTest in 
core/src/test/scala/unit/kafka/server/ServerShutdownTest.scala need to be 
updated to support KRaft

192 : def testCleanShutdownWithZkUnavailable(quorum: String): Unit = {

258 : def testControllerShutdownDuringSend(quorum: String): Unit = {

Scanned 324 lines. Found 5 KRaft tests out of 7 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15712) KRaft support in MultipleListenersWithSameSecurityProtocolBaseTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15712:
-

 Summary: KRaft support in 
MultipleListenersWithSameSecurityProtocolBaseTest
 Key: KAFKA-15712
 URL: https://issues.apache.org/jira/browse/KAFKA-15712
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in LogRecoveryTest in 
core/src/test/scala/unit/kafka/server/LogRecoveryTest.scala need to be updated 
to support KRaft

103 : def testHWCheckpointNoFailuresSingleLogSegment(): Unit = {

120 : def testHWCheckpointWithFailuresSingleLogSegment(): Unit = {

180 : def testHWCheckpointNoFailuresMultipleLogSegments(): Unit = {

196 : def testHWCheckpointWithFailuresMultipleLogSegments(): Unit = {

Scanned 247 lines. Found 0 KRaft tests out of 4 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15710) KRaft support in ServerShutdownTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15710:
-

 Summary: KRaft support in ServerShutdownTest
 Key: KAFKA-15710
 URL: https://issues.apache.org/jira/browse/KAFKA-15710
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in ServerStartupTest in 
core/src/test/scala/unit/kafka/server/ServerStartupTest.scala need to be 
updated to support KRaft

38 : def testBrokerCreatesZKChroot(): Unit = {

51 : def testConflictBrokerStartupWithSamePort(): Unit = {

65 : def testConflictBrokerRegistration(): Unit = {

82 : def testBrokerSelfAware(): Unit = {

93 : def testBrokerStateRunningAfterZK(): Unit = {

Scanned 107 lines. Found 0 KRaft tests out of 5 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15709) KRaft support in ServerStartupTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15709:
-

 Summary: KRaft support in ServerStartupTest
 Key: KAFKA-15709
 URL: https://issues.apache.org/jira/browse/KAFKA-15709
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in FetchRequestDownConversionConfigTest in 
core/src/test/scala/unit/kafka/server/FetchRequestDownConversionConfigTest.scala
 need to be updated to support KRaft

100 : def testV1FetchWithDownConversionDisabled(): Unit = {

117 : def testLatestFetchWithDownConversionDisabled(): Unit = {

134 : def testV12WithDownConversionDisabled(): Unit = {

Scanned 271 lines. Found 2 KRaft tests out of 5 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15708) KRaft support in FetchRequestDownConversionConfigTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15708:
-

 Summary: KRaft support in FetchRequestDownConversionConfigTest
 Key: KAFKA-15708
 URL: https://issues.apache.org/jira/browse/KAFKA-15708
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in TopicBasedRemoteLogMetadataManagerHarness in 
storage/src/test/java/org/apache/kafka/server/log/remote/metadata/storage/TopicBasedRemoteLogMetadataManagerHarness.java
 need to be updated to support KRaft

69 : public void testWithNoAssignedPartitions() throws Exception {

76 : public void testNewPartitionUpdates() throws Exception {

Scanned 172 lines. Found 0 KRaft tests out of 2 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15707) KRaft support in TopicBasedRemoteLogMetadataManagerHarness

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15707:
-

 Summary: KRaft support in TopicBasedRemoteLogMetadataManagerHarness
 Key: KAFKA-15707
 URL: https://issues.apache.org/jira/browse/KAFKA-15707
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DynamicBrokerReconfigurationTest in 
core/src/test/scala/integration/kafka/server/DynamicBrokerReconfigurationTest.scala
 need to be updated to support KRaft

621 : def testDefaultTopicConfig(): Unit = {

734 : def testUncleanLeaderElectionEnable(): Unit = {

795 : def testThreadPoolResize(): Unit = {

934 : def testMetricsReporterUpdate(): Unit = {

1022 : def testAdvertisedListenerUpdate(): Unit = {

1093 : def testAddRemoveSslListener(): Unit = {

1138 : def testAddRemoveSaslListeners(): Unit = {

Scanned 1993 lines. Found 7 KRaft tests out of 14 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-15706) KRaft support in DynamicBrokerReconfigurationTest

2023-10-29 Thread Sameer Tejani (Jira)
Sameer Tejani created KAFKA-15706:
-

 Summary: KRaft support in DynamicBrokerReconfigurationTest
 Key: KAFKA-15706
 URL: https://issues.apache.org/jira/browse/KAFKA-15706
 Project: Kafka
  Issue Type: Task
  Components: core
Reporter: Sameer Tejani


The following tests in DynamicBrokerReconfigurationTest in 
core/src/test/scala/integration/kafka/server/DynamicBrokerReconfigurationTest.scala
 need to be updated to support KRaft

621 : def testDefaultTopicConfig(): Unit = {

734 : def testUncleanLeaderElectionEnable(): Unit = {

795 : def testThreadPoolResize(): Unit = {

934 : def testMetricsReporterUpdate(): Unit = {

1022 : def testAdvertisedListenerUpdate(): Unit = {

1093 : def testAddRemoveSslListener(): Unit = {

1138 : def testAddRemoveSaslListeners(): Unit = {

Scanned 1993 lines. Found 7 KRaft tests out of 14 tests



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-29 Thread Colt McNealy
Guozhang—I agree, I am in favor of moving forward with the KIP now that the
Transactional State Stores will be behind a feature flag.

Nick—I just did a bit more light testing of your branch `KIP-892-3.5.0`
with your most recent changes. I couldn't detect a performance difference
versus trunk (in the past there was a slight degradation of performance on
the restoration path, but that has been fixed). I don't believe that your
branch has the state updater thread enabled, so I didn't test that path too
heavily.

As expected, however, our internal correctness tests failed due to the IQ
read-your-own-writes issue we discussed previously. The community as a
whole would vastly benefit from this KIP getting over the finish line in
3.7.0, and so long as it is behind a feature flag so that we at LittleHorse
can still guarantee RYOW for our users, I think it's purely a win for the
community. Until we can figure out how to get read_committed, we will just
be smart with standby's + rebalances etc (:

Thanks Nick! This improvement is long overdue for the streams community.

Colt McNealy

*Founder, LittleHorse.dev*


On Sun, Oct 29, 2023 at 11:30 AM Guozhang Wang 
wrote:

> I'd agree with you guys that as long as we are in agreement about the
> configuration semantics, that would be a big win to move forward for
> this KIP. As for the TaskCorruptedException handling like wiping state
> stores, we can discuss that in the PR rather than in the KIP.
>
> Just to clarify, I'm onboard with the latest proposal, and probably we
> can move on for voting on this KIP now?
>
> Guozhang
>
> On Thu, Oct 19, 2023 at 5:33 AM Bruno Cadonna  wrote:
> >
> > Hi Nick,
> >
> > What you and Lucas wrote about the different configurations of ALOS/EOS
> > and READ_COMMITTED/READ_UNCOMMITTED make sense to me. My earlier
> > concerns about changelogs diverging from the content of the local state
> > stores turned out to not apply. So I think, we can move on with those
> > configurations.
> >
> > Regarding the TaskCorruptedException and wiping out the state stores
> > under EOS, couldn't we abort the transaction on the state store and
> > close the task dirty? If the Kafka transaction was indeed committed, the
> > store would restore the missing part from the changelog topic. If the
> > Kafka transaction was not committed, changelog topic and state store are
> > in-sync.
> >
> > In any case, IMO those are implementation details that we do not need to
> > discuss and solve in the KIP discussion. We can solve them on the PR.
> > The important thing is that the processing guarantees hold.
> >
> > Best,
> > Bruno
> >
> > On 10/18/23 3:56 PM, Nick Telford wrote:
> > > Hi Lucas,
> > >
> > > TaskCorruptedException is how Streams signals that the Task state
> needs to
> > > be wiped, so we can't retain that exception without also wiping state
> on
> > > timeouts.
> > >
> > > Regards,
> > > Nick
> > >
> > > On Wed, 18 Oct 2023 at 14:48, Lucas Brutschy  .invalid>
> > > wrote:
> > >
> > >> Hi Nick,
> > >>
> > >> I think indeed the better behavior would be to retry commitTransaction
> > >> until we risk running out of time to meet `max.poll.interval.ms`.
> > >>
> > >> However, if it's handled as a `TaskCorruptedException` at the moment,
> > >> I would do the same in this KIP, and leave exception handling
> > >> improvements to future work. This KIP is already improving the
> > >> situation a lot by not wiping the state store.
> > >>
> > >> Cheers,
> > >> Lucas
> > >>
> > >> On Tue, Oct 17, 2023 at 3:51 PM Nick Telford 
> > >> wrote:
> > >>>
> > >>> Hi Lucas,
> > >>>
> > >>> Yeah, this is pretty much the direction I'm thinking of going in
> now. You
> > >>> make an interesting point about committing on-error under
> > >>> ALOS/READ_COMMITTED, although I haven't had a chance to think
> through the
> > >>> implications yet.
> > >>>
> > >>> Something that I ran into earlier this week is an issue with the new
> > >>> handling of TimeoutException. Without TX stores, TimeoutException
> under
> > >> EOS
> > >>> throws a TaskCorruptedException, which wipes the stores. However,
> with TX
> > >>> stores, TimeoutException is now just bubbled up and dealt with as it
> is
> > >>> under ALOS. The problem arises when the Producer#commitTransaction
> call
> > >>> times out: Streams attempts to ignore the error and continue
> producing,
> > >>> which causes the next call to Producer#send to throw
> > >>> "IllegalStateException: Cannot attempt operation `send` because the
> > >>> previous call to `commitTransaction` timed out and must be retried".
> > >>>
> > >>> I'm not sure what we should do here: retrying the commitTransaction
> seems
> > >>> logical, but what if it times out again? Where do we draw the line
> and
> > >>> shutdown the instance?
> > >>>
> > >>> Regards,
> > >>> Nick
> > >>>
> > >>> On Mon, 16 Oct 2023 at 13:19, Lucas Brutschy  > >> .invalid>
> > >>> wrote:
> > >>>
> >  Hi all,
> > 
> >  I think I liked your suggestion of allowing EOS with
> 

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-10-29 Thread Guozhang Wang
I'd agree with you guys that as long as we are in agreement about the
configuration semantics, that would be a big win to move forward for
this KIP. As for the TaskCorruptedException handling like wiping state
stores, we can discuss that in the PR rather than in the KIP.

Just to clarify, I'm onboard with the latest proposal, and probably we
can move on for voting on this KIP now?

Guozhang

On Thu, Oct 19, 2023 at 5:33 AM Bruno Cadonna  wrote:
>
> Hi Nick,
>
> What you and Lucas wrote about the different configurations of ALOS/EOS
> and READ_COMMITTED/READ_UNCOMMITTED make sense to me. My earlier
> concerns about changelogs diverging from the content of the local state
> stores turned out to not apply. So I think, we can move on with those
> configurations.
>
> Regarding the TaskCorruptedException and wiping out the state stores
> under EOS, couldn't we abort the transaction on the state store and
> close the task dirty? If the Kafka transaction was indeed committed, the
> store would restore the missing part from the changelog topic. If the
> Kafka transaction was not committed, changelog topic and state store are
> in-sync.
>
> In any case, IMO those are implementation details that we do not need to
> discuss and solve in the KIP discussion. We can solve them on the PR.
> The important thing is that the processing guarantees hold.
>
> Best,
> Bruno
>
> On 10/18/23 3:56 PM, Nick Telford wrote:
> > Hi Lucas,
> >
> > TaskCorruptedException is how Streams signals that the Task state needs to
> > be wiped, so we can't retain that exception without also wiping state on
> > timeouts.
> >
> > Regards,
> > Nick
> >
> > On Wed, 18 Oct 2023 at 14:48, Lucas Brutschy 
> > 
> > wrote:
> >
> >> Hi Nick,
> >>
> >> I think indeed the better behavior would be to retry commitTransaction
> >> until we risk running out of time to meet `max.poll.interval.ms`.
> >>
> >> However, if it's handled as a `TaskCorruptedException` at the moment,
> >> I would do the same in this KIP, and leave exception handling
> >> improvements to future work. This KIP is already improving the
> >> situation a lot by not wiping the state store.
> >>
> >> Cheers,
> >> Lucas
> >>
> >> On Tue, Oct 17, 2023 at 3:51 PM Nick Telford 
> >> wrote:
> >>>
> >>> Hi Lucas,
> >>>
> >>> Yeah, this is pretty much the direction I'm thinking of going in now. You
> >>> make an interesting point about committing on-error under
> >>> ALOS/READ_COMMITTED, although I haven't had a chance to think through the
> >>> implications yet.
> >>>
> >>> Something that I ran into earlier this week is an issue with the new
> >>> handling of TimeoutException. Without TX stores, TimeoutException under
> >> EOS
> >>> throws a TaskCorruptedException, which wipes the stores. However, with TX
> >>> stores, TimeoutException is now just bubbled up and dealt with as it is
> >>> under ALOS. The problem arises when the Producer#commitTransaction call
> >>> times out: Streams attempts to ignore the error and continue producing,
> >>> which causes the next call to Producer#send to throw
> >>> "IllegalStateException: Cannot attempt operation `send` because the
> >>> previous call to `commitTransaction` timed out and must be retried".
> >>>
> >>> I'm not sure what we should do here: retrying the commitTransaction seems
> >>> logical, but what if it times out again? Where do we draw the line and
> >>> shutdown the instance?
> >>>
> >>> Regards,
> >>> Nick
> >>>
> >>> On Mon, 16 Oct 2023 at 13:19, Lucas Brutschy  >> .invalid>
> >>> wrote:
> >>>
>  Hi all,
> 
>  I think I liked your suggestion of allowing EOS with READ_UNCOMMITTED,
>  but keep wiping the state on error, and I'd vote for this solution
>  when introducing `default.state.isolation.level`. This way, we'd have
>  the most low-risk roll-out of this feature (no behavior change without
>  reconfiguration), with the possibility of switching to the most sane /
>  battle-tested default settings in 4.0. Essentially, we'd have a
>  feature flag but call it `default.state.isolation.level` and don't
>  have to deprecate it later.
> 
>  So the possible configurations would then be this:
> 
>  1. ALOS/READ_UNCOMMITTED (default) = processing uses direct-to-DB, IQ
>  reads from DB.
>  2. ALOS/READ_COMMITTED = processing uses WriteBatch, IQ reads from
>  WriteBatch/DB. Flush on error (see note below).
>  3. EOS/READ_UNCOMMITTED (default) = processing uses direct-to-DB, IQ
>  reads from DB. Wipe state on error.
>  4. EOS/READ_COMMITTED = processing uses WriteBatch, IQ reads from
>  WriteBatch/DB.
> 
>  I believe the feature is important enough that we will see good
>  adoption even without changing the default. In 4.0, when we have seen
>  this being adopted and is battle-tested, we make READ_COMMITTED the
>  default for EOS, or even READ_COMITTED always the default, depending
>  on our experiences. And we could add a clever implementation of
> 

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2023-10-29 Thread Ismael Juma
I think kafka-native is clearer. Over time, the graalvm images may be used
for production too.

Ismael

On Sat, Oct 28, 2023, 11:52 PM Manikumar  wrote:

> Thanks for the explanation. I am fine with using ""kafka-local" as the
> image name.
>
> On Fri, Oct 27, 2023 at 11:47 AM Krishna Agarwal <
> krishna0608agar...@gmail.com> wrote:
>
> > Hi Manikumar,
> > Thanks for the feedback.
> >
> > This image signifies 2 things:
> >
> >1. Image should be used for the local development and testing purposes
> >with fast startup times. (kafka-local)
> >2. To achieve (1) - we are providing a native executable for Apache
> >Kafka in the docker image. (kafka-native)
> >
> > While "graalvm" is the underlying tool enabling this, I'm unsure if we
> > should explicitly mention it in the name.
> > I'd love to hear your thoughts on this. Do you prefer "kafka-native"
> > instead of "kafka-local"?
> >
> > Regards,
> > Krishna
> >
> > On Fri, Oct 20, 2023 at 3:32 PM Manikumar 
> > wrote:
> >
> > > Hi,
> > >
> > > > For the native AK docker image, we are considering '*kafka-local*' as
> > it
> > > clearly signifies that this image is intended exclusively for local
> > >
> > > I am not sure, if there is any naming pattern for graalvm based images.
> > Can
> > > we include "graalvm" to the image name like "kafka-graalvm-native".
> > > This will clearly indicate this is graalvm based image.
> > >
> > >
> > > Thanks. Regards
> > >
> > >
> > >
> > >
> > > On Wed, Oct 18, 2023 at 9:26 PM Krishna Agarwal <
> > > krishna0608agar...@gmail.com> wrote:
> > >
> > > > Hi Federico,
> > > > Thanks for the feedback and apologies for the delay.
> > > >
> > > > I've included a section in the KIP on the release process. I would
> > > greatly
> > > > appreciate your insights after reviewing it.
> > > >
> > > > Regards,
> > > > Krishna
> > > >
> > > > On Fri, Sep 8, 2023 at 3:08 PM Federico Valeri  >
> > > > wrote:
> > > >
> > > > > Hi Krishna, thanks for opening this discussion.
> > > > >
> > > > > I see you created two separate KIPs (974 and 975), but there are
> some
> > > > > common points (build system and test plan).
> > > > >
> > > > > Currently, the Docker image used for system tests is only supported
> > in
> > > > > that limited scope, so the maintenance burden is minimal. Providing
> > > > > official Kafka images would be much more complicated. Have you
> > > > > considered how the image rebuild process would work in case a high
> > > > > severity CVE comes out for a non Kafka image dependency? In that
> > case,
> > > > > there will be no Kafka release.
> > > > >
> > > > > Br
> > > > > Fede
> > > > >
> > > > > On Fri, Sep 8, 2023 at 9:17 AM Krishna Agarwal
> > > > >  wrote:
> > > > > >
> > > > > > Hi,
> > > > > > I want to submit a KIP to deliver an experimental Apache Kafka
> > docker
> > > > > image.
> > > > > > The proposed docker image can launch brokers with sub-second
> > startup
> > > > time
> > > > > > and minimal memory footprint by leveraging a GraalVM based native
> > > Kafka
> > > > > > binary.
> > > > > >
> > > > > > KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > > > > > <
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A+Docker+Image+for+GraalVM+based+Native+Kafka+Broker
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Krishna
> > > > >
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-29 Thread John Roesler
Congratulations, Satish!
-John

On Sun, Oct 29, 2023, at 08:09, Randall Hauch wrote:
> Congratulations, Satish!
>
> On Sun, Oct 29, 2023 at 1:47 AM Tom Bentley  wrote:
>
>> Congratulations!
>>
>> On Sun, 29 Oct 2023 at 5:41 PM, Guozhang Wang 
>> wrote:
>>
>> > Congratulations Satish!
>> >
>> > On Sat, Oct 28, 2023 at 12:59 AM Luke Chen  wrote:
>> > >
>> > > Congrats Satish!
>> > >
>> > > Luke
>> > >
>> > > On Sat, Oct 28, 2023 at 11:16 AM ziming deng > >
>> > > wrote:
>> > >
>> > > > Congratulations Satish!
>> > > >
>> > > > > On Oct 27, 2023, at 23:03, Jun Rao 
>> wrote:
>> > > > >
>> > > > > Hi, Everyone,
>> > > > >
>> > > > > Satish Duggana has been a Kafka committer since 2022. He has been
>> > very
>> > > > > instrumental to the community since becoming a committer. It's my
>> > > > pleasure
>> > > > > to announce that Satish is now a member of Kafka PMC.
>> > > > >
>> > > > > Congratulations Satish!
>> > > > >
>> > > > > Jun
>> > > > > on behalf of Apache Kafka PMC
>> > > >
>> > > >
>> >
>> >
>>


Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-29 Thread Randall Hauch
Congratulations, Satish!

On Sun, Oct 29, 2023 at 1:47 AM Tom Bentley  wrote:

> Congratulations!
>
> On Sun, 29 Oct 2023 at 5:41 PM, Guozhang Wang 
> wrote:
>
> > Congratulations Satish!
> >
> > On Sat, Oct 28, 2023 at 12:59 AM Luke Chen  wrote:
> > >
> > > Congrats Satish!
> > >
> > > Luke
> > >
> > > On Sat, Oct 28, 2023 at 11:16 AM ziming deng  >
> > > wrote:
> > >
> > > > Congratulations Satish!
> > > >
> > > > > On Oct 27, 2023, at 23:03, Jun Rao 
> wrote:
> > > > >
> > > > > Hi, Everyone,
> > > > >
> > > > > Satish Duggana has been a Kafka committer since 2022. He has been
> > very
> > > > > instrumental to the community since becoming a committer. It's my
> > > > pleasure
> > > > > to announce that Satish is now a member of Kafka PMC.
> > > > >
> > > > > Congratulations Satish!
> > > > >
> > > > > Jun
> > > > > on behalf of Apache Kafka PMC
> > > >
> > > >
> >
> >
>


Re: [VOTE] KIP-975: Docker Image for Apache Kafka

2023-10-29 Thread David Jacot
+1 (binding). Thanks for doing this!

Le dim. 29 oct. 2023 à 07:54, Manikumar  a
écrit :

> Hi,
>
> Thanks for the KIP.
>
> +1 (binding)
>
> Thanks
>
> On Fri, Oct 27, 2023 at 9:41 PM Ismael Juma  wrote:
>
> > Thanks for the KIP Krishna - looking forward to this. +1 (binding).
> >
> > On Thu, Oct 26, 2023 at 9:36 PM Krishna Agarwal <
> > krishna0608agar...@gmail.com> wrote:
> >
> > > Hi,
> > > I'd like to call a vote on KIP-975 which aims to publish an official
> > docker
> > > image for Apache Kafka.
> > >
> > > KIP -
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-975%3A+Docker+Image+for+Apache+Kafka
> > >
> > > Discussion thread -
> > > https://lists.apache.org/thread/3g43hps2dmkyxgglplrlwpsf7vkywkyy
> > >
> > > Regards,
> > > Krishna
> > >
> >
>


Re: [VOTE] KIP-975: Docker Image for Apache Kafka

2023-10-29 Thread Manikumar
Hi,

Thanks for the KIP.

+1 (binding)

Thanks

On Fri, Oct 27, 2023 at 9:41 PM Ismael Juma  wrote:

> Thanks for the KIP Krishna - looking forward to this. +1 (binding).
>
> On Thu, Oct 26, 2023 at 9:36 PM Krishna Agarwal <
> krishna0608agar...@gmail.com> wrote:
>
> > Hi,
> > I'd like to call a vote on KIP-975 which aims to publish an official
> docker
> > image for Apache Kafka.
> >
> > KIP -
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-975%3A+Docker+Image+for+Apache+Kafka
> >
> > Discussion thread -
> > https://lists.apache.org/thread/3g43hps2dmkyxgglplrlwpsf7vkywkyy
> >
> > Regards,
> > Krishna
> >
>


Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2023-10-29 Thread Manikumar
Thanks for the explanation. I am fine with using ""kafka-local" as the
image name.

On Fri, Oct 27, 2023 at 11:47 AM Krishna Agarwal <
krishna0608agar...@gmail.com> wrote:

> Hi Manikumar,
> Thanks for the feedback.
>
> This image signifies 2 things:
>
>1. Image should be used for the local development and testing purposes
>with fast startup times. (kafka-local)
>2. To achieve (1) - we are providing a native executable for Apache
>Kafka in the docker image. (kafka-native)
>
> While "graalvm" is the underlying tool enabling this, I'm unsure if we
> should explicitly mention it in the name.
> I'd love to hear your thoughts on this. Do you prefer "kafka-native"
> instead of "kafka-local"?
>
> Regards,
> Krishna
>
> On Fri, Oct 20, 2023 at 3:32 PM Manikumar 
> wrote:
>
> > Hi,
> >
> > > For the native AK docker image, we are considering '*kafka-local*' as
> it
> > clearly signifies that this image is intended exclusively for local
> >
> > I am not sure, if there is any naming pattern for graalvm based images.
> Can
> > we include "graalvm" to the image name like "kafka-graalvm-native".
> > This will clearly indicate this is graalvm based image.
> >
> >
> > Thanks. Regards
> >
> >
> >
> >
> > On Wed, Oct 18, 2023 at 9:26 PM Krishna Agarwal <
> > krishna0608agar...@gmail.com> wrote:
> >
> > > Hi Federico,
> > > Thanks for the feedback and apologies for the delay.
> > >
> > > I've included a section in the KIP on the release process. I would
> > greatly
> > > appreciate your insights after reviewing it.
> > >
> > > Regards,
> > > Krishna
> > >
> > > On Fri, Sep 8, 2023 at 3:08 PM Federico Valeri 
> > > wrote:
> > >
> > > > Hi Krishna, thanks for opening this discussion.
> > > >
> > > > I see you created two separate KIPs (974 and 975), but there are some
> > > > common points (build system and test plan).
> > > >
> > > > Currently, the Docker image used for system tests is only supported
> in
> > > > that limited scope, so the maintenance burden is minimal. Providing
> > > > official Kafka images would be much more complicated. Have you
> > > > considered how the image rebuild process would work in case a high
> > > > severity CVE comes out for a non Kafka image dependency? In that
> case,
> > > > there will be no Kafka release.
> > > >
> > > > Br
> > > > Fede
> > > >
> > > > On Fri, Sep 8, 2023 at 9:17 AM Krishna Agarwal
> > > >  wrote:
> > > > >
> > > > > Hi,
> > > > > I want to submit a KIP to deliver an experimental Apache Kafka
> docker
> > > > image.
> > > > > The proposed docker image can launch brokers with sub-second
> startup
> > > time
> > > > > and minimal memory footprint by leveraging a GraalVM based native
> > Kafka
> > > > > binary.
> > > > >
> > > > > KIP-974: Docker Image for GraalVM based Native Kafka Broker
> > > > > <
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-974%3A+Docker+Image+for+GraalVM+based+Native+Kafka+Broker
> > > > >
> > > > >
> > > > > Regards,
> > > > > Krishna
> > > >
> > >
> >
>


Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-29 Thread Tom Bentley
Congratulations!

On Sun, 29 Oct 2023 at 5:41 PM, Guozhang Wang 
wrote:

> Congratulations Satish!
>
> On Sat, Oct 28, 2023 at 12:59 AM Luke Chen  wrote:
> >
> > Congrats Satish!
> >
> > Luke
> >
> > On Sat, Oct 28, 2023 at 11:16 AM ziming deng 
> > wrote:
> >
> > > Congratulations Satish!
> > >
> > > > On Oct 27, 2023, at 23:03, Jun Rao  wrote:
> > > >
> > > > Hi, Everyone,
> > > >
> > > > Satish Duggana has been a Kafka committer since 2022. He has been
> very
> > > > instrumental to the community since becoming a committer. It's my
> > > pleasure
> > > > to announce that Satish is now a member of Kafka PMC.
> > > >
> > > > Congratulations Satish!
> > > >
> > > > Jun
> > > > on behalf of Apache Kafka PMC
> > >
> > >
>
>