date:20210208

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #519

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: add Utils.isBlank to check whitespace character string and 
empty string (#10012)


--
[...truncated 7.22 MB...]

AclAuthorizerTest > testAuthorizeByResourceTypeWildcardResourceDenyDominate() 
STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWildcardResourceDenyDominate() 
PASSED

AclAuthorizerTest > testEmptyAclThrowsException() STARTED

AclAuthorizerTest > testEmptyAclThrowsException() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() PASSED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() STARTED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() PASSED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() STARTED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() PASSED

AclAuthorizerTest > testDeleteAclOnWildcardResource() STARTED

AclAuthorizerTest > testDeleteAclOnWildcardResource() PASSED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() STARTED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() PASSED

AclAuthorizerTest > testChangeListenerTiming() STARTED

AclAuthorizerTest > testChangeListenerTiming() PASSED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 STARTED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 PASSED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() STARTED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
STARTED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() PASSED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() STARTED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() PASSED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() STARTED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() PASSED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() STARTED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() PASSED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() STARTED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() PASSED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() STARTED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() PASSED

AclAuthorizerTest > testAddAclsOnLiteralResource() STARTED

AclAuthorizerTest > testAddAclsOnLiteralResource() PASSED

AclAuthorizerTest > testGetAclsPrincipal() STARTED

AclAuthorizerTest > testGetAclsPrincipal() PASSED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() STARTED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() PASSED

AclAuthorizerTest > testLoadCache() STARTED

AclAuthorizerTest > testLoadCache() PASSED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
STARTED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() PASSED

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #497

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: add Utils.isBlank to check whitespace character string and 
empty string (#10012)


--
[...truncated 3.62 MB...]
KafkaZkClientTest > testDeleteTopicPathMethods() STARTED

KafkaZkClientTest > testDeleteTopicPathMethods() PASSED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() STARTED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() PASSED

KafkaZkClientTest > testAclManagementMethods() STARTED

KafkaZkClientTest > testAclManagementMethods() PASSED

KafkaZkClientTest > testPreferredReplicaElectionMethods() STARTED

KafkaZkClientTest > testPreferredReplicaElectionMethods() PASSED

KafkaZkClientTest > testPropagateLogDir() STARTED

KafkaZkClientTest > testPropagateLogDir() PASSED

KafkaZkClientTest > testGetDataAndStat() STARTED

KafkaZkClientTest > testGetDataAndStat() PASSED

KafkaZkClientTest > testReassignPartitionsInProgress() STARTED

KafkaZkClientTest > testReassignPartitionsInProgress() PASSED

KafkaZkClientTest > testCreateTopLevelPaths() STARTED

KafkaZkClientTest > testCreateTopLevelPaths() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() PASSED

KafkaZkClientTest > testIsrChangeNotificationGetters() STARTED

KafkaZkClientTest > testIsrChangeNotificationGetters() PASSED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() STARTED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() PASSED

KafkaZkClientTest > testGetLogConfigs() STARTED

KafkaZkClientTest > testGetLogConfigs() PASSED

KafkaZkClientTest > testBrokerSequenceIdMethods() STARTED

KafkaZkClientTest > testBrokerSequenceIdMethods() PASSED

KafkaZkClientTest > testAclMethods() STARTED

KafkaZkClientTest > testAclMethods() PASSED

KafkaZkClientTest > testCreateSequentialPersistentPath() STARTED

KafkaZkClientTest > testCreateSequentialPersistentPath() PASSED

KafkaZkClientTest > testConditionalUpdatePath() STARTED

KafkaZkClientTest > testConditionalUpdatePath() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() PASSED

KafkaZkClientTest > testDeleteTopicZNode() STARTED

KafkaZkClientTest > testDeleteTopicZNode() PASSED

KafkaZkClientTest > testDeletePath() STARTED

KafkaZkClientTest > testDeletePath() PASSED

KafkaZkClientTest > testGetBrokerMethods() STARTED

KafkaZkClientTest > testGetBrokerMethods() PASSED

KafkaZkClientTest > testCreateTokenChangeNotification() STARTED

KafkaZkClientTest > testCreateTokenChangeNotification() PASSED

KafkaZkClientTest > testGetTopicsAndPartitions() STARTED

KafkaZkClientTest > testGetTopicsAndPartitions() PASSED

KafkaZkClientTest > testRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRegisterBrokerInfo() PASSED

KafkaZkClientTest > testRetryRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRetryRegisterBrokerInfo() PASSED

KafkaZkClientTest > testConsumerOffsetPath() STARTED

KafkaZkClientTest > testConsumerOffsetPath() PASSED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() STARTED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() PASSED

KafkaZkClientTest > testTopicAssignments() STARTED

KafkaZkClientTest > testTopicAssignments() PASSED

KafkaZkClientTest > testControllerManagementMethods() STARTED

KafkaZkClientTest > testControllerManagementMethods() PASSED

KafkaZkClientTest > testTopicAssignmentMethods() STARTED

KafkaZkClientTest > testTopicAssignmentMethods() PASSED

KafkaZkClientTest > testConnectionViaNettyClient() STARTED

KafkaZkClientTest > testConnectionViaNettyClient() PASSED

KafkaZkClientTest > testPropagateIsrChanges() STARTED

KafkaZkClientTest > testPropagateIsrChanges() PASSED

KafkaZkClientTest > testControllerEpochMethods() STARTED

KafkaZkClientTest > testControllerEpochMethods() PASSED

KafkaZkClientTest > testDeleteRecursive() STARTED

KafkaZkClientTest > testDeleteRecursive() PASSED

KafkaZkClientTest > testGetTopicPartitionStates() STARTED

KafkaZkClientTest > testGetTopicPartitionStates() PASSED

KafkaZkClientTest > testCreateConfigChangeNotification() STARTED

KafkaZkClientTest > testCreateConfigChangeNotification() PASSED

KafkaZkClientTest > testDelegationTokenMethods() STARTED

KafkaZkClientTest > testDelegationTokenMethods() PASSED

LiteralAclStoreTest > shouldHaveCorrectPaths() STARTED

LiteralAclStoreTest > shouldHaveCorrectPaths() PASSED

LiteralAclStoreTest > shouldRoundTripChangeNode() STARTED

LiteralAclStoreTest > shouldRoundTripChangeNode() PASSED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() STARTED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() PASSED

LiteralAclStoreTest > shouldWriteChangesToTheWritePath() STARTED

LiteralAclStoreTest > shouldWriteChangesToTheWritePath() PASSED

[jira] [Created] (KAFKA-12315) Clearing the ZkReplicaStateMachine request batch state upon ControllerMovedException

2021-02-08 Thread Lucas Wang (Jira)

Lucas Wang created KAFKA-12315:
--

 Summary: Clearing the ZkReplicaStateMachine request batch state 
upon ControllerMovedException
 Key: KAFKA-12315
 URL: https://issues.apache.org/jira/browse/KAFKA-12315
 Project: Kafka
  Issue Type: Improvement
Reporter: Lucas Wang
 Attachments: controller_moved_left_over_state.png

As shown in the attached sequence diagram, during topic deletion the following 
sequence of events can happen
1. The ZkReplicaStateMachine calls 
AbstractControllerBrokerRequestBatch.addStopReplicaRequestForBrokers and
   adds some entries to its stopReplicaRequestMap

2. The ZkReplicaStateMachine then tries to call KafkaZkClient.updateLeaderAndIsr

3. Inside KafkaZkClient$.unwrapResponseWithControllerEpochCheck, a 
ControllerMovedException may be thrown
   due to zkVersion check failure

4. The ControllerMovedException is captured by the ZkPartitionStateMachine and 
an error such as the following is created:

2021/02/05 04:34:45.302 [ZkReplicaStateMachine] [ReplicaStateMachine 
controllerId=31862] Controller moved to another broker when moving some 
replicas to OfflineReplica state
org.apache.kafka.common.errors.ControllerMovedException: Controller epoch 
zkVersion check fails. Expected zkVersion = 139

5. The ControllerMovedException is rethrown and captured by the 
KafkaController, which will resign

At this point, the controller has resigned, however the stopReplicaRequestMap 
state populated in step 1 hasn't been cleared.

Later on, when the controller wins an election and becomes the active 
controller again, an IllegalStateException will be triggered due to the left 
over state:

```
2021/02/05 16:04:33.193 [ZkReplicaStateMachine] [ReplicaStateMachine 
controllerId=31862] Error while moving some replicas to OnlineReplica state
java.lang.IllegalStateException: Controller to broker state change requests 
batch is not empty while creating a new one. Some StopReplica state changes 
Map(6121 -> ListB\
uffer(StopRepl\
icaRequestInfo([Topic=,Partition=2,Replica=6121],false))) 
might be lost
at 
kafka.controller.AbstractControllerBrokerRequestBatch.newBatch(ControllerChannelManager.scala:383)
 ~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.ZkReplicaStateMachine.handleStateChanges(ReplicaStateMachine.scala:109)
 ~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.ReplicaStateMachine.startup(ReplicaStateMachine.scala:40) 
~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:365)
 ~[kafka_2.12-2.4.1.10.jar:?]
at kafka.controller.KafkaController.elect(KafkaController.scala:1484) 
~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.KafkaController.processReelect(KafkaController.scala:1972) 
~[kafka_2.12-2.4.1.10.jar:?]
at kafka.controller.KafkaController.process(KafkaController.scala:2065) 
~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.QueuedEvent.process(ControllerEventManager.scala:53) 
~[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.ControllerEventManager$ControllerEventThread.$anonfun$doWork$1(ControllerEventManager.scala:137)
 ~[kafka_2.12-2.4.1.10.jar:?]
at 
scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) 
[scala-library-2.12.10.jar:?]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:31) 
[kafka_2.12-2.4.1.10.jar:?]
at 
kafka.controller.ControllerEventManager$ControllerEventThread.doWork(ControllerEventManager.scala:137)
 [kafka_2.12-2.4.1.10.jar:?]
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96) 
[kafka_2.12-2.4.1.10.jar:?]
```
Essentially, the controller is not able to transition some replicas to 
OnlineReplica state, and it cannot send any requests to any brokers via the 
ReplicaStateMachine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #466

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: add Utils.isBlank to check whitespace character string and 
empty string (#10012)


--
[...truncated 3.61 MB...]
LogTest > testReadWithTooSmallMaxLength() PASSED

LogTest > testOverCompactedLogRecovery() STARTED

LogTest > testOverCompactedLogRecovery() PASSED

LogTest > testBogusIndexSegmentsAreRemoved() STARTED

LogTest > testBogusIndexSegmentsAreRemoved() PASSED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() STARTED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() PASSED

LogTest > testCompressedMessages() STARTED

LogTest > testCompressedMessages() PASSED

LogTest > testAppendMessageWithNullPayload() STARTED

LogTest > testAppendMessageWithNullPayload() PASSED

LogTest > testCorruptLog() STARTED

LogTest > testCorruptLog() PASSED

LogTest > testLogRecoversToCorrectOffset() STARTED

LogTest > testLogRecoversToCorrectOffset() PASSED

LogTest > testReopenThenTruncate() STARTED

LogTest > testReopenThenTruncate() PASSED

LogTest > testZombieCoordinatorFenced() STARTED

LogTest > testZombieCoordinatorFenced() PASSED

LogTest > testOldProducerEpoch() STARTED

LogTest > testOldProducerEpoch() PASSED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() STARTED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() PASSED

LogTest > testDegenerateSegmentSplit() STARTED

LogTest > testDegenerateSegmentSplit() PASSED

LogTest > testParseTopicPartitionNameForMissingPartition() STARTED

LogTest > testParseTopicPartitionNameForMissingPartition() PASSED

LogTest > testParseTopicPartitionNameForEmptyName() STARTED

LogTest > testParseTopicPartitionNameForEmptyName() PASSED

LogTest > testOffsetSnapshot() STARTED

LogTest > testOffsetSnapshot() PASSED

LogTest > testOpenDeletesObsoleteFiles() STARTED

LogTest > testOpenDeletesObsoleteFiles() PASSED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() STARTED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() PASSED

LogTest > testLogDeleteDirName() STARTED

LogTest > testLogDeleteDirName() PASSED

LogTest > testDeleteOldSegments() STARTED

LogTest > testDeleteOldSegments() PASSED

LogTest > testRebuildTimeIndexForOldMessages() STARTED

LogTest > testRebuildTimeIndexForOldMessages() PASSED

LogTest > testProducerIdMapTruncateTo() STARTED

LogTest > testProducerIdMapTruncateTo() PASSED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
STARTED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
PASSED

LogTest > testLogEndLessThanStartAfterReopen() STARTED

LogTest > testLogEndLessThanStartAfterReopen() PASSED

LogTest > testLogRecoversForLeaderEpoch() STARTED

LogTest > testLogRecoversForLeaderEpoch() PASSED

LogTest > testRetentionDeletesProducerStateSnapshots() STARTED

LogTest > testRetentionDeletesProducerStateSnapshots() PASSED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() STARTED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() PASSED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() STARTED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() PASSED

LogTest > testOverCompactedLogRecoveryMultiRecord() STARTED

LogTest > testOverCompactedLogRecoveryMultiRecord() PASSED

LogTest > testSizeBasedLogRoll() STARTED

LogTest > testSizeBasedLogRoll() PASSED

LogTest > testRebuildProducerIdMapWithCompactedData() STARTED

LogTest > testRebuildProducerIdMapWithCompactedData() PASSED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() STARTED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() PASSED

LogTest > testTransactionIndexUpdatedThroughReplication() STARTED

LogTest > testTransactionIndexUpdatedThroughReplication() PASSED

LogTest > testTimeBasedLogRollJitter() STARTED

LogTest > testTimeBasedLogRollJitter() PASSED

LogTest > testParseTopicPartitionName() STARTED

LogTest > testParseTopicPartitionName() PASSED

LogTest > testEndTxnWithFencedProducerEpoch() STARTED

LogTest > testEndTxnWithFencedProducerEpoch() PASSED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() STARTED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() PASSED

LogTest > testRecoverAfterNonMonotonicCoordinatorEpochWrite() STARTED

LogTest > testRecoverAfterNonMonotonicCoordinatorEpochWrite() PASSED

LogTest > testLoadProducersAfterDeleteRecordsMidSegment() STARTED

LogTest > testLoadProducersAfterDeleteRecordsMidSegment() PASSED

LogTest > testInitializationOfProducerSnapshotsUpgradePath() STARTED

LogTest > testInitializationOfProducerSnapshotsUpgradePath() PASSED

LogTest > 
shouldDeleteStartOffsetBreachedSegmentsWhenPolicyDoesNotIncludeDelete() STARTED

LogTest > 
shouldDeleteStartOffsetBreachedSegmentsWhenPolicyDoesNotIncludeDelete() PASSED

LogTest >

[jira] [Resolved] (KAFKA-10834) Remove redundant type casts in Connect

2021-02-08 Thread Chia-Ping Tsai (Jira)



 [ 
https://issues.apache.org/jira/browse/KAFKA-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chia-Ping Tsai resolved KAFKA-10834.

Fix Version/s: 2.8.0
   Resolution: Fixed

> Remove redundant type casts in Connect
> --
>
> Key: KAFKA-10834
> URL: https://issues.apache.org/jira/browse/KAFKA-10834
> Project: Kafka
>  Issue Type: Improvement
>  Components: KafkaConnect
>Reporter: Konstantine Karantasis
>Assignee: Lev Zemlyanov
>Priority: Minor
> Fix For: 2.8.0
>
>
> Some type casts in the code base are not required any more and can be 
> removed. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (KAFKA-10835) Replace Runnable and Callable overrides with lambdas in Connect

2021-02-08 Thread Chia-Ping Tsai (Jira)



 [ 
https://issues.apache.org/jira/browse/KAFKA-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chia-Ping Tsai resolved KAFKA-10835.

Fix Version/s: 2.8.0
   Resolution: Fixed

> Replace Runnable and Callable overrides with lambdas in Connect
> ---
>
> Key: KAFKA-10835
> URL: https://issues.apache.org/jira/browse/KAFKA-10835
> Project: Kafka
>  Issue Type: Improvement
>  Components: KafkaConnect
>Reporter: Konstantine Karantasis
>Assignee: Lev Zemlyanov
>Priority: Minor
> Fix For: 2.8.0
>
>
> We've been using Java 8 for sometime now of course. Replacing the overrides 
> from the pre-Java 8 era will simplify some parts of the code and will reduce 
> verbosity. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #496

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: replace hard-coding utf-8 with StandardCharsets.UTF_8 (#10079)


--
[...truncated 7.11 MB...]

KafkaZkClientTest > testGetConsumerOffsetNoData() STARTED

KafkaZkClientTest > testGetConsumerOffsetNoData() PASSED

KafkaZkClientTest > testDeleteTopicPathMethods() STARTED

KafkaZkClientTest > testDeleteTopicPathMethods() PASSED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() STARTED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() PASSED

KafkaZkClientTest > testAclManagementMethods() STARTED

KafkaZkClientTest > testAclManagementMethods() PASSED

KafkaZkClientTest > testPreferredReplicaElectionMethods() STARTED

KafkaZkClientTest > testPreferredReplicaElectionMethods() PASSED

KafkaZkClientTest > testPropagateLogDir() STARTED

KafkaZkClientTest > testPropagateLogDir() PASSED

KafkaZkClientTest > testGetDataAndStat() STARTED

KafkaZkClientTest > testGetDataAndStat() PASSED

KafkaZkClientTest > testReassignPartitionsInProgress() STARTED

KafkaZkClientTest > testReassignPartitionsInProgress() PASSED

KafkaZkClientTest > testCreateTopLevelPaths() STARTED

KafkaZkClientTest > testCreateTopLevelPaths() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() PASSED

KafkaZkClientTest > testIsrChangeNotificationGetters() STARTED

KafkaZkClientTest > testIsrChangeNotificationGetters() PASSED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() STARTED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() PASSED

KafkaZkClientTest > testGetLogConfigs() STARTED

KafkaZkClientTest > testGetLogConfigs() PASSED

KafkaZkClientTest > testBrokerSequenceIdMethods() STARTED

KafkaZkClientTest > testBrokerSequenceIdMethods() PASSED

KafkaZkClientTest > testAclMethods() STARTED

KafkaZkClientTest > testAclMethods() PASSED

KafkaZkClientTest > testCreateSequentialPersistentPath() STARTED

KafkaZkClientTest > testCreateSequentialPersistentPath() PASSED

KafkaZkClientTest > testConditionalUpdatePath() STARTED

KafkaZkClientTest > testConditionalUpdatePath() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() PASSED

KafkaZkClientTest > testDeleteTopicZNode() STARTED

KafkaZkClientTest > testDeleteTopicZNode() PASSED

KafkaZkClientTest > testDeletePath() STARTED

KafkaZkClientTest > testDeletePath() PASSED

KafkaZkClientTest > testGetBrokerMethods() STARTED

KafkaZkClientTest > testGetBrokerMethods() PASSED

KafkaZkClientTest > testCreateTokenChangeNotification() STARTED

KafkaZkClientTest > testCreateTokenChangeNotification() PASSED

KafkaZkClientTest > testGetTopicsAndPartitions() STARTED

KafkaZkClientTest > testGetTopicsAndPartitions() PASSED

KafkaZkClientTest > testRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRegisterBrokerInfo() PASSED

KafkaZkClientTest > testRetryRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRetryRegisterBrokerInfo() PASSED

KafkaZkClientTest > testConsumerOffsetPath() STARTED

KafkaZkClientTest > testConsumerOffsetPath() PASSED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() STARTED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() PASSED

KafkaZkClientTest > testTopicAssignments() STARTED

KafkaZkClientTest > testTopicAssignments() PASSED

KafkaZkClientTest > testControllerManagementMethods() STARTED

KafkaZkClientTest > testControllerManagementMethods() PASSED

KafkaZkClientTest > testTopicAssignmentMethods() STARTED

KafkaZkClientTest > testTopicAssignmentMethods() PASSED

KafkaZkClientTest > testConnectionViaNettyClient() STARTED

KafkaZkClientTest > testConnectionViaNettyClient() PASSED

KafkaZkClientTest > testPropagateIsrChanges() STARTED

KafkaZkClientTest > testPropagateIsrChanges() PASSED

KafkaZkClientTest > testControllerEpochMethods() STARTED

KafkaZkClientTest > testControllerEpochMethods() PASSED

KafkaZkClientTest > testDeleteRecursive() STARTED

KafkaZkClientTest > testDeleteRecursive() PASSED

KafkaZkClientTest > testGetTopicPartitionStates() STARTED

KafkaZkClientTest > testGetTopicPartitionStates() PASSED

KafkaZkClientTest > testCreateConfigChangeNotification() STARTED

KafkaZkClientTest > testCreateConfigChangeNotification() PASSED

KafkaZkClientTest > testDelegationTokenMethods() STARTED

KafkaZkClientTest > testDelegationTokenMethods() PASSED

LiteralAclStoreTest > shouldHaveCorrectPaths() STARTED

LiteralAclStoreTest > shouldHaveCorrectPaths() PASSED

LiteralAclStoreTest > shouldRoundTripChangeNode() STARTED

LiteralAclStoreTest > shouldRoundTripChangeNode() PASSED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() STARTED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() PASSED

LiteralAclStoreTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #465

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: replace hard-coding utf-8 with StandardCharsets.UTF_8 (#10079)


--
[...truncated 3.60 MB...]

LogTest > testFetchUpToLogEndOffset() STARTED

LogTest > testFetchUpToLogEndOffset() PASSED

LogTest > testLastStableOffsetDoesNotExceedLogStartOffsetMidSegment() STARTED

LogTest > testLastStableOffsetDoesNotExceedLogStartOffsetMidSegment() PASSED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() STARTED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() PASSED

LogTest > testCorruptIndexRebuild() STARTED

LogTest > testCorruptIndexRebuild() PASSED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() STARTED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() PASSED

LogTest > testReadWithTooSmallMaxLength() STARTED

LogTest > testReadWithTooSmallMaxLength() PASSED

LogTest > testOverCompactedLogRecovery() STARTED

LogTest > testOverCompactedLogRecovery() PASSED

LogTest > testBogusIndexSegmentsAreRemoved() STARTED

LogTest > testBogusIndexSegmentsAreRemoved() PASSED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() STARTED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() PASSED

LogTest > testCompressedMessages() STARTED

LogTest > testCompressedMessages() PASSED

LogTest > testAppendMessageWithNullPayload() STARTED

LogTest > testAppendMessageWithNullPayload() PASSED

LogTest > testCorruptLog() STARTED

LogTest > testCorruptLog() PASSED

LogTest > testLogRecoversToCorrectOffset() STARTED

LogTest > testLogRecoversToCorrectOffset() PASSED

LogTest > testReopenThenTruncate() STARTED

LogTest > testReopenThenTruncate() PASSED

LogTest > testZombieCoordinatorFenced() STARTED

LogTest > testZombieCoordinatorFenced() PASSED

LogTest > testOldProducerEpoch() STARTED

LogTest > testOldProducerEpoch() PASSED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() STARTED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() PASSED

LogTest > testDegenerateSegmentSplit() STARTED

LogTest > testDegenerateSegmentSplit() PASSED

LogTest > testParseTopicPartitionNameForMissingPartition() STARTED

LogTest > testParseTopicPartitionNameForMissingPartition() PASSED

LogTest > testParseTopicPartitionNameForEmptyName() STARTED

LogTest > testParseTopicPartitionNameForEmptyName() PASSED

LogTest > testOffsetSnapshot() STARTED

LogTest > testOffsetSnapshot() PASSED

LogTest > testOpenDeletesObsoleteFiles() STARTED

LogTest > testOpenDeletesObsoleteFiles() PASSED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() STARTED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() PASSED

LogTest > testLogDeleteDirName() STARTED

LogTest > testLogDeleteDirName() PASSED

LogTest > testDeleteOldSegments() STARTED

LogTest > testDeleteOldSegments() PASSED

LogTest > testRebuildTimeIndexForOldMessages() STARTED

LogTest > testRebuildTimeIndexForOldMessages() PASSED

LogTest > testProducerIdMapTruncateTo() STARTED

LogTest > testProducerIdMapTruncateTo() PASSED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
STARTED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
PASSED

LogTest > testLogEndLessThanStartAfterReopen() STARTED

LogTest > testLogEndLessThanStartAfterReopen() PASSED

LogTest > testLogRecoversForLeaderEpoch() STARTED

LogTest > testLogRecoversForLeaderEpoch() PASSED

LogTest > testRetentionDeletesProducerStateSnapshots() STARTED

LogTest > testRetentionDeletesProducerStateSnapshots() PASSED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() STARTED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() PASSED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() STARTED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() PASSED

LogTest > testOverCompactedLogRecoveryMultiRecord() STARTED

LogTest > testOverCompactedLogRecoveryMultiRecord() PASSED

LogTest > testSizeBasedLogRoll() STARTED

LogTest > testSizeBasedLogRoll() PASSED

LogTest > testRebuildProducerIdMapWithCompactedData() STARTED

LogTest > testRebuildProducerIdMapWithCompactedData() PASSED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() STARTED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() PASSED

LogTest > testTransactionIndexUpdatedThroughReplication() STARTED

LogTest > testTransactionIndexUpdatedThroughReplication() PASSED

LogTest > testTimeBasedLogRollJitter() STARTED

LogTest > testTimeBasedLogRollJitter() PASSED

LogTest > testParseTopicPartitionName() STARTED

LogTest > testParseTopicPartitionName() PASSED

LogTest > testEndTxnWithFencedProducerEpoch() STARTED

LogTest > testEndTxnWithFencedProducerEpoch() PASSED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() STARTED

LogTest >

[jira] [Resolved] (KAFKA-10866) Add fetched metadata to ConsumerRecords

2021-02-08 Thread John Roesler (Jira)



 [ 
https://issues.apache.org/jira/browse/KAFKA-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Roesler resolved KAFKA-10866.
--
Resolution: Fixed

> Add fetched metadata to ConsumerRecords
> ---
>
> Key: KAFKA-10866
> URL: https://issues.apache.org/jira/browse/KAFKA-10866
> Project: Kafka
>  Issue Type: Sub-task
>  Components: consumer
>Reporter: John Roesler
>Assignee: John Roesler
>Priority: Blocker
> Fix For: 2.8.0
>
>
> Consumer-side changes for KIP-695



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #518

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: replace hard-coding utf-8 with StandardCharsets.UTF_8 (#10079)


--
[...truncated 3.61 MB...]

AclAuthorizerTest > testAuthorizeByResourceTypeWildcardResourceDenyDominate() 
STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWildcardResourceDenyDominate() 
PASSED

AclAuthorizerTest > testEmptyAclThrowsException() STARTED

AclAuthorizerTest > testEmptyAclThrowsException() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() PASSED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() STARTED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() PASSED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() STARTED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() PASSED

AclAuthorizerTest > testDeleteAclOnWildcardResource() STARTED

AclAuthorizerTest > testDeleteAclOnWildcardResource() PASSED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() STARTED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() PASSED

AclAuthorizerTest > testChangeListenerTiming() STARTED

AclAuthorizerTest > testChangeListenerTiming() PASSED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 STARTED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 PASSED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() STARTED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
STARTED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() PASSED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() STARTED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() PASSED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() STARTED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() PASSED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() STARTED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() PASSED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() STARTED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() PASSED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() STARTED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() PASSED

AclAuthorizerTest > testAddAclsOnLiteralResource() STARTED

AclAuthorizerTest > testAddAclsOnLiteralResource() PASSED

AclAuthorizerTest > testGetAclsPrincipal() STARTED

AclAuthorizerTest > testGetAclsPrincipal() PASSED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() STARTED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() PASSED

AclAuthorizerTest > testLoadCache() STARTED

AclAuthorizerTest > testLoadCache() PASSED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
STARTED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() PASSED

AuthorizerInterfaceDefaultTest >

[jira] [Reopened] (KAFKA-10866) Add fetched metadata to ConsumerRecords

2021-02-08 Thread John Roesler (Jira)



 [ 
https://issues.apache.org/jira/browse/KAFKA-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Roesler reopened KAFKA-10866:
--

> Add fetched metadata to ConsumerRecords
> ---
>
> Key: KAFKA-10866
> URL: https://issues.apache.org/jira/browse/KAFKA-10866
> Project: Kafka
>  Issue Type: Sub-task
>  Components: consumer
>Reporter: John Roesler
>Assignee: John Roesler
>Priority: Major
> Fix For: 2.8.0
>
>
> Consumer-side changes for KIP-695



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KAFKA-12314) Leverage custom comparator for optimized range scans on RocksDB

2021-02-08 Thread A. Sophie Blee-Goldman (Jira)

A. Sophie Blee-Goldman created KAFKA-12314:
--

 Summary: Leverage custom comparator for optimized range scans on 
RocksDB
 Key: KAFKA-12314
 URL: https://issues.apache.org/jira/browse/KAFKA-12314
 Project: Kafka
  Issue Type: Improvement
Reporter: A. Sophie Blee-Goldman


Currently our SessionStore has poor performance on any range scans due to the 
byte layout and possibility of varyingly sized keys. A session window consists 
of the key and two timestamps, the windowEnd and windowStart. This data is 
formatted as

[key, windowEnd, windowStart]

The default comparator in rocksdb is lexicographical, and so it compares bytes 
starting with the key. This means with the above format, the records are 
effectively sorted first by key and then by windowEnd. But if two keys are of 
different lengths, the comparator will start on the left and end up comparing 
the tail bytes of the longer key against the windowEnd timestamp of the shorter 
key. Due to this, we have to set the bounds on SessionStore range scans very 
conservatively, which means we end up reading way more data than we need.

One way out of this would be to use a custom comparator which understands the 
window bytes format we use. So far we haven't done this because of the overhead 
in crossing the JNI with the Java Comparator; we would need a native comparator 
to avoid further performance hit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KAFKA-12313) Consider deprecating the default.windowed.serde.inner.class configs

2021-02-08 Thread A. Sophie Blee-Goldman (Jira)

A. Sophie Blee-Goldman created KAFKA-12313:
--

 Summary: Consider deprecating the 
default.windowed.serde.inner.class configs
 Key: KAFKA-12313
 URL: https://issues.apache.org/jira/browse/KAFKA-12313
 Project: Kafka
  Issue Type: Improvement
Reporter: A. Sophie Blee-Goldman


During the discussion of KIP-659 we discussed whether it made sense to have a 
"default" class for the serdes of windowed inner classes across Streams. Using 
these configs instead of specifying an actual Serde object can lead to subtle 
bugs, since the WindowedDeserializer requires a windowSize in addition to the 
inner class. If the default constructor is invoked, as it will be when falling 
back on the config, this windowSize defaults to MAX_VALUE. 

If the downstream program doesn't care about the window end time in the output, 
then this can go unnoticed and technically there is no problem. But if anything 
does depend on the end time, or the user just wants to manually read the output 
for testing purposes, then the MAX_VALUE will result in a garbage timestamp.

We should consider whether the convenience of specifying a config instead of 
instantiating a Serde in each operator is really worth the risk of a user 
accidentally failing to specify a windowSize



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #464

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Add StorageTool as specified in KIP-631 (#10043)


--
[...truncated 7.19 MB...]

LogTest > testFetchUpToLogEndOffset() STARTED

LogTest > testFetchUpToLogEndOffset() PASSED

LogTest > testLastStableOffsetDoesNotExceedLogStartOffsetMidSegment() STARTED

LogTest > testLastStableOffsetDoesNotExceedLogStartOffsetMidSegment() PASSED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() STARTED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() PASSED

LogTest > testCorruptIndexRebuild() STARTED

LogTest > testCorruptIndexRebuild() PASSED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() STARTED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() PASSED

LogTest > testReadWithTooSmallMaxLength() STARTED

LogTest > testReadWithTooSmallMaxLength() PASSED

LogTest > testOverCompactedLogRecovery() STARTED

LogTest > testOverCompactedLogRecovery() PASSED

LogTest > testBogusIndexSegmentsAreRemoved() STARTED

LogTest > testBogusIndexSegmentsAreRemoved() PASSED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() STARTED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() PASSED

LogTest > testCompressedMessages() STARTED

LogTest > testCompressedMessages() PASSED

LogTest > testAppendMessageWithNullPayload() STARTED

LogTest > testAppendMessageWithNullPayload() PASSED

LogTest > testCorruptLog() STARTED

LogTest > testCorruptLog() PASSED

LogTest > testLogRecoversToCorrectOffset() STARTED

LogTest > testLogRecoversToCorrectOffset() PASSED

LogTest > testReopenThenTruncate() STARTED

LogTest > testReopenThenTruncate() PASSED

LogTest > testZombieCoordinatorFenced() STARTED

LogTest > testZombieCoordinatorFenced() PASSED

LogTest > testOldProducerEpoch() STARTED

LogTest > testOldProducerEpoch() PASSED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() STARTED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() PASSED

LogTest > testDegenerateSegmentSplit() STARTED

LogTest > testDegenerateSegmentSplit() PASSED

LogTest > testParseTopicPartitionNameForMissingPartition() STARTED

LogTest > testParseTopicPartitionNameForMissingPartition() PASSED

LogTest > testParseTopicPartitionNameForEmptyName() STARTED

LogTest > testParseTopicPartitionNameForEmptyName() PASSED

LogTest > testOffsetSnapshot() STARTED

LogTest > testOffsetSnapshot() PASSED

LogTest > testOpenDeletesObsoleteFiles() STARTED

LogTest > testOpenDeletesObsoleteFiles() PASSED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() STARTED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() PASSED

LogTest > testLogDeleteDirName() STARTED

LogTest > testLogDeleteDirName() PASSED

LogTest > testDeleteOldSegments() STARTED

LogTest > testDeleteOldSegments() PASSED

LogTest > testRebuildTimeIndexForOldMessages() STARTED

LogTest > testRebuildTimeIndexForOldMessages() PASSED

LogTest > testProducerIdMapTruncateTo() STARTED

LogTest > testProducerIdMapTruncateTo() PASSED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
STARTED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
PASSED

LogTest > testLogEndLessThanStartAfterReopen() STARTED

LogTest > testLogEndLessThanStartAfterReopen() PASSED

LogTest > testLogRecoversForLeaderEpoch() STARTED

LogTest > testLogRecoversForLeaderEpoch() PASSED

LogTest > testRetentionDeletesProducerStateSnapshots() STARTED

LogTest > testRetentionDeletesProducerStateSnapshots() PASSED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() STARTED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() PASSED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() STARTED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() PASSED

LogTest > testOverCompactedLogRecoveryMultiRecord() STARTED

LogTest > testOverCompactedLogRecoveryMultiRecord() PASSED

LogTest > testSizeBasedLogRoll() STARTED

LogTest > testSizeBasedLogRoll() PASSED

LogTest > testRebuildProducerIdMapWithCompactedData() STARTED

LogTest > testRebuildProducerIdMapWithCompactedData() PASSED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() STARTED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() PASSED

LogTest > testTransactionIndexUpdatedThroughReplication() STARTED

LogTest > testTransactionIndexUpdatedThroughReplication() PASSED

LogTest > testTimeBasedLogRollJitter() STARTED

LogTest > testTimeBasedLogRollJitter() PASSED

LogTest > testParseTopicPartitionName() STARTED

LogTest > testParseTopicPartitionName() PASSED

LogTest > testEndTxnWithFencedProducerEpoch() STARTED

LogTest > testEndTxnWithFencedProducerEpoch() PASSED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() STARTED

LogTest > testRecoveryOfSegmentWithOffsetOverflow()

Re: [DISCUSS] Apache Kafka 2.6.2 release

2021-02-08 Thread Luke Chen

Hi Sophie,
I found there is 1 issue that should be cherry-picked into 2.6 and 2.7
branches: KAFKA-12312 .
Simply put, *Scala* *2.13.4* is released at the end of 2020, and we
upgraded to it and fixed some compatible issues on this PR
, more specifically, it's here

.
We only merged this fix on *trunk*(which will be on 2.8), but we didn't
tell users (or we didn't know there'll be compatible issues) not to adopt
the latest *Scala* *2.13.4*.

Therefore, I think we should cherry-pick this fix into 2.6 and 2.7
branches. What do you think?

Thank you.
Luke

On Tue, Feb 9, 2021 at 3:10 AM Sophie Blee-Goldman 
wrote:

> Hey all,
>
> Since all outstanding bugfixes seem to have made their way over to the 2.6
> branch by now, I plan to move ahead with cutting an RC. As always, please
> let me know if you uncover and critical or blocker bugs that affect 2.6
>
> Thanks!
> Sophie
>
> On Thu, Jan 28, 2021 at 9:25 AM John Roesler  wrote:
>
> > Thanks so much for stepping up, Sophie!
> >
> > I'm +1
> >
> > -John
> >
> > On Wed, 2021-01-27 at 17:59 -0500, Bill Bejeck wrote:
> > > Thanks for taking this on Sophie. +1
> > >
> > > Bill
> > >
> > > On Wed, Jan 27, 2021 at 5:59 PM Ismael Juma  wrote:
> > >
> > > > Thanks Sophie! +1
> > > >
> > > > Ismael
> > > >
> > > > On Wed, Jan 27, 2021 at 2:45 PM Sophie Blee-Goldman <
> > sop...@confluent.io>
> > > > wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > I'd like to volunteer as release manager for a 2.6.2 release. This
> is
> > > > being
> > > > > accelerated
> > > > > to address a critical regression in Kafka Streams for Windows
> users.
> > > > >
> > > > > You can find the release plan on the wiki:
> > > > >
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.6.2
> > > > >
> > > > > Thanks,
> > > > > Sophie
> > > > >
> > > >
> >
> >
> >
>

Jenkins build is back to normal : Kafka » kafka-2.8-jdk8 #3

2021-02-08 Thread Apache Jenkins Server

See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #463

2021-02-08 Thread Apache Jenkins Server

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #495

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Add ClusterTool as specified in KIP-631 (#10047)

[github] MINOR: Add StorageTool as specified in KIP-631 (#10043)


--
[...truncated 3.61 MB...]

KafkaZkClientTest > testUpdateBrokerInfo() STARTED

KafkaZkClientTest > testUpdateBrokerInfo() PASSED

KafkaZkClientTest > testCreateRecursive() STARTED

KafkaZkClientTest > testCreateRecursive() PASSED

KafkaZkClientTest > testGetConsumerOffsetNoData() STARTED

KafkaZkClientTest > testGetConsumerOffsetNoData() PASSED

KafkaZkClientTest > testDeleteTopicPathMethods() STARTED

KafkaZkClientTest > testDeleteTopicPathMethods() PASSED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() STARTED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() PASSED

KafkaZkClientTest > testAclManagementMethods() STARTED

KafkaZkClientTest > testAclManagementMethods() PASSED

KafkaZkClientTest > testPreferredReplicaElectionMethods() STARTED

KafkaZkClientTest > testPreferredReplicaElectionMethods() PASSED

KafkaZkClientTest > testPropagateLogDir() STARTED

KafkaZkClientTest > testPropagateLogDir() PASSED

KafkaZkClientTest > testGetDataAndStat() STARTED

KafkaZkClientTest > testGetDataAndStat() PASSED

KafkaZkClientTest > testReassignPartitionsInProgress() STARTED

KafkaZkClientTest > testReassignPartitionsInProgress() PASSED

KafkaZkClientTest > testCreateTopLevelPaths() STARTED

KafkaZkClientTest > testCreateTopLevelPaths() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() PASSED

KafkaZkClientTest > testIsrChangeNotificationGetters() STARTED

KafkaZkClientTest > testIsrChangeNotificationGetters() PASSED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() STARTED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() PASSED

KafkaZkClientTest > testGetLogConfigs() STARTED

KafkaZkClientTest > testGetLogConfigs() PASSED

KafkaZkClientTest > testBrokerSequenceIdMethods() STARTED

KafkaZkClientTest > testBrokerSequenceIdMethods() PASSED

KafkaZkClientTest > testAclMethods() STARTED

KafkaZkClientTest > testAclMethods() PASSED

KafkaZkClientTest > testCreateSequentialPersistentPath() STARTED

KafkaZkClientTest > testCreateSequentialPersistentPath() PASSED

KafkaZkClientTest > testConditionalUpdatePath() STARTED

KafkaZkClientTest > testConditionalUpdatePath() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() PASSED

KafkaZkClientTest > testDeleteTopicZNode() STARTED

KafkaZkClientTest > testDeleteTopicZNode() PASSED

KafkaZkClientTest > testDeletePath() STARTED

KafkaZkClientTest > testDeletePath() PASSED

KafkaZkClientTest > testGetBrokerMethods() STARTED

KafkaZkClientTest > testGetBrokerMethods() PASSED

KafkaZkClientTest > testCreateTokenChangeNotification() STARTED

KafkaZkClientTest > testCreateTokenChangeNotification() PASSED

KafkaZkClientTest > testGetTopicsAndPartitions() STARTED

KafkaZkClientTest > testGetTopicsAndPartitions() PASSED

KafkaZkClientTest > testRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRegisterBrokerInfo() PASSED

KafkaZkClientTest > testRetryRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRetryRegisterBrokerInfo() PASSED

KafkaZkClientTest > testConsumerOffsetPath() STARTED

KafkaZkClientTest > testConsumerOffsetPath() PASSED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() STARTED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() PASSED

KafkaZkClientTest > testTopicAssignments() STARTED

KafkaZkClientTest > testTopicAssignments() PASSED

KafkaZkClientTest > testControllerManagementMethods() STARTED

KafkaZkClientTest > testControllerManagementMethods() PASSED

KafkaZkClientTest > testTopicAssignmentMethods() STARTED

KafkaZkClientTest > testTopicAssignmentMethods() PASSED

KafkaZkClientTest > testConnectionViaNettyClient() STARTED

KafkaZkClientTest > testConnectionViaNettyClient() PASSED

KafkaZkClientTest > testPropagateIsrChanges() STARTED

KafkaZkClientTest > testPropagateIsrChanges() PASSED

KafkaZkClientTest > testControllerEpochMethods() STARTED

KafkaZkClientTest > testControllerEpochMethods() PASSED

KafkaZkClientTest > testDeleteRecursive() STARTED

KafkaZkClientTest > testDeleteRecursive() PASSED

KafkaZkClientTest > testGetTopicPartitionStates() STARTED

KafkaZkClientTest > testGetTopicPartitionStates() PASSED

KafkaZkClientTest > testCreateConfigChangeNotification() STARTED

KafkaZkClientTest > testCreateConfigChangeNotification() PASSED

KafkaZkClientTest > testDelegationTokenMethods() STARTED

KafkaZkClientTest > testDelegationTokenMethods() PASSED

LiteralAclStoreTest > shouldHaveCorrectPaths() STARTED

LiteralAclStoreTest > shouldHaveCorrectPaths() PASSED

LiteralAclStoreTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #517

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Add ClusterTool as specified in KIP-631 (#10047)

[github] MINOR: Add StorageTool as specified in KIP-631 (#10043)


--
[...truncated 3.61 MB...]

AuthorizerIntegrationTest > testConsumeWithoutTopicDescribeAccess() PASSED

AuthorizerIntegrationTest > testClusterId() STARTED

AuthorizerIntegrationTest > testClusterId() PASSED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnEndTransaction()
 STARTED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnEndTransaction()
 PASSED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnSendOffsetsToTxn()
 STARTED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnSendOffsetsToTxn()
 PASSED

AuthorizerIntegrationTest > testCommitWithNoGroupAccess() STARTED

AuthorizerIntegrationTest > testCommitWithNoGroupAccess() PASSED

AuthorizerIntegrationTest > 
testTransactionalProducerInitTransactionsNoDescribeTransactionalIdAcl() STARTED

AuthorizerIntegrationTest > 
testTransactionalProducerInitTransactionsNoDescribeTransactionalIdAcl() PASSED

AuthorizerIntegrationTest > testAuthorizeByResourceTypeDenyTakesPrecedence() 
STARTED

AuthorizerIntegrationTest > testAuthorizeByResourceTypeDenyTakesPrecedence() 
PASSED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithDescribe() STARTED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithDescribe() PASSED

AuthorizerIntegrationTest > testCreateTopicAuthorizationWithClusterCreate() 
STARTED

AuthorizerIntegrationTest > testCreateTopicAuthorizationWithClusterCreate() 
PASSED

AuthorizerIntegrationTest > testOffsetFetchWithTopicAndGroupRead() STARTED

AuthorizerIntegrationTest > testOffsetFetchWithTopicAndGroupRead() PASSED

AuthorizerIntegrationTest > testCommitWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testCommitWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testAuthorizationWithTopicExisting() STARTED

AuthorizerIntegrationTest > testAuthorizationWithTopicExisting() PASSED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithoutDescribe() 
STARTED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithoutDescribe() 
PASSED

AuthorizerIntegrationTest > testMetadataWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testMetadataWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testProduceWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testProduceWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testDescribeGroupApiWithNoGroupAcl() STARTED

AuthorizerIntegrationTest > testDescribeGroupApiWithNoGroupAcl() PASSED

AuthorizerIntegrationTest > testPatternSubscriptionMatchingInternalTopic() 
STARTED

AuthorizerIntegrationTest > testPatternSubscriptionMatchingInternalTopic() 
PASSED

AuthorizerIntegrationTest > testSendOffsetsWithNoConsumerGroupDescribeAccess() 
STARTED

AuthorizerIntegrationTest > testSendOffsetsWithNoConsumerGroupDescribeAccess() 
PASSED

AuthorizerIntegrationTest > testOffsetFetchTopicDescribe() STARTED

AuthorizerIntegrationTest > testOffsetFetchTopicDescribe() PASSED

AuthorizerIntegrationTest > testCommitWithTopicAndGroupRead() STARTED

AuthorizerIntegrationTest > testCommitWithTopicAndGroupRead() PASSED

AuthorizerIntegrationTest > 
testIdempotentProducerNoIdempotentWriteAclInInitProducerId() STARTED

AuthorizerIntegrationTest > 
testIdempotentProducerNoIdempotentWriteAclInInitProducerId() PASSED

AuthorizerIntegrationTest > testSimpleConsumeWithExplicitSeekAndNoGroupAccess() 
STARTED

AuthorizerIntegrationTest > testSimpleConsumeWithExplicitSeekAndNoGroupAccess() 
PASSED

SslProducerSendTest > testSendNonCompressedMessageWithCreateTime() STARTED

SslProducerSendTest > testSendNonCompressedMessageWithCreateTime() PASSED

SslProducerSendTest > testClose() STARTED

SslProducerSendTest > testClose() PASSED

SslProducerSendTest > testFlush() STARTED

SslProducerSendTest > testFlush() PASSED

SslProducerSendTest > testSendToPartition() STARTED

SslProducerSendTest > testSendToPartition() PASSED

SslProducerSendTest > testSendOffset() STARTED

SslProducerSendTest > testSendOffset() PASSED

SslProducerSendTest > testSendCompressedMessageWithCreateTime() STARTED

SslProducerSendTest > testSendCompressedMessageWithCreateTime() PASSED

SslProducerSendTest > testCloseWithZeroTimeoutFromCallerThread() STARTED

SslProducerSendTest > testCloseWithZeroTimeoutFromCallerThread() PASSED

SslProducerSendTest > testCloseWithZeroTimeoutFromSenderThread() STARTED

SslProducerSendTest > testCloseWithZeroTimeoutFromSenderThread() PASSED

SslProducerSendTest > testSendBeforeAndAfterPartitionExpansion() STARTED

SslProducerSendTest > testSendBeforeAndAfterPartitionExpansion() PASSED

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2021-02-08 Thread Colin McCabe

Hi Gwen,

Thanks for taking a look.  Yes, I do think unregisterBroker would be a better 
name than decommissionBroker.  Let's do that, and also rename the associated 
RPC.

cheers,
Colin


On Sat, Feb 6, 2021, at 21:13, Gwen Shapira wrote:
> I realize that I'm very very late to a pretty big party, but I was
> just looking at the new code (super readable, btw), and noticed that
> the inverse API for registerBroker() is called decomissionBroker().
> It would be way clearer that we are undoing a registration is we
> rename it to unregisterBroker() (and the AdminClient API that matches,
> to avoid more confusion).
> 
> Any objections?
> 
> On Fri, Dec 18, 2020 at 10:08 AM Jun Rao  wrote:
> >
> > Hi, Colin,
> >
> > Thanks for the reply. The KIP looks good to me now. Thanks for your
> > diligence.
> >
> > Jun
> >
> > On Thu, Dec 17, 2020 at 5:15 PM Colin McCabe  wrote:
> >
> > > On Thu, Dec 17, 2020, at 17:02, Jun Rao wrote:
> > > > Hi, Colin,
> > > >
> > > > Thanks for the reply. Sounds good. One more comment.
> > > >
> > > > 231. Currently, we have sasl.mechanism.inter.broker.protocol for inter
> > > > broker communication. It seems that we need a similar config for
> > > specifying
> > > > the sasl mechanism for the communication between the broker and the
> > > > controller.
> > > >
> > >
> > > Hi Jun,
> > >
> > > Yeah... sounds like we could use a new configuration key for this.  I
> > > added sasl.mechanism.controller.protocol for this.
> > >
> > > regards,
> > > Colin
> > >
> > > > Jun
> > > >
> > > > On Thu, Dec 17, 2020 at 2:29 PM Colin McCabe  wrote:
> > > >
> > > > > On Thu, Dec 17, 2020, at 10:19, Jun Rao wrote:
> > > > > > Hi, Colin,
> > > > > >
> > > > > > Thanks for the reply.
> > > > > >
> > > > > > 211. Hmm, I still don't see a clear benefit of registering a broker
> > > > > before
> > > > > > recovery. It's possible for the recovery to take time. However,
> > > during
> > > > > the
> > > > > > recovery mode, it seems the broker will still be in the fenced mode
> > > and
> > > > > > won't be able to do work for the clients. So, registering and
> > > > > heartbeating
> > > > > > early seems to only add unnecessary overhead. For your point on 
> > > > > > topic
> > > > > > creation, I thought we now allow replicas to be created on
> > > > > > unregistered brokers.
> > > > > >
> > > > >
> > > > > Hi Jun,
> > > > >
> > > > > Thanks again for the reviews.
> > > > >
> > > > > Topics cannot be created on unregistered brokers.  They can be created
> > > on
> > > > > registered but fenced brokers.  So for that reason I think it makes
> > > sense
> > > > > to register as early as possible.
> > > > >
> > > > > > 230. Currently, we do have a ControllerId field in MetadataResponse.
> > > In
> > > > > the
> > > > > > early discussion, I thought that we want to expose the controller 
> > > > > > for
> > > > > > debugging purposes, but not used by the client library.
> > > > > >
> > > > >
> > > > > The current plan is that we will expose the controller node ID, but 
> > > > > the
> > > > > controller will not be included in the list of nodes in the metadata
> > > > > response.
> > > > >
> > > > > It's not really possible to include the controller in that list of
> > > nodes
> > > > > because the controller may not share the same set of listeners as the
> > > > > broker.  So, for example, maybe the controller endpoint is using a
> > > > > different type of security than the broker.  So while we could pass
> > > back a
> > > > > hostname and port, the client would have no way to connect since it
> > > doesn't
> > > > > know what security settings to use.
> > > > >
> > > > > regards,
> > > > > Colin
> > > > >
> > > > > > Jun
> > > > > >
> > > > > > On Wed, Dec 16, 2020 at 9:13 PM Colin McCabe 
> > > wrote:
> > > > > >
> > > > > > > On Wed, Dec 16, 2020, at 18:13, Jun Rao wrote:
> > > > > > > > Hi, Colin,
> > > > > > > >
> > > > > > > > Thanks for the reply. Just a couple of more comments.
> > > > > > > >
> > > > > > > > 211. Currently, the broker only registers itself in ZK after log
> > > > > > > recovery.
> > > > > > > > Is there any benefit to change that? As you mentioned, the 
> > > > > > > > broker
> > > > > can't
> > > > > > > do
> > > > > > > > much before completing log recovery.
> > > > > > > >
> > > > > > >
> > > > > > > Hi Jun,
> > > > > > >
> > > > > > > Previously, it wasn't possible to register in ZK without
> > > immediately
> > > > > > > getting added to the MetadataResponse.  So I think that's the main
> > > > > reason
> > > > > > > why registration was delayed until after log recovery.  Since that
> > > > > > > constraint doesn't exist any more, there seems to be no reason to
> > > delay
> > > > > > > registration.
> > > > > > >
> > > > > > > I think delaying registration would have some major downsides.  If
> > > log
> > > > > > > recovery takes a while, that's a longer window during which 
> > > > > > > someone
> > > > > else
> > > > > > > could register a broker with the same ID.  Having

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #494

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: remove an unnecessary explicit type argument (#9982)


--
[...truncated 7.00 MB...]

TransactionMarkerChannelManagerTest > 
shouldRetryAppendToLogOnEndTxnWhenCoordinatorNotAvailableError() PASSED

TransactionMarkerChannelManagerTest > 
shouldCompleteAppendToLogOnEndTxnWhenSendMarkersSucceed() STARTED

TransactionMarkerChannelManagerTest > 
shouldCompleteAppendToLogOnEndTxnWhenSendMarkersSucceed() PASSED

TransactionMarkerChannelManagerTest > 
shouldGenerateRequestPerPartitionPerBroker() STARTED

TransactionMarkerChannelManagerTest > 
shouldGenerateRequestPerPartitionPerBroker() PASSED

TransactionMarkerChannelManagerTest > 
shouldRemoveMarkersForTxnPartitionWhenPartitionEmigrated() STARTED

TransactionMarkerChannelManagerTest > 
shouldRemoveMarkersForTxnPartitionWhenPartitionEmigrated() PASSED

TransactionMarkerChannelManagerTest > shouldSkipSendMarkersWhenLeaderNotFound() 
STARTED

TransactionMarkerChannelManagerTest > shouldSkipSendMarkersWhenLeaderNotFound() 
PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRemoveTopicPartitionFromWaitingSetOnUnsupportedForMessageFormat() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRemoveTopicPartitionFromWaitingSetOnUnsupportedForMessageFormat() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenRecordListTooLargeError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenRecordListTooLargeError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenInvalidProducerEpoch() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenInvalidProducerEpoch() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotLeaderOrFollowerError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotLeaderOrFollowerError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenInvalidRequiredAcksError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenInvalidRequiredAcksError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldReEnqueuePartitionsWhenBrokerDisconnected() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldReEnqueuePartitionsWhenBrokerDisconnected() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotEnoughReplicasError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotEnoughReplicasError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenNoErrors() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenNoErrors() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenCorruptMessageError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenCorruptMessageError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenCoordinatorLoading() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenCoordinatorLoading() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWheCoordinatorEpochFenced() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWheCoordinatorEpochFenced() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenUnknownError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenUnknownError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenNotCoordinator() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenNotCoordinator() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenCoordinatorEpochChanged() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldCompleteDelayedOperationWhenCoordinatorEpochChanged() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenUnknownTopicOrPartitionError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenUnknownTopicOrPartitionError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotEnoughReplicasAfterAppendError() STARTED

TransactionMarkerRequestCompletionHandlerTest > 
shouldRetryPartitionWhenNotEnoughReplicasAfterAppendError() PASSED

TransactionMarkerRequestCompletionHandlerTest > 
shouldThrowIllegalStateExceptionWhenMessageTooLargeError() STARTED

TransactionMarkerRequestCompletionHandlerTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #516

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: remove an unnecessary explicit type argument (#9982)


--
[...truncated 3.63 MB...]
AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeNoAclFoundOverride() PASSED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() STARTED

AclAuthorizerTest > testSuperUserWithCustomPrincipalHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllOperationAce() PASSED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() STARTED

AclAuthorizerTest > testAllowAccessWithCustomPrincipal() PASSED

AclAuthorizerTest > testDeleteAclOnWildcardResource() STARTED

AclAuthorizerTest > testDeleteAclOnWildcardResource() PASSED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() STARTED

AclAuthorizerTest > testAuthorizerZkConfigFromKafkaConfig() PASSED

AclAuthorizerTest > testChangeListenerTiming() STARTED

AclAuthorizerTest > testChangeListenerTiming() PASSED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 STARTED

AclAuthorizerTest > 
testWritesLiteralWritesLiteralAclChangeEventWhenInterBrokerProtocolLessThanKafkaV2eralAclChangesForOlderProtocolVersions()
 PASSED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() STARTED

AclAuthorizerTest > testAuthorzeByResourceTypeSuperUserHasAccess() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
STARTED

AclAuthorizerTest > testAuthorizeByResourceTypePrefixedResourceDenyDominate() 
PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeMultipleAddAndRemove() PASSED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() STARTED

AclAuthorizerTest > 
testThrowsOnAddPrefixedAclIfInterBrokerProtocolVersionTooLow() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnPrefixedResource() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeDenyTakesPrecedence() PASSED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() STARTED

AclAuthorizerTest > testHighConcurrencyModificationOfResourceAcls() PASSED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() STARTED

AclAuthorizerTest > testAuthorizeByResourceTypeWithAllPrincipalAce() PASSED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() STARTED

AclAuthorizerTest > testAuthorizeWithEmptyResourceName() PASSED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() STARTED

AclAuthorizerTest > testAuthorizeThrowsOnNonLiteralResource() PASSED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() STARTED

AclAuthorizerTest > testDeleteAllAclOnPrefixedResource() PASSED

AclAuthorizerTest > testAddAclsOnLiteralResource() STARTED

AclAuthorizerTest > testAddAclsOnLiteralResource() PASSED

AclAuthorizerTest > testGetAclsPrincipal() STARTED

AclAuthorizerTest > testGetAclsPrincipal() PASSED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() STARTED

AclAuthorizerTest > 
testWritesExtendedAclChangeEventIfInterBrokerProtocolNotSet() PASSED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() 
STARTED

AclAuthorizerTest > testAccessAllowedIfAllowAclExistsOnWildcardResource() PASSED

AclAuthorizerTest > testLoadCache() STARTED

AclAuthorizerTest > testLoadCache() PASSED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
STARTED

AuthorizerInterfaceDefaultTest > testAuthorizeByResourceTypeWithAllHostAce() 
PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeIsolationUnrelatedDenyWontDominateAllow() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWildcardResourceDenyDominate() PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() STARTED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypeWithAllOperationAce() PASSED

AuthorizerInterfaceDefaultTest > testAuthorzeByResourceTypeSuperUserHasAccess() 
STARTED

AuthorizerInterfaceDefaultTest > testAuthorzeByResourceTypeSuperUserHasAccess() 
PASSED

AuthorizerInterfaceDefaultTest > 
testAuthorizeByResourceTypePrefixedResourceDenyDominate() STARTED

AuthorizerInterfaceDefaultTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #462

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: remove an unnecessary explicit type argument (#9982)


--
[...truncated 3.59 MB...]

TransactionsTest > testConsecutivelyRunInitTransactions() STARTED

TransactionsTest > testConsecutivelyRunInitTransactions() PASSED

TransactionsTest > testReadCommittedConsumerShouldNotSeeUndecidedData() STARTED

TransactionsTest > testReadCommittedConsumerShouldNotSeeUndecidedData() PASSED

TransactionsTest > testSendOffsetsToTransactionTimeout() STARTED

TransactionsTest > testSendOffsetsToTransactionTimeout() PASSED

TransactionsTest > testFailureToFenceEpoch() STARTED

TransactionsTest > testFailureToFenceEpoch() PASSED

TransactionsTest > testFencingOnSend() STARTED

TransactionsTest > testFencingOnSend() PASSED

TransactionsTest > testFencingOnCommit() STARTED

TransactionsTest > testFencingOnCommit() PASSED

TransactionsTest > testAbortTransactionTimeout() STARTED

TransactionsTest > testAbortTransactionTimeout() PASSED

TransactionsTest > testMultipleMarkersOneLeader() STARTED

TransactionsTest > testMultipleMarkersOneLeader() PASSED

TransactionsTest > testCommitTransactionTimeout() STARTED

TransactionsTest > testCommitTransactionTimeout() PASSED

SaslClientsWithInvalidCredentialsTest > 
testTransactionalProducerWithAuthenticationFailure() STARTED

SaslClientsWithInvalidCredentialsTest > 
testTransactionalProducerWithAuthenticationFailure() PASSED

SaslClientsWithInvalidCredentialsTest > 
testManualAssignmentConsumerWithAuthenticationFailure() STARTED

SaslClientsWithInvalidCredentialsTest > 
testManualAssignmentConsumerWithAuthenticationFailure() PASSED

SaslClientsWithInvalidCredentialsTest > 
testConsumerGroupServiceWithAuthenticationSuccess() STARTED

SaslClientsWithInvalidCredentialsTest > 
testConsumerGroupServiceWithAuthenticationSuccess() PASSED

SaslClientsWithInvalidCredentialsTest > testProducerWithAuthenticationFailure() 
STARTED

SaslClientsWithInvalidCredentialsTest > testProducerWithAuthenticationFailure() 
PASSED

SaslClientsWithInvalidCredentialsTest > 
testConsumerGroupServiceWithAuthenticationFailure() STARTED

SaslClientsWithInvalidCredentialsTest > 
testConsumerGroupServiceWithAuthenticationFailure() PASSED

SaslClientsWithInvalidCredentialsTest > 
testManualAssignmentConsumerWithAutoCommitDisabledWithAuthenticationFailure() 
STARTED

SaslClientsWithInvalidCredentialsTest > 
testManualAssignmentConsumerWithAutoCommitDisabledWithAuthenticationFailure() 
PASSED

SaslClientsWithInvalidCredentialsTest > 
testKafkaAdminClientWithAuthenticationFailure() STARTED

SaslClientsWithInvalidCredentialsTest > 
testKafkaAdminClientWithAuthenticationFailure() PASSED

SaslClientsWithInvalidCredentialsTest > testConsumerWithAuthenticationFailure() 
STARTED

SaslClientsWithInvalidCredentialsTest > testConsumerWithAuthenticationFailure() 
PASSED

UserClientIdQuotaTest > testProducerConsumerOverrideLowerQuota() STARTED

UserClientIdQuotaTest > testProducerConsumerOverrideLowerQuota() PASSED

UserClientIdQuotaTest > testProducerConsumerOverrideUnthrottled() STARTED

UserClientIdQuotaTest > testProducerConsumerOverrideUnthrottled() PASSED

UserClientIdQuotaTest > testThrottledProducerConsumer() STARTED

UserClientIdQuotaTest > testThrottledProducerConsumer() PASSED

UserClientIdQuotaTest > testQuotaOverrideDelete() STARTED

UserClientIdQuotaTest > testQuotaOverrideDelete() PASSED

UserClientIdQuotaTest > testThrottledRequest() STARTED

UserClientIdQuotaTest > testThrottledRequest() PASSED

ZooKeeperClientTest > testZNodeChangeHandlerForDataChange() STARTED

ZooKeeperClientTest > testZNodeChangeHandlerForDataChange() PASSED

ZooKeeperClientTest > testZooKeeperSessionStateMetric() STARTED

ZooKeeperClientTest > testZooKeeperSessionStateMetric() PASSED

ZooKeeperClientTest > testExceptionInBeforeInitializingSession() STARTED

ZooKeeperClientTest > testExceptionInBeforeInitializingSession() PASSED

ZooKeeperClientTest > testGetChildrenExistingZNode() STARTED

ZooKeeperClientTest > testGetChildrenExistingZNode() PASSED

ZooKeeperClientTest > testConnection() STARTED

ZooKeeperClientTest > testConnection() PASSED

ZooKeeperClientTest > testZNodeChangeHandlerForCreation() STARTED

ZooKeeperClientTest > testZNodeChangeHandlerForCreation() PASSED

ZooKeeperClientTest > testGetAclExistingZNode() STARTED

ZooKeeperClientTest > testGetAclExistingZNode() PASSED

ZooKeeperClientTest > testSessionExpiryDuringClose() STARTED

ZooKeeperClientTest > testSessionExpiryDuringClose() PASSED

ZooKeeperClientTest > testReinitializeAfterAuthFailure() STARTED

ZooKeeperClientTest > testReinitializeAfterAuthFailure() PASSED

ZooKeeperClientTest > testSetAclNonExistentZNode() STARTED

ZooKeeperClientTest > testSetAclNonExistentZNode() PASSED

ZooKeeperClientTest > testConnectionLossRequestTermination() STARTED

ZooKeeperClientTest > testConnectionLossRequestTermination()

Re: [DISCUSS] Apache Kafka 2.6.2 release

2021-02-08 Thread Sophie Blee-Goldman

Hey all,

Since all outstanding bugfixes seem to have made their way over to the 2.6
branch by now, I plan to move ahead with cutting an RC. As always, please
let me know if you uncover and critical or blocker bugs that affect 2.6

Thanks!
Sophie

On Thu, Jan 28, 2021 at 9:25 AM John Roesler  wrote:

> Thanks so much for stepping up, Sophie!
>
> I'm +1
>
> -John
>
> On Wed, 2021-01-27 at 17:59 -0500, Bill Bejeck wrote:
> > Thanks for taking this on Sophie. +1
> >
> > Bill
> >
> > On Wed, Jan 27, 2021 at 5:59 PM Ismael Juma  wrote:
> >
> > > Thanks Sophie! +1
> > >
> > > Ismael
> > >
> > > On Wed, Jan 27, 2021 at 2:45 PM Sophie Blee-Goldman <
> sop...@confluent.io>
> > > wrote:
> > >
> > > > Hi all,
> > > >
> > > > I'd like to volunteer as release manager for a 2.6.2 release. This is
> > > being
> > > > accelerated
> > > > to address a critical regression in Kafka Streams for Windows users.
> > > >
> > > > You can find the release plan on the wiki:
> > > > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.6.2
> > > >
> > > > Thanks,
> > > > Sophie
> > > >
> > >
>
>
>

Re: Please help | KIP-500 | KAFKA-9119

2021-02-08 Thread Colin McCabe

Hi Gaurav,

There will be a preview of KIP-500 in Apache Kafka 2.8, like we discussed 
earlier.  Hope this helps.

best,
Colin


On Wed, Jan 27, 2021, at 22:57, gaurav chhabra wrote:
> Hi Team,
> 
> Can you please help on the timelines of the below?
> 
> Is it confirmed for Apache Kafka version 2.8  release.
> 
> In case of any delays when do you anticipate the release.
> 
> Please let me know. It would be really helpful.
> 
> 
> KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
> 
> https://issues.apache.org/jira/browse/KAFKA-9119
> 
> Thanks and Regards
> Gaurav
>

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #461

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Update security doc


--
[...truncated 7.07 MB...]

LogTest > testLastStableOffsetDoesNotExceedLogStartOffsetMidSegment() PASSED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() STARTED

LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() PASSED

LogTest > testCorruptIndexRebuild() STARTED

LogTest > testCorruptIndexRebuild() PASSED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() STARTED

LogTest > shouldDeleteTimeBasedSegmentsReadyToBeDeleted() PASSED

LogTest > testReadWithTooSmallMaxLength() STARTED

LogTest > testReadWithTooSmallMaxLength() PASSED

LogTest > testOverCompactedLogRecovery() STARTED

LogTest > testOverCompactedLogRecovery() PASSED

LogTest > testBogusIndexSegmentsAreRemoved() STARTED

LogTest > testBogusIndexSegmentsAreRemoved() PASSED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() STARTED

LogTest > testLeaderEpochCacheClearedAfterStaticMessageFormatDowngrade() PASSED

LogTest > testCompressedMessages() STARTED

LogTest > testCompressedMessages() PASSED

LogTest > testAppendMessageWithNullPayload() STARTED

LogTest > testAppendMessageWithNullPayload() PASSED

LogTest > testCorruptLog() STARTED

LogTest > testCorruptLog() PASSED

LogTest > testLogRecoversToCorrectOffset() STARTED

LogTest > testLogRecoversToCorrectOffset() PASSED

LogTest > testReopenThenTruncate() STARTED

LogTest > testReopenThenTruncate() PASSED

LogTest > testZombieCoordinatorFenced() STARTED

LogTest > testZombieCoordinatorFenced() PASSED

LogTest > testOldProducerEpoch() STARTED

LogTest > testOldProducerEpoch() PASSED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() STARTED

LogTest > testProducerSnapshotsRecoveryAfterUncleanShutdownV1() PASSED

LogTest > testDegenerateSegmentSplit() STARTED

LogTest > testDegenerateSegmentSplit() PASSED

LogTest > testParseTopicPartitionNameForMissingPartition() STARTED

LogTest > testParseTopicPartitionNameForMissingPartition() PASSED

LogTest > testParseTopicPartitionNameForEmptyName() STARTED

LogTest > testParseTopicPartitionNameForEmptyName() PASSED

LogTest > testOffsetSnapshot() STARTED

LogTest > testOffsetSnapshot() PASSED

LogTest > testOpenDeletesObsoleteFiles() STARTED

LogTest > testOpenDeletesObsoleteFiles() PASSED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() STARTED

LogTest > shouldUpdateOffsetForLeaderEpochsWhenDeletingSegments() PASSED

LogTest > testLogDeleteDirName() STARTED

LogTest > testLogDeleteDirName() PASSED

LogTest > testDeleteOldSegments() STARTED

LogTest > testDeleteOldSegments() PASSED

LogTest > testRebuildTimeIndexForOldMessages() STARTED

LogTest > testRebuildTimeIndexForOldMessages() PASSED

LogTest > testProducerIdMapTruncateTo() STARTED

LogTest > testProducerIdMapTruncateTo() PASSED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
STARTED

LogTest > testTakeSnapshotOnRollAndDeleteSnapshotOnRecoveryPointCheckpoint() 
PASSED

LogTest > testLogEndLessThanStartAfterReopen() STARTED

LogTest > testLogEndLessThanStartAfterReopen() PASSED

LogTest > testLogRecoversForLeaderEpoch() STARTED

LogTest > testLogRecoversForLeaderEpoch() PASSED

LogTest > testRetentionDeletesProducerStateSnapshots() STARTED

LogTest > testRetentionDeletesProducerStateSnapshots() PASSED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() STARTED

LogTest > testLoadingLogDeletesProducerStateSnapshotsPastLogEndOffset() PASSED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() STARTED

LogTest > testWriteLeaderEpochCheckpointAfterDirectoryRename() PASSED

LogTest > testOverCompactedLogRecoveryMultiRecord() STARTED

LogTest > testOverCompactedLogRecoveryMultiRecord() PASSED

LogTest > testSizeBasedLogRoll() STARTED

LogTest > testSizeBasedLogRoll() PASSED

LogTest > testRebuildProducerIdMapWithCompactedData() STARTED

LogTest > testRebuildProducerIdMapWithCompactedData() PASSED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() STARTED

LogTest > shouldNotDeleteSizeBasedSegmentsWhenUnderRetentionSize() PASSED

LogTest > testTransactionIndexUpdatedThroughReplication() STARTED

LogTest > testTransactionIndexUpdatedThroughReplication() PASSED

LogTest > testTimeBasedLogRollJitter() STARTED

LogTest > testTimeBasedLogRollJitter() PASSED

LogTest > testParseTopicPartitionName() STARTED

LogTest > testParseTopicPartitionName() PASSED

LogTest > testEndTxnWithFencedProducerEpoch() STARTED

LogTest > testEndTxnWithFencedProducerEpoch() PASSED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() STARTED

LogTest > testRecoveryOfSegmentWithOffsetOverflow() PASSED

LogTest > testRecoverAfterNonMonotonicCoordinatorEpochWrite() STARTED

LogTest > testRecoverAfterNonMonotonicCoordinatorEpochWrite() PASSED

LogTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #493

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Update security doc


--
[...truncated 3.61 MB...]
KafkaZkClientTest > testDeleteTopicPathMethods() STARTED

KafkaZkClientTest > testDeleteTopicPathMethods() PASSED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() STARTED

KafkaZkClientTest > testSetTopicPartitionStatesRaw() PASSED

KafkaZkClientTest > testAclManagementMethods() STARTED

KafkaZkClientTest > testAclManagementMethods() PASSED

KafkaZkClientTest > testPreferredReplicaElectionMethods() STARTED

KafkaZkClientTest > testPreferredReplicaElectionMethods() PASSED

KafkaZkClientTest > testPropagateLogDir() STARTED

KafkaZkClientTest > testPropagateLogDir() PASSED

KafkaZkClientTest > testGetDataAndStat() STARTED

KafkaZkClientTest > testGetDataAndStat() PASSED

KafkaZkClientTest > testReassignPartitionsInProgress() STARTED

KafkaZkClientTest > testReassignPartitionsInProgress() PASSED

KafkaZkClientTest > testCreateTopLevelPaths() STARTED

KafkaZkClientTest > testCreateTopLevelPaths() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterDoesNotTriggerWatch() PASSED

KafkaZkClientTest > testIsrChangeNotificationGetters() STARTED

KafkaZkClientTest > testIsrChangeNotificationGetters() PASSED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() STARTED

KafkaZkClientTest > testLogDirEventNotificationsDeletion() PASSED

KafkaZkClientTest > testGetLogConfigs() STARTED

KafkaZkClientTest > testGetLogConfigs() PASSED

KafkaZkClientTest > testBrokerSequenceIdMethods() STARTED

KafkaZkClientTest > testBrokerSequenceIdMethods() PASSED

KafkaZkClientTest > testAclMethods() STARTED

KafkaZkClientTest > testAclMethods() PASSED

KafkaZkClientTest > testCreateSequentialPersistentPath() STARTED

KafkaZkClientTest > testCreateSequentialPersistentPath() PASSED

KafkaZkClientTest > testConditionalUpdatePath() STARTED

KafkaZkClientTest > testConditionalUpdatePath() PASSED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() STARTED

KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() PASSED

KafkaZkClientTest > testDeleteTopicZNode() STARTED

KafkaZkClientTest > testDeleteTopicZNode() PASSED

KafkaZkClientTest > testDeletePath() STARTED

KafkaZkClientTest > testDeletePath() PASSED

KafkaZkClientTest > testGetBrokerMethods() STARTED

KafkaZkClientTest > testGetBrokerMethods() PASSED

KafkaZkClientTest > testCreateTokenChangeNotification() STARTED

KafkaZkClientTest > testCreateTokenChangeNotification() PASSED

KafkaZkClientTest > testGetTopicsAndPartitions() STARTED

KafkaZkClientTest > testGetTopicsAndPartitions() PASSED

KafkaZkClientTest > testRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRegisterBrokerInfo() PASSED

KafkaZkClientTest > testRetryRegisterBrokerInfo() STARTED

KafkaZkClientTest > testRetryRegisterBrokerInfo() PASSED

KafkaZkClientTest > testConsumerOffsetPath() STARTED

KafkaZkClientTest > testConsumerOffsetPath() PASSED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() STARTED

KafkaZkClientTest > testDeleteRecursiveWithControllerEpochVersionCheck() PASSED

KafkaZkClientTest > testTopicAssignments() STARTED

KafkaZkClientTest > testTopicAssignments() PASSED

KafkaZkClientTest > testControllerManagementMethods() STARTED

KafkaZkClientTest > testControllerManagementMethods() PASSED

KafkaZkClientTest > testTopicAssignmentMethods() STARTED

KafkaZkClientTest > testTopicAssignmentMethods() PASSED

KafkaZkClientTest > testConnectionViaNettyClient() STARTED

KafkaZkClientTest > testConnectionViaNettyClient() PASSED

KafkaZkClientTest > testPropagateIsrChanges() STARTED

KafkaZkClientTest > testPropagateIsrChanges() PASSED

KafkaZkClientTest > testControllerEpochMethods() STARTED

KafkaZkClientTest > testControllerEpochMethods() PASSED

KafkaZkClientTest > testDeleteRecursive() STARTED

KafkaZkClientTest > testDeleteRecursive() PASSED

KafkaZkClientTest > testGetTopicPartitionStates() STARTED

KafkaZkClientTest > testGetTopicPartitionStates() PASSED

KafkaZkClientTest > testCreateConfigChangeNotification() STARTED

KafkaZkClientTest > testCreateConfigChangeNotification() PASSED

KafkaZkClientTest > testDelegationTokenMethods() STARTED

KafkaZkClientTest > testDelegationTokenMethods() PASSED

LiteralAclStoreTest > shouldHaveCorrectPaths() STARTED

LiteralAclStoreTest > shouldHaveCorrectPaths() PASSED

LiteralAclStoreTest > shouldRoundTripChangeNode() STARTED

LiteralAclStoreTest > shouldRoundTripChangeNode() PASSED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() STARTED

LiteralAclStoreTest > shouldThrowFromEncodeOnNoneLiteral() PASSED

LiteralAclStoreTest > shouldWriteChangesToTheWritePath() STARTED

LiteralAclStoreTest > shouldWriteChangesToTheWritePath() PASSED

LiteralAclStoreTest > shouldHaveCorrectPatternType() STARTED

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #515

2021-02-08 Thread Apache Jenkins Server

See 


Changes:

[github] MINOR: Update security doc


--
[...truncated 3.61 MB...]

AuthorizerIntegrationTest > testConsumeWithoutTopicDescribeAccess() STARTED

AuthorizerIntegrationTest > testConsumeWithoutTopicDescribeAccess() PASSED

AuthorizerIntegrationTest > testClusterId() STARTED

AuthorizerIntegrationTest > testClusterId() PASSED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnEndTransaction()
 STARTED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnEndTransaction()
 PASSED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnSendOffsetsToTxn()
 STARTED

AuthorizerIntegrationTest > 
shouldThrowTransactionalIdAuthorizationExceptionWhenNoTransactionAccessOnSendOffsetsToTxn()
 PASSED

AuthorizerIntegrationTest > testCommitWithNoGroupAccess() STARTED

AuthorizerIntegrationTest > testCommitWithNoGroupAccess() PASSED

AuthorizerIntegrationTest > 
testTransactionalProducerInitTransactionsNoDescribeTransactionalIdAcl() STARTED

AuthorizerIntegrationTest > 
testTransactionalProducerInitTransactionsNoDescribeTransactionalIdAcl() PASSED

AuthorizerIntegrationTest > testAuthorizeByResourceTypeDenyTakesPrecedence() 
STARTED

AuthorizerIntegrationTest > testAuthorizeByResourceTypeDenyTakesPrecedence() 
PASSED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithDescribe() STARTED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithDescribe() PASSED

AuthorizerIntegrationTest > testCreateTopicAuthorizationWithClusterCreate() 
STARTED

AuthorizerIntegrationTest > testCreateTopicAuthorizationWithClusterCreate() 
PASSED

AuthorizerIntegrationTest > testOffsetFetchWithTopicAndGroupRead() STARTED

AuthorizerIntegrationTest > testOffsetFetchWithTopicAndGroupRead() PASSED

AuthorizerIntegrationTest > testCommitWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testCommitWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testAuthorizationWithTopicExisting() STARTED

AuthorizerIntegrationTest > testAuthorizationWithTopicExisting() PASSED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithoutDescribe() 
STARTED

AuthorizerIntegrationTest > testUnauthorizedDeleteRecordsWithoutDescribe() 
PASSED

AuthorizerIntegrationTest > testMetadataWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testMetadataWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testProduceWithTopicDescribe() STARTED

AuthorizerIntegrationTest > testProduceWithTopicDescribe() PASSED

AuthorizerIntegrationTest > testDescribeGroupApiWithNoGroupAcl() STARTED

AuthorizerIntegrationTest > testDescribeGroupApiWithNoGroupAcl() PASSED

AuthorizerIntegrationTest > testPatternSubscriptionMatchingInternalTopic() 
STARTED

AuthorizerIntegrationTest > testPatternSubscriptionMatchingInternalTopic() 
PASSED

AuthorizerIntegrationTest > testSendOffsetsWithNoConsumerGroupDescribeAccess() 
STARTED

AuthorizerIntegrationTest > testSendOffsetsWithNoConsumerGroupDescribeAccess() 
PASSED

AuthorizerIntegrationTest > testOffsetFetchTopicDescribe() STARTED

AuthorizerIntegrationTest > testOffsetFetchTopicDescribe() PASSED

AuthorizerIntegrationTest > testCommitWithTopicAndGroupRead() STARTED

AuthorizerIntegrationTest > testCommitWithTopicAndGroupRead() PASSED

AuthorizerIntegrationTest > 
testIdempotentProducerNoIdempotentWriteAclInInitProducerId() STARTED

AuthorizerIntegrationTest > 
testIdempotentProducerNoIdempotentWriteAclInInitProducerId() PASSED

AuthorizerIntegrationTest > testSimpleConsumeWithExplicitSeekAndNoGroupAccess() 
STARTED

AuthorizerIntegrationTest > testSimpleConsumeWithExplicitSeekAndNoGroupAccess() 
PASSED

SslProducerSendTest > testSendNonCompressedMessageWithCreateTime() STARTED

SslProducerSendTest > testSendNonCompressedMessageWithCreateTime() PASSED

SslProducerSendTest > testClose() STARTED

SslProducerSendTest > testClose() PASSED

SslProducerSendTest > testFlush() STARTED

SslProducerSendTest > testFlush() PASSED

SslProducerSendTest > testSendToPartition() STARTED

SslProducerSendTest > testSendToPartition() PASSED

SslProducerSendTest > testSendOffset() STARTED

SslProducerSendTest > testSendOffset() PASSED

SslProducerSendTest > testSendCompressedMessageWithCreateTime() STARTED

SslProducerSendTest > testSendCompressedMessageWithCreateTime() PASSED

SslProducerSendTest > testCloseWithZeroTimeoutFromCallerThread() STARTED

SslProducerSendTest > testCloseWithZeroTimeoutFromCallerThread() PASSED

SslProducerSendTest > testCloseWithZeroTimeoutFromSenderThread() STARTED

SslProducerSendTest > testCloseWithZeroTimeoutFromSenderThread() PASSED

SslProducerSendTest > testSendBeforeAndAfterPartitionExpansion() STARTED

SslProducerSendTest > testSendBeforeAndAfterPartitionExpansion() PASSED

[jira] [Created] (KAFKA-12312) kafka_2.13:2.6.1 throws NoSuchMethodError when running against scala-sdk-2.13.4

2021-02-08 Thread Tamas Kornai (Jira)

Tamas Kornai created KAFKA-12312:


 Summary: kafka_2.13:2.6.1 throws NoSuchMethodError when running 
against scala-sdk-2.13.4
 Key: KAFKA-12312
 URL: https://issues.apache.org/jira/browse/KAFKA-12312
 Project: Kafka
  Issue Type: Bug
Affects Versions: 2.6.1, 2.6.0
Reporter: Tamas Kornai


The below snippet runs without issues with {{scala-sdk-2.13.3}}, but throws 
{{NoSuchMethodError}} for {{scala-sdk-2.13.4}}: 
{quote}{{val authorize = new AclAuthorizer()
val acls = authorize.acls(AclBindingFilter.ANY)}}
{quote}
The error is: 
{quote}{{Exception in thread "main" java.lang.NoSuchMethodError: 
'scala.collection.immutable.RedBlackTree$Tree 
scala.collection.immutable.TreeMap.scala$collection$immutable$TreeMap$$tree()'
at 
kafka.security.authorizer.AclAuthorizer.acls(AclAuthorizer.scala:293)}}
{quote}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [kafka-site] omkreddy merged pull request #330: MINOR: remove the indent in security doc

2021-02-08 Thread GitBox



omkreddy merged pull request #330:
URL: https://github.com/apache/kafka-site/pull/330


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[jira] [Created] (KAFKA-12311) The decoder in DumpLogSegments can't access properties

2021-02-08 Thread Chia-Ping Tsai (Jira)

Chia-Ping Tsai created KAFKA-12311:
--

 Summary: The decoder in DumpLogSegments can't access properties 
 Key: KAFKA-12311
 URL: https://issues.apache.org/jira/browse/KAFKA-12311
 Project: Kafka
  Issue Type: Bug
Reporter: Chia-Ping Tsai


see 
https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/DumpLogSegments.scala#L420

We always pass empty properties to decoder.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[GitHub] [kafka-site] showuon opened a new pull request #330: MINOR: remove the indent in security doc

2021-02-08 Thread GitBox



showuon opened a new pull request #330:
URL: https://github.com/apache/kafka-site/pull/330


   Fix the kafka-site: this is the same fix as the kafka PR: 
https://github.com/apache/kafka/pull/10002.
   
   @omkreddy , please help review. there's only 233 line changes here instead 
of 234 as the original PR, is because I accidentally remove the intent for a 
line. Fix in another PR: https://github.com/apache/kafka/pull/10081. Thanks.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #519

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #497

[jira] [Created] (KAFKA-12315) Clearing the ZkReplicaStateMachine request batch state upon ControllerMovedException

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #466

[jira] [Resolved] (KAFKA-10834) Remove redundant type casts in Connect

[jira] [Resolved] (KAFKA-10835) Replace Runnable and Callable overrides with lambdas in Connect

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #496

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #465

[jira] [Resolved] (KAFKA-10866) Add fetched metadata to ConsumerRecords

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #518

[jira] [Reopened] (KAFKA-10866) Add fetched metadata to ConsumerRecords

[jira] [Created] (KAFKA-12314) Leverage custom comparator for optimized range scans on RocksDB

[jira] [Created] (KAFKA-12313) Consider deprecating the default.windowed.serde.inner.class configs

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #464

Re: [DISCUSS] Apache Kafka 2.6.2 release

Jenkins build is back to normal : Kafka » kafka-2.8-jdk8 #3

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #463

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #495

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #517

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #494

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #516

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #462

Re: [DISCUSS] Apache Kafka 2.6.2 release

Re: Please help | KIP-500 | KAFKA-9119

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #461

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #493

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #515

[jira] [Created] (KAFKA-12312) kafka_2.13:2.6.1 throws NoSuchMethodError when running against scala-sdk-2.13.4

[GitHub] [kafka-site] omkreddy merged pull request #330: MINOR: remove the indent in security doc

[jira] [Created] (KAFKA-12311) The decoder in DumpLogSegments can't access properties

[GitHub] [kafka-site] showuon opened a new pull request #330: MINOR: remove the indent in security doc

32 matches

Site Navigation

Mail list logo

Footer information