This is an automated email from the ASF dual-hosted git repository.
vvcephei pushed a change to branch kafka-10866-consumerrecords-metadata
in repository https://gitbox.apache.org/repos/asf/kafka.git.
discard 552131c drop beginningOffset from the metadata
discard 7e0d558 Rollback consumer-side metadata caching
discard d4edf3c Consumer changes to cope with cached metadata response
discard c0a02f9 spotbugs
discard d78118e fix test
discard 94b35e9 fix core integration test failures
discard 2b45771 tests
discard ce6b13d KAFKA-10866: Add fetched metadata to ConsumerRecords
omit 612ca95 MINOR: Fix StreamsOptimizedTest
add 0c92b83 KAFKA-12203 Migrate connect:mirror-client module to JUnit 5
(#9889)
add 63f49f9 KAFKA-12189 ShellTest can replace 'assumeTrue' by (junit 5)
conditional test (#9898)
add 738904e KAFKA-12191 SslTransportTls12Tls13Test can replace
'assumeTrue' by (junit 5) conditional test (#9899)
add 144b123 MINOR: Remove incorrect code in metadata module build (#9897)
add c9f3d5e KAFKA-12206: o.a.k.common.Uuid should implement Comparable
(#9896)
add 9361a43 MINOR: remove unused flag 'hasIdempotentRecords' (#9884)
add 3e6c6f5 KAFKA-12198: Migrate connect:json module to JUnit 5 (#9890)
add ba1e16f MINOR: Upstream ApisUtils from kip-500 (#9715)
add b5c1073 KAFKA-12208: Rename AdminManager to ZkAdminManager (#9900)
add 7ac0606 KAFKA-12161; Support raft observers with optional id (#9871)
add 06c9a39 KAFKA-12214: Generated code does not include UUID or struct
fields in its toString output (#9914)
add 8f063c1 MINOR: Generalize server startup to make way for KIP-500
(#9883)
add bfc96ef KAFKA-10674: Controller API version bond with forwardable
APIs (#9600)
add 6f9e73c MINOR: Move a few more methods to AuthHelper (#9913)
add 4126cfd KAFKA-12197: Migrate connect:transforms module to JUnit 5
(#9907)
add e0ebb1d KAFKA-12202 Migrate connect:mirror module to JUnit 5 (#9894)
add 87df3b9 MINOR: Delete unused `jenkins.sh` (#9919)
add 962b69b KAFKA-12200: Migrate connect:file module to JUnit 5 (#9917)
add 462be6d KAFKA-12196: Migrate connect:api module to JUnit 5 (#9909)
add 7bd10ff MINOR: Make data in FetchSnapshotRequest and
FetchSnapshotRespponse private (#9820)
add 5a4bbb9 KAFKA-7341 Migrate core module to JUnit 5 (#9855)
add f2ac0c6 KAFKA-12221 remove PowerMock from connect-json module and
connect-transforms module (#9924)
add 8648643 MINOR: Use Gradle's JUnitPlatform for upgrade-system-tests
modules (#9922)
add 1ca497a MINOR: Upgrade gradle to 6.8 and test retry plugin to 1.2.0
(#9849)
add efff9db KAFKA-10841: Extract conversion from LogReadResult to
FetchPartitionData (#9743)
add 277c437 KAFKA-12194: use stateListener to catch each state change
(#9888)
add 6752f28 KAFKA-12195 Fix synchronization issue happening in
KafkaStreams (#9887)
add 418aaa0 MINOR: Ensure compile and runtime classpaths have consistent
versions (#9921)
add ef5b7b7 MINOR: Exclude junit 3 transitive dependency from jfreechart
(#9928)
add f7c0b0d MINOR: Replace ApiVersion by auto-generated protocol (#9746)
add 302eee6 KAFKA-12204; Implement DescribeCluster API in the broker
(KIP-700) (#9903)
add 130274b KAFKA-10017: fix uncaucht-exception handling in
EosBetaUpgradeIntegrationTest (#9733)
add 4c6f900 KAFKA-12219: Add 'synchronized' keyword to
InMemoryKeyValueStore#[reverseRange, reverseAll] (#9923)
add be88f5a MINOR: Fix StreamsOptimizedTest (#9911)
add add160d KAFKA-9924: Add docs for RocksDB properties-based metrics
(#9895)
add 0158e1d MINOR: Add 'task container' class to KafkaStreams TaskManager
(#9835)
add 918c332 KAFKA-8460: produce records with current timestamp (#9877)
add 38b320a HOTFIX: fix RocksDBMetricsTest (#9935)
add 8c7e551 KAFKA-10866: Add fetched metadata to ConsumerRecords
add d091e9c tests
add 06b2492 fix core integration test failures
add 118ecfb fix test
add 36db117 spotbugs
add 3da66f1 Consumer changes to cope with cached metadata response
add 3b4e86c Rollback consumer-side metadata caching
add 2e46bce drop beginningOffset from the metadata
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (552131c)
\
N -- N -- N refs/heads/kafka-10866-consumerrecords-metadata
(2e46bce)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
build.gradle | 74 ++-
.../java/org/apache/kafka/clients/ApiVersion.java | 56 --
.../org/apache/kafka/clients/NetworkClient.java | 4 +-
.../org/apache/kafka/clients/NodeApiVersions.java | 82 +--
.../kafka/clients/consumer/internals/Fetcher.java | 4 +-
.../producer/internals/TransactionManager.java | 4 +-
.../main/java/org/apache/kafka/common/Uuid.java | 17 +-
.../org/apache/kafka/common/config/ConfigDef.java | 16 +-
.../org/apache/kafka/common/protocol/ApiKeys.java | 3 +-
.../kafka/common/requests/AbstractRequest.java | 2 +
.../kafka/common/requests/AbstractResponse.java | 2 +
.../kafka/common/requests/ApiVersionsRequest.java | 10 +-
.../kafka/common/requests/ApiVersionsResponse.java | 75 ++-
...TxnRequest.java => DescribeClusterRequest.java} | 50 +-
...pResponse.java => DescribeClusterResponse.java} | 47 +-
.../common/requests/FetchSnapshotRequest.java | 14 +-
.../common/requests/FetchSnapshotResponse.java | 17 +-
.../apache/kafka/common/requests/RequestUtils.java | 42 +-
.../authenticator/SaslClientAuthenticator.java | 6 +-
.../common/message/ApiVersionsResponse.json | 2 +-
.../common/message/DescribeClusterRequest.json | 11 +-
...sResponse.json => DescribeClusterResponse.json} | 39 +-
.../apache/kafka/clients/NetworkClientTest.java | 19 +-
.../apache/kafka/clients/NodeApiVersionsTest.java | 35 +-
.../kafka/clients/admin/KafkaAdminClientTest.java | 7 +-
.../kafka/clients/producer/KafkaProducerTest.java | 8 +
.../clients/producer/internals/SenderTest.java | 15 +-
.../producer/internals/TransactionManagerTest.java | 42 +-
.../java/org/apache/kafka/common/UuidTest.java | 16 +
.../apache/kafka/common/message/MessageTest.java | 24 +
.../common/message/SimpleExampleMessageTest.java | 22 +
.../common/network/SslTransportTls12Tls13Test.java | 14 +-
.../common/requests/ApiVersionsResponseTest.java | 84 ++-
.../kafka/common/requests/ProduceRequestTest.java | 6 +-
.../kafka/common/requests/RequestContextTest.java | 4 +-
.../kafka/common/requests/RequestResponseTest.java | 44 +-
.../kafka/common/requests/RequestTestUtils.java | 4 +
.../authenticator/SaslAuthenticatorTest.java | 24 +-
.../org/apache/kafka/common/utils/ShellTest.java | 18 +-
.../connector/ConnectorReconfigurationTest.java | 6 +-
.../kafka/connect/connector/ConnectorTest.java | 6 +-
.../kafka/connect/data/ConnectSchemaTest.java | 13 +-
.../org/apache/kafka/connect/data/DateTest.java | 6 +-
.../org/apache/kafka/connect/data/DecimalTest.java | 6 +-
.../org/apache/kafka/connect/data/FieldTest.java | 6 +-
.../kafka/connect/data/SchemaBuilderTest.java | 8 +-
.../kafka/connect/data/SchemaProjectorTest.java | 143 ++--
.../org/apache/kafka/connect/data/StructTest.java | 10 +-
.../org/apache/kafka/connect/data/TimeTest.java | 6 +-
.../apache/kafka/connect/data/TimestampTest.java | 6 +-
.../org/apache/kafka/connect/data/ValuesTest.java | 20 +-
.../kafka/connect/header/ConnectHeaderTest.java | 14 +-
.../kafka/connect/header/ConnectHeadersTest.java | 24 +-
.../kafka/connect/sink/SinkConnectorTest.java | 6 +-
.../apache/kafka/connect/sink/SinkRecordTest.java | 20 +-
.../kafka/connect/source/SourceConnectorTest.java | 6 +-
.../kafka/connect/source/SourceRecordTest.java | 20 +-
.../kafka/connect/storage/ConverterTypeTest.java | 4 +-
.../connect/storage/SimpleHeaderConverterTest.java | 14 +-
.../kafka/connect/storage/StringConverterTest.java | 6 +-
.../kafka/connect/util/ConnectorUtilsTest.java | 6 +-
.../connect/file/FileStreamSinkConnectorTest.java | 14 +-
.../kafka/connect/file/FileStreamSinkTaskTest.java | 22 +-
.../file/FileStreamSourceConnectorTest.java | 16 +-
.../connect/file/FileStreamSourceTaskTest.java | 14 +-
.../apache/kafka/connect/json/JsonConverter.java | 10 +
.../connect/json/JsonConverterConfigTest.java | 9 +-
.../kafka/connect/json/JsonConverterTest.java | 67 +-
.../kafka/connect/mirror/MirrorClientTest.java | 8 +-
.../kafka/connect/mirror/CheckpointTest.java | 4 +-
.../apache/kafka/connect/mirror/HeartbeatTest.java | 4 +-
.../mirror/MirrorCheckpointConnectorTest.java | 4 +-
.../connect/mirror/MirrorCheckpointTaskTest.java | 4 +-
.../connect/mirror/MirrorConnectorConfigTest.java | 16 +-
.../mirror/MirrorHeartBeatConnectorTest.java | 4 +-
.../connect/mirror/MirrorMakerConfigTest.java | 165 +++--
.../connect/mirror/MirrorSourceConnectorTest.java | 55 +-
.../kafka/connect/mirror/MirrorSourceTaskTest.java | 38 +-
.../kafka/connect/mirror/OffsetSyncStoreTest.java | 4 +-
.../kafka/connect/mirror/OffsetSyncTest.java | 4 +-
.../MirrorConnectorsIntegrationBaseTest.java | 129 ++--
.../MirrorConnectorsIntegrationSSLTest.java | 9 +-
.../MirrorConnectorsIntegrationTest.java | 5 +-
.../util/clusters/EmbeddedConnectCluster.java | 4 +-
.../util/clusters/EmbeddedKafkaCluster.java | 23 +-
.../apache/kafka/connect/transforms/CastTest.java | 14 +-
.../kafka/connect/transforms/ExtractFieldTest.java | 12 +-
.../kafka/connect/transforms/FlattenTest.java | 18 +-
.../kafka/connect/transforms/HoistFieldTest.java | 10 +-
.../kafka/connect/transforms/InsertFieldTest.java | 14 +-
.../kafka/connect/transforms/MaskFieldTest.java | 50 +-
.../kafka/connect/transforms/RegexRouterTest.java | 4 +-
.../kafka/connect/transforms/ReplaceFieldTest.java | 10 +-
.../connect/transforms/SetSchemaMetadataTest.java | 12 +-
.../connect/transforms/TimestampConverterTest.java | 12 +-
.../connect/transforms/TimestampRouterTest.java | 8 +-
.../kafka/connect/transforms/ValueToKeyTest.java | 12 +-
.../transforms/predicates/HasHeaderKeyTest.java | 24 +-
.../predicates/TopicNameMatchesTest.java | 20 +-
.../transforms/util/NonEmptyListValidatorTest.java | 5 +-
core/src/main/scala/kafka/Kafka.scala | 44 +-
.../kafka/admin/BrokerApiVersionsCommand.scala | 4 +-
core/src/main/scala/kafka/api/ApiVersion.scala | 44 +-
core/src/main/scala/kafka/log/LogConfig.scala | 37 +-
core/src/main/scala/kafka/log/LogManager.scala | 2 +-
.../scala/kafka/metrics/KafkaMetricsReporter.scala | 4 +-
.../scala/kafka/network/RequestConvertToJson.scala | 2 +
core/src/main/scala/kafka/raft/RaftManager.scala | 23 +-
core/src/main/scala/kafka/server/AuthHelper.scala | 133 ++++
.../src/main/scala/kafka/server/BrokerServer.scala | 14 +-
.../server/BrokerToControllerChannelManager.scala | 60 +-
.../main/scala/kafka/server/ControllerServer.scala | 14 +-
.../kafka/server/DelayedCreatePartitions.scala | 2 +-
.../scala/kafka/server/DelayedDeleteTopics.scala | 2 +-
.../src/main/scala/kafka/server/DelayedFetch.scala | 11 +-
.../scala/kafka/server/DynamicBrokerConfig.scala | 2 +-
.../scala/kafka/server/ForwardingManager.scala | 49 +-
core/src/main/scala/kafka/server/KafkaApis.scala | 717 ++++++++-------------
core/src/main/scala/kafka/server/KafkaConfig.scala | 21 +
.../main/scala/kafka/server/KafkaRaftServer.scala | 103 +++
core/src/main/scala/kafka/server/KafkaServer.scala | 97 +--
.../scala/kafka/server/KafkaServerStartable.scala | 75 ---
.../main/scala/kafka/server/ReplicaManager.scala | 22 +-
.../scala/kafka/server/RequestHandlerHelper.scala | 195 ++++++
core/src/main/scala/kafka/server/Server.scala | 73 +++
.../{AdminManager.scala => ZkAdminManager.scala} | 6 +-
.../main/scala/kafka/tools/TestRaftServer.scala | 3 +-
core/src/main/scala/kafka/utils/CoreUtils.scala | 3 +-
.../scala/kafka/utils/VerifiableProperties.scala | 8 +
.../kafka/admin/BrokerApiVersionsCommandTest.scala | 26 +-
.../admin/ReassignPartitionsIntegrationTest.scala | 39 +-
.../kafka/api/AbstractConsumerTest.scala | 16 +-
.../AdminClientWithPoliciesIntegrationTest.scala | 26 +-
.../kafka/api/AuthorizerIntegrationTest.scala | 87 ++-
.../kafka/api/BaseAdminIntegrationTest.scala | 16 +-
.../integration/kafka/api/BaseConsumerTest.scala | 9 +-
.../kafka/api/BaseProducerSendTest.scala | 65 +-
.../integration/kafka/api/BaseQuotaTest.scala | 45 +-
.../integration/kafka/api/ClientIdQuotaTest.scala | 4 +-
.../integration/kafka/api/ConsumerBounceTest.scala | 38 +-
.../kafka/api/ConsumerTopicCreationTest.scala | 118 ++--
.../kafka/api/CustomQuotaCallbackTest.scala | 12 +-
.../DelegationTokenEndToEndAuthorizationTest.scala | 7 +-
.../api/DescribeAuthorizedOperationsTest.scala | 8 +-
.../kafka/api/EndToEndAuthorizationTest.scala | 58 +-
.../kafka/api/EndToEndClusterIdTest.scala | 7 +-
.../kafka/api/GroupAuthorizerIntegrationTest.scala | 7 +-
.../api/GroupCoordinatorIntegrationTest.scala | 6 +-
.../kafka/api/IntegrationTestHarness.scala | 6 +-
.../integration/kafka/api/LogAppendTimeTest.scala | 7 +-
.../scala/integration/kafka/api/MetricsTest.scala | 38 +-
.../kafka/api/PlaintextAdminIntegrationTest.scala | 260 +++-----
.../kafka/api/PlaintextConsumerTest.scala | 154 +++--
.../api/PlaintextEndToEndAuthorizationTest.scala | 6 +-
.../kafka/api/PlaintextProducerSendTest.scala | 8 +-
.../kafka/api/ProducerCompressionTest.scala | 47 +-
.../kafka/api/ProducerFailureHandlingTest.scala | 61 +-
.../kafka/api/RackAwareAutoTopicCreationTest.scala | 6 +-
.../SaslClientsWithInvalidCredentialsTest.scala | 29 +-
.../kafka/api/SaslEndToEndAuthorizationTest.scala | 9 +-
.../kafka/api/SaslMultiMechanismConsumerTest.scala | 30 +-
.../kafka/api/SaslPlainPlaintextConsumerTest.scala | 6 +-
.../SaslPlainSslEndToEndAuthorizationTest.scala | 2 +-
.../kafka/api/SaslPlaintextConsumerTest.scala | 6 +-
.../SaslScramSslEndToEndAuthorizationTest.scala | 4 +-
.../kafka/api/SaslSslAdminIntegrationTest.scala | 25 +-
.../kafka/api/SaslSslConsumerTest.scala | 6 +-
.../kafka/api/SslAdminIntegrationTest.scala | 20 +-
.../kafka/api/SslEndToEndAuthorizationTest.scala | 4 +-
.../kafka/api/TransactionsBounceTest.scala | 8 +-
.../kafka/api/TransactionsExpirationTest.scala | 6 +-
.../integration/kafka/api/TransactionsTest.scala | 34 +-
.../api/TransactionsWithMaxInFlightOneTest.scala | 8 +-
.../kafka/api/UserClientIdQuotaTest.scala | 4 +-
.../integration/kafka/api/UserQuotaTest.scala | 6 +-
.../kafka/network/DynamicConnectionQuotaTest.scala | 12 +-
.../kafka/server/DelayedFetchTest.scala | 4 +-
.../server/DynamicBrokerReconfigurationTest.scala | 120 ++--
.../kafka/server/GssapiAuthenticationTest.scala | 25 +-
...ListenersWithSameSecurityProtocolBaseTest.scala | 14 +-
.../kafka/server/ScramServerStartupTest.scala | 6 +-
.../kafka/tools/MirrorMakerIntegrationTest.scala | 14 +-
.../kafka/common/InterBrokerSendThreadTest.scala | 13 +-
.../metrics/LinuxIoMetricsCollectorTest.scala | 9 +-
.../scala/kafka/security/auth/ResourceTest.scala | 4 +-
.../scala/kafka/security/minikdc/MiniKdcTest.scala | 6 +-
.../server/BrokerMetadataCheckpointTest.scala | 4 +-
.../BrokerToControllerRequestThreadTest.scala | 18 +-
.../scala/kafka/tools/CustomDeserializerTest.scala | 9 +-
.../kafka/tools/DefaultMessageFormatterTest.scala | 61 +-
.../kafka/tools/ReplicaVerificationToolTest.scala | 8 +-
core/src/test/scala/kafka/utils/ExitTest.scala | 4 +-
core/src/test/scala/kafka/utils/LoggingTest.scala | 6 +-
.../test/scala/kafka/utils/ToolsUtilsTest.scala | 4 +-
.../test/scala/kafka/zk/ExtendedAclStoreTest.scala | 4 +-
.../src/test/scala/kafka/zk/FeatureZNodeTest.scala | 39 +-
.../test/scala/kafka/zk/LiteralAclStoreTest.scala | 4 +-
.../test/scala/unit/kafka/KafkaConfigTest.scala | 8 +-
.../scala/unit/kafka/admin/AclCommandTest.scala | 22 +-
.../scala/unit/kafka/admin/AddPartitionsTest.scala | 33 +-
.../unit/kafka/admin/AdminRackAwareTest.scala | 4 +-
.../scala/unit/kafka/admin/ConfigCommandTest.scala | 70 +-
.../kafka/admin/ConsumerGroupCommandTest.scala | 6 +-
.../kafka/admin/DelegationTokenCommandTest.scala | 8 +-
.../kafka/admin/DeleteConsumerGroupsTest.scala | 48 +-
...ffsetsConsumerGroupCommandIntegrationTest.scala | 4 +-
.../scala/unit/kafka/admin/DeleteTopicTest.scala | 56 +-
.../kafka/admin/DescribeConsumerGroupTest.scala | 82 +--
.../unit/kafka/admin/FeatureCommandTest.scala | 4 +-
.../kafka/admin/LeaderElectionCommandTest.scala | 142 ++--
.../unit/kafka/admin/ListConsumerGroupTest.scala | 4 +-
...PreferredReplicaLeaderElectionCommandTest.scala | 27 +-
.../scala/unit/kafka/admin/RackAwareTest.scala | 15 +-
.../admin/ReassignPartitionsCommandArgsTest.scala | 21 +-
.../kafka/admin/ReassignPartitionsUnitTest.scala | 95 ++-
.../kafka/admin/ResetConsumerGroupOffsetTest.scala | 4 +-
.../scala/unit/kafka/admin/TopicCommandTest.scala | 4 +-
.../admin/TopicCommandWithAdminClientTest.scala | 34 +-
.../kafka/admin/TopicCommandWithZKClientTest.scala | 47 +-
.../admin/UserScramCredentialsCommandTest.scala | 10 +-
.../test/scala/unit/kafka/api/ApiUtilsTest.scala | 20 +-
.../test/scala/unit/kafka/api/ApiVersionTest.scala | 16 +-
.../unit/kafka/cluster/AbstractPartitionTest.scala | 6 +-
.../unit/kafka/cluster/AssignmentStateTest.scala | 61 +-
.../unit/kafka/cluster/BrokerEndPointTest.scala | 4 +-
.../unit/kafka/cluster/PartitionLockTest.scala | 18 +-
.../scala/unit/kafka/cluster/PartitionTest.scala | 155 ++---
.../scala/unit/kafka/cluster/ReplicaTest.scala | 8 +-
.../ZkNodeChangeNotificationListenerTest.scala | 6 +-
.../controller/ControllerChannelManagerTest.scala | 18 +-
.../kafka/controller/ControllerContextTest.scala | 10 +-
.../controller/ControllerEventManagerTest.scala | 8 +-
.../kafka/controller/ControllerFailoverTest.scala | 10 +-
.../controller/ControllerIntegrationTest.scala | 24 +-
.../PartitionLeaderElectionAlgorithmsTest.scala | 6 +-
.../controller/PartitionStateMachineTest.scala | 21 +-
.../kafka/controller/ReplicaStateMachineTest.scala | 6 +-
.../controller/TopicDeletionManagerTest.scala | 4 +-
.../AbstractCoordinatorConcurrencyTest.scala | 6 +-
.../group/GroupCoordinatorConcurrencyTest.scala | 8 +-
.../coordinator/group/GroupCoordinatorTest.scala | 16 +-
.../group/GroupMetadataManagerTest.scala | 18 +-
.../coordinator/group/GroupMetadataTest.scala | 13 +-
.../coordinator/group/MemberMetadataTest.scala | 4 +-
.../transaction/ProducerIdManagerTest.scala | 6 +-
.../TransactionCoordinatorConcurrencyTest.scala | 14 +-
.../transaction/TransactionCoordinatorTest.scala | 4 +-
.../transaction/TransactionLogTest.scala | 4 +-
.../TransactionMarkerChannelManagerTest.scala | 8 +-
...sactionMarkerRequestCompletionHandlerTest.scala | 22 +-
.../transaction/TransactionMetadataTest.scala | 4 +-
.../transaction/TransactionStateManagerTest.scala | 10 +-
.../kafka/integration/KafkaServerTestHarness.scala | 6 +-
.../MetricsDuringTopicCreationDeletionTest.scala | 4 +-
.../unit/kafka/integration/MinIsrConfigTest.scala | 2 +-
.../integration/UncleanLeaderElectionTest.scala | 30 +-
.../log/AbstractLogCleanerIntegrationTest.scala | 12 +-
.../unit/kafka/log/BrokerCompressionTest.scala | 35 +-
.../unit/kafka/log/LogCleanerIntegrationTest.scala | 27 +-
.../kafka/log/LogCleanerLagIntegrationTest.scala | 38 +-
.../unit/kafka/log/LogCleanerManagerTest.scala | 50 +-
.../LogCleanerParameterizedIntegrationTest.scala | 89 ++-
.../test/scala/unit/kafka/log/LogCleanerTest.scala | 106 +--
.../scala/unit/kafka/log/LogConcurrencyTest.scala | 16 +-
.../test/scala/unit/kafka/log/LogConfigTest.scala | 20 +-
.../test/scala/unit/kafka/log/LogManagerTest.scala | 72 +--
.../test/scala/unit/kafka/log/LogSegmentTest.scala | 24 +-
core/src/test/scala/unit/kafka/log/LogTest.scala | 555 +++++++---------
.../scala/unit/kafka/log/LogValidatorTest.scala | 108 ++--
.../scala/unit/kafka/log/OffsetIndexTest.scala | 54 +-
.../test/scala/unit/kafka/log/OffsetMapTest.scala | 4 +-
.../unit/kafka/log/ProducerStateManagerTest.scala | 29 +-
.../test/scala/unit/kafka/log/TimeIndexTest.scala | 8 +-
.../unit/kafka/log/TransactionIndexTest.scala | 8 +-
.../scala/unit/kafka/metrics/KafkaTimerTest.scala | 4 +-
.../scala/unit/kafka/metrics/MetricsTest.scala | 19 +-
.../unit/kafka/network/ConnectionQuotasTest.scala | 178 ++---
.../unit/kafka/network/RequestChannelTest.scala | 8 +-
.../kafka/network/RequestConvertToJsonTest.scala | 8 +-
.../unit/kafka/network/SocketServerTest.scala | 53 +-
.../unit/kafka/raft/KafkaNetworkChannelTest.scala | 13 +-
.../scala/unit/kafka/raft/RaftManagerTest.scala | 2 +-
.../unit/kafka/security/auth/OperationTest.scala | 4 +-
.../kafka/security/auth/PermissionTypeTest.scala | 11 +-
.../kafka/security/auth/ResourceTypeTest.scala | 12 +-
.../security/auth/SimpleAclAuthorizerTest.scala | 88 +--
.../kafka/security/auth/ZkAuthorizationTest.scala | 35 +-
.../security/authorizer/AclAuthorizerTest.scala | 102 ++-
.../authorizer/AclAuthorizerWithZkSaslTest.scala | 8 +-
.../kafka/security/authorizer/AclEntryTest.scala | 7 +-
.../AuthorizerInterfaceDefaultTest.scala | 6 +-
.../authorizer/AuthorizerWrapperTest.scala | 30 +-
.../security/authorizer/BaseAuthorizerTest.scala | 172 ++---
.../delegation/DelegationTokenManagerTest.scala | 8 +-
.../server/AbstractApiVersionsRequestTest.scala | 37 +-
.../server/AbstractCreateTopicsRequestTest.scala | 31 +-
.../kafka/server/AbstractFetcherManagerTest.scala | 6 +-
.../kafka/server/AbstractFetcherThreadTest.scala | 10 +-
.../AddPartitionsToTxnRequestServerTest.scala | 6 +-
.../unit/kafka/server/AdvertiseBrokerTest.scala | 6 +-
.../unit/kafka/server/AlterIsrManagerTest.scala | 8 +-
.../server/AlterReplicaLogDirsRequestTest.scala | 4 +-
...rScramCredentialsRequestNotAuthorizedTest.scala | 79 +++
.../AlterUserScramCredentialsRequestTest.scala | 78 +--
.../unit/kafka/server/ApiVersionsRequestTest.scala | 25 +-
.../scala/unit/kafka/server/AuthHelperTest.scala | 142 ++++
.../kafka/server/BaseClientQuotaManagerTest.scala | 4 +-
.../kafka/server/BrokerEpochIntegrationTest.scala | 10 +-
.../unit/kafka/server/BrokerFeaturesTest.scala | 4 +-
.../unit/kafka/server/ClientQuotaManagerTest.scala | 52 +-
.../kafka/server/ClientQuotasRequestTest.scala | 12 +-
.../server/ClientRequestQuotaManagerTest.scala | 14 +-
.../ControllerMutationQuotaManagerTest.scala | 17 +-
.../kafka/server/ControllerMutationQuotaTest.scala | 16 +-
.../kafka/server/CreateTopicsRequestTest.scala | 4 +-
.../CreateTopicsRequestWithForwardingTest.scala | 4 +-
.../server/CreateTopicsRequestWithPolicyTest.scala | 2 +-
.../unit/kafka/server/DelayedOperationTest.scala | 84 +--
.../DelegationTokenRequestsOnPlainTextTest.scala | 8 +-
.../kafka/server/DelegationTokenRequestsTest.scala | 10 +-
...nTokenRequestsWithDisableTokenFeatureTest.scala | 17 +-
.../kafka/server/DeleteTopicsRequestTest.scala | 12 +-
...leteTopicsRequestWithDeletionDisabledTest.scala | 4 +-
.../kafka/server/DescribeClusterRequestTest.scala | 92 +++
.../kafka/server/DescribeLogDirsRequestTest.scala | 6 +-
...rScramCredentialsRequestNotAuthorizedTest.scala | 51 ++
.../DescribeUserScramCredentialsRequestTest.scala | 49 +-
.../kafka/server/DynamicBrokerConfigTest.scala | 40 +-
.../kafka/server/DynamicConfigChangeTest.scala | 75 +--
.../unit/kafka/server/DynamicConfigTest.scala | 4 +-
.../unit/kafka/server/EdgeCaseRequestTest.scala | 14 +-
.../FetchRequestDownConversionConfigTest.scala | 7 +-
.../kafka/server/FetchRequestMaxBytesTest.scala | 14 +-
.../scala/unit/kafka/server/FetchRequestTest.scala | 22 +-
.../scala/unit/kafka/server/FetchSessionTest.scala | 25 +-
.../kafka/server/FinalizedFeatureCacheTest.scala | 12 +-
.../FinalizedFeatureChangeListenerTest.scala | 12 +-
.../unit/kafka/server/ForwardingManagerTest.scala | 52 +-
.../server/HighwatermarkPersistenceTest.scala | 6 +-
.../unit/kafka/server/IsrExpirationTest.scala | 34 +-
.../scala/unit/kafka/server/KafkaApisTest.scala | 230 ++++---
.../scala/unit/kafka/server/KafkaConfigTest.scala | 12 +-
.../server/KafkaMetricReporterClusterIdTest.scala | 12 +-
.../KafkaMetricReporterExceptionHandlingTest.scala | 9 +-
.../kafka/server/KafkaMetricsReporterTest.scala | 14 +-
.../scala/unit/kafka/server/KafkaServerTest.scala | 7 +-
.../unit/kafka/server/LeaderElectionTest.scala | 26 +-
.../unit/kafka/server/ListOffsetsRequestTest.scala | 4 +-
.../unit/kafka/server/LogDirFailureTest.scala | 23 +-
.../scala/unit/kafka/server/LogOffsetTest.scala | 4 +-
.../scala/unit/kafka/server/LogRecoveryTest.scala | 20 +-
.../unit/kafka/server/MetadataCacheTest.scala | 6 +-
.../unit/kafka/server/MetadataRequestTest.scala | 57 +-
.../server/OffsetsForLeaderEpochRequestTest.scala | 4 +-
.../unit/kafka/server/ProduceRequestTest.scala | 4 +-
.../server/ReplicaAlterLogDirsThreadTest.scala | 23 +-
.../scala/unit/kafka/server/ReplicaFetchTest.scala | 6 +-
.../kafka/server/ReplicaFetcherThreadTest.scala | 80 ++-
.../kafka/server/ReplicaManagerQuotasTest.scala | 42 +-
.../unit/kafka/server/ReplicaManagerTest.scala | 26 +-
.../kafka/server/ReplicationQuotaManagerTest.scala | 6 +-
.../unit/kafka/server/ReplicationQuotasTest.scala | 24 +-
.../scala/unit/kafka/server/RequestQuotaTest.scala | 51 +-
.../kafka/server/SaslApiVersionsRequestTest.scala | 8 +-
.../kafka/server/ServerGenerateBrokerIdTest.scala | 8 +-
.../kafka/server/ServerGenerateClusterIdTest.scala | 8 +-
.../unit/kafka/server/ServerMetricsTest.scala | 14 +-
.../unit/kafka/server/ServerShutdownTest.scala | 8 +-
.../unit/kafka/server/ServerStartupTest.scala | 21 +-
.../unit/kafka/server/StopReplicaRequestTest.scala | 4 +-
.../server/ThrottledChannelExpirationTest.scala | 27 +-
.../unit/kafka/server/UpdateFeaturesTest.scala | 10 +-
...nManagerTest.scala => ZkAdminManagerTest.scala} | 26 +-
.../LeaderEpochCheckpointFileTest.scala | 4 +-
.../checkpoints/OffsetCheckpointFileTest.scala | 7 +-
...chDrivenReplicationProtocolAcceptanceTest.scala | 18 +-
.../server/epoch/LeaderEpochFileCacheTest.scala | 12 +-
.../server/epoch/LeaderEpochIntegrationTest.scala | 6 +-
.../server/epoch/OffsetsForLeaderEpochTest.scala | 8 +-
.../unit/kafka/tools/ConsoleConsumerTest.scala | 35 +-
.../unit/kafka/tools/ConsoleProducerTest.scala | 4 +-
.../unit/kafka/tools/ConsumerPerformanceTest.scala | 4 +-
.../unit/kafka/tools/DumpLogSegmentsTest.scala | 18 +-
.../scala/unit/kafka/tools/MirrorMakerTest.scala | 4 +-
.../unit/kafka/utils/CommandLineUtilsTest.scala | 20 +-
.../scala/unit/kafka/utils/CoreUtilsTest.scala | 12 +-
.../src/test/scala/unit/kafka/utils/JsonTest.scala | 4 +-
.../unit/kafka/utils/PasswordEncoderTest.scala | 10 +-
.../src/test/scala/unit/kafka/utils/PoolTest.scala | 4 +-
.../scala/unit/kafka/utils/QuotaUtilsTest.scala | 11 +-
.../unit/kafka/utils/ReplicationUtilsTest.scala | 6 +-
.../scala/unit/kafka/utils/SchedulerTest.scala | 44 +-
.../unit/kafka/utils/ShutdownableThreadTest.scala | 8 +-
.../test/scala/unit/kafka/utils/TestUtils.scala | 88 +--
.../scala/unit/kafka/utils/ThrottlerTest.scala | 5 +-
.../scala/unit/kafka/utils/TopicFilterTest.scala | 4 +-
.../unit/kafka/utils/json/JsonValueTest.scala | 4 +-
.../unit/kafka/utils/timer/TimerTaskListTest.scala | 4 +-
.../scala/unit/kafka/utils/timer/TimerTest.scala | 14 +-
.../scala/unit/kafka/zk/AdminZkClientTest.scala | 46 +-
.../scala/unit/kafka/zk/KafkaZkClientTest.scala | 123 ++--
.../kafka/zk/ReassignPartitionsZNodeTest.scala | 4 +-
.../scala/unit/kafka/zk/ZooKeeperTestHarness.scala | 24 +-
.../unit/kafka/zookeeper/ZooKeeperClientTest.scala | 167 +++--
docs/ops.html | 147 ++++-
.../apache/kafka/message/MessageDataGenerator.java | 5 +-
gradle/dependencies.gradle | 4 +-
gradle/spotbugs-exclude.xml | 7 +
gradle/wrapper/gradle-wrapper.properties | 2 +-
gradlew | 4 +-
jenkins.sh | 77 ---
.../jmh/metadata/MetadataRequestBenchmark.java | 4 +-
.../org/apache/kafka/raft/KafkaRaftClient.java | 40 +-
.../java/org/apache/kafka/raft/QuorumState.java | 52 +-
.../kafka/raft/internals/KafkaRaftMetrics.java | 2 +-
.../kafka/raft/KafkaRaftClientSnapshotTest.java | 6 +-
.../org/apache/kafka/raft/KafkaRaftClientTest.java | 160 +++--
.../org/apache/kafka/raft/QuorumStateTest.java | 41 ++
.../apache/kafka/raft/RaftClientTestContext.java | 26 +-
.../apache/kafka/raft/RaftEventSimulationTest.java | 2 +-
.../kafka/raft/internals/KafkaRaftMetricsTest.java | 3 +-
.../org/apache/kafka/streams/KafkaStreams.java | 88 ++-
.../processor/internals/ActiveTaskCreator.java | 2 +
.../processor/internals/StandbyTaskCreator.java | 2 +
.../streams/processor/internals/StreamThread.java | 1 +
.../streams/processor/internals/TaskManager.java | 197 +++---
.../kafka/streams/processor/internals/Tasks.java | 295 +++++++++
.../state/internals/InMemoryKeyValueStore.java | 4 +-
.../state/internals/metrics/RocksDBMetrics.java | 6 +-
.../integration/AdjustStreamThreadCountTest.java | 128 +++-
.../integration/EosBetaUpgradeIntegrationTest.java | 58 +-
.../processor/internals/StreamThreadTest.java | 2 +
.../processor/internals/TaskManagerTest.java | 40 +-
.../internals/metrics/RocksDBMetricsTest.java | 6 +-
wrapper.gradle | 2 +-
435 files changed, 7037 insertions(+), 6222 deletions(-)
delete mode 100644
clients/src/main/java/org/apache/kafka/clients/ApiVersion.java
copy
clients/src/main/java/org/apache/kafka/common/requests/{AddOffsetsToTxnRequest.java
=> DescribeClusterRequest.java} (53%)
copy
clients/src/main/java/org/apache/kafka/common/requests/{SyncGroupResponse.java
=> DescribeClusterResponse.java} (60%)
copy metadata/src/main/resources/common/metadata/RemoveTopicRecord.json =>
clients/src/main/resources/common/message/DescribeClusterRequest.json (76%)
copy
clients/src/main/resources/common/message/{ListPartitionReassignmentsResponse.json
=> DescribeClusterResponse.json} (52%)
create mode 100644 core/src/main/scala/kafka/server/AuthHelper.scala
copy
clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestFutureListener.java
=> core/src/main/scala/kafka/server/BrokerServer.scala (75%)
copy
clients/src/main/java/org/apache/kafka/clients/consumer/internals/RequestFutureListener.java
=> core/src/main/scala/kafka/server/ControllerServer.scala (74%)
create mode 100644 core/src/main/scala/kafka/server/KafkaRaftServer.scala
delete mode 100644 core/src/main/scala/kafka/server/KafkaServerStartable.scala
create mode 100644 core/src/main/scala/kafka/server/RequestHandlerHelper.scala
create mode 100644 core/src/main/scala/kafka/server/Server.scala
rename core/src/main/scala/kafka/server/{AdminManager.scala =>
ZkAdminManager.scala} (99%)
create mode 100644
core/src/test/scala/unit/kafka/server/AlterUserScramCredentialsRequestNotAuthorizedTest.scala
create mode 100644 core/src/test/scala/unit/kafka/server/AuthHelperTest.scala
create mode 100644
core/src/test/scala/unit/kafka/server/DescribeClusterRequestTest.scala
create mode 100644
core/src/test/scala/unit/kafka/server/DescribeUserScramCredentialsRequestNotAuthorizedTest.scala
rename core/src/test/scala/unit/kafka/server/{AdminManagerTest.scala =>
ZkAdminManagerTest.scala} (85%)
delete mode 100755 jenkins.sh
create mode 100644
streams/src/main/java/org/apache/kafka/streams/processor/internals/Tasks.java
