This is an automated email from the ASF dual-hosted git repository.
vvcephei pushed a change to branch kafka-10866-consumerrecords-metadata
in repository https://gitbox.apache.org/repos/asf/kafka.git.
omit 1cc0bb7 CR feedback
omit 2e46bce drop beginningOffset from the metadata
omit 3b4e86c Rollback consumer-side metadata caching
omit 3da66f1 Consumer changes to cope with cached metadata response
omit 36db117 spotbugs
omit 118ecfb fix test
omit 06b2492 fix core integration test failures
omit d091e9c tests
omit 8c7e551 KAFKA-10866: Add fetched metadata to ConsumerRecords
add 287b600 KAFKA-12210; AdminClient should use DescribeCluster API when
available (KIP-700) (#9905)
add 462c89e KAFKA-12211: don't change perm for base/state dir when no
persistent store (#9904)
add 86b9fde KAFKA-10869: Gate topic IDs behind IBP 2.8 (KIP-516) (#9814)
add 484c99e KAFKA-12175 Migrate generator module to junit5 (#9926)
add 62860fa MINOR: Remind user index file is empty when dumping
LogSegment index file (#9891)
add eb026fc KAFKA-12152; Idempotent Producer does not reset the sequence
number of partitions without in-flight batches (#9832)
add 24e7e81 MINOR: Refactor DescribeAuthorizedOperationsTest (#9938)
add 92e72f7 KAFKA-12185: fix ConcurrentModificationException in newly
added Tasks container class (#9940)
add 976e6ea MINOR: Tweak IBM i support in "stop" scripts (#9810)
add fea2f65 MINOR: Import RaftConfig config definitions into KafkaConfig
(#9916)
add 5ce8141 KAFKA-10866: Add fetched metadata to ConsumerRecords
add 746f235 tests
add 8d64a7c fix core integration test failures
add 1ffa71c fix test
add 79f8f1f spotbugs
add 88cf06a Consumer changes to cope with cached metadata response
add ce1230a Rollback consumer-side metadata caching
add 59cb4a5 drop beginningOffset from the metadata
add c2ce4c8 CR feedback
add ffbaeab guard against early long-poll return due to metadata-only
response
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1cc0bb7)
\
N -- N -- N refs/heads/kafka-10866-consumerrecords-metadata
(ffbaeab)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
bin/kafka-server-stop.sh | 2 +-
bin/zookeeper-server-stop.sh | 2 +-
build.gradle | 15 +-
.../kafka/clients/admin/KafkaAdminClient.java | 65 ++++-
.../producer/internals/RecordAccumulator.java | 14 +-
.../producer/internals/TransactionManager.java | 59 +++--
.../org/apache/kafka/common/config/ConfigDef.java | 5 +-
.../kafka/clients/admin/KafkaAdminClientTest.java | 108 ++++++--
.../clients/producer/internals/SenderTest.java | 279 ++++++++++++++++++++-
.../producer/internals/TransactionManagerTest.java | 5 +
.../test/java/org/apache/kafka/test/TestUtils.java | 9 +
core/src/main/scala/kafka/api/ApiVersion.scala | 2 +-
.../controller/ControllerChannelManager.scala | 4 +-
.../scala/kafka/controller/KafkaController.scala | 12 +-
core/src/main/scala/kafka/raft/RaftManager.scala | 6 +-
core/src/main/scala/kafka/server/KafkaApis.scala | 2 +-
core/src/main/scala/kafka/server/KafkaConfig.scala | 38 ++-
.../main/scala/kafka/server/ZkAdminManager.scala | 2 +-
.../main/scala/kafka/tools/DumpLogSegments.scala | 5 +
core/src/main/scala/kafka/zk/AdminZkClient.scala | 21 +-
core/src/main/scala/kafka/zk/KafkaZkClient.scala | 22 +-
core/src/main/scala/kafka/zk/ZkData.scala | 4 +-
.../api/DescribeAuthorizedOperationsTest.scala | 146 ++++++-----
.../kafka/api/PlaintextConsumerTest.scala | 36 ++-
...PreferredReplicaLeaderElectionCommandTest.scala | 2 +-
.../controller/ControllerIntegrationTest.scala | 119 ++++++++-
.../kafka/security/auth/ZkAuthorizationTest.scala | 2 +-
.../scala/unit/kafka/server/KafkaConfigTest.scala | 58 ++++-
.../TopicIdWithOldInterBrokerProtocolTest.scala | 66 +++++
.../unit/kafka/tools/DumpLogSegmentsTest.scala | 15 +-
.../scala/unit/kafka/zk/KafkaZkClientTest.scala | 12 +-
.../org/apache/kafka/message/CodeBufferTest.java | 35 ++-
.../org/apache/kafka/message/EntityTypeTest.java | 16 +-
.../kafka/message/IsNullConditionalTest.java | 18 +-
.../kafka/message/MessageDataGeneratorTest.java | 18 +-
.../apache/kafka/message/MessageGeneratorTest.java | 16 +-
.../apache/kafka/message/StructRegistryTest.java | 27 +-
.../kafka/message/VersionConditionalTest.java | 38 ++-
.../org/apache/kafka/message/VersionsTest.java | 33 +--
raft/README.md | 6 +-
.../java/org/apache/kafka/raft/RaftConfig.java | 169 +++++--------
.../apache/kafka/raft/RaftClientTestContext.java | 10 +-
.../java/org/apache/kafka/raft/RaftConfigTest.java | 76 ------
.../apache/kafka/raft/RaftEventSimulationTest.java | 11 +-
.../java/org/apache/kafka/raft/RaftTestUtil.java | 65 -----
.../processor/internals/StateDirectory.java | 45 ++--
.../kafka/streams/processor/internals/Tasks.java | 6 +-
.../processor/internals/StateDirectoryTest.java | 15 +-
.../processor/internals/TaskManagerTest.java | 168 ++++++++-----
tests/kafkatest/services/kafka/kafka.py | 32 +++
tests/kafkatest/tests/core/downgrade_test.py | 8 +
tests/kafkatest/tests/core/upgrade_test.py | 14 +-
tests/kafkatest/version.py | 8 +
53 files changed, 1300 insertions(+), 671 deletions(-)
create mode 100644
core/src/test/scala/unit/kafka/server/MetadataRequestIBPTest/TopicIdWithOldInterBrokerProtocolTest.scala
delete mode 100644 raft/src/test/java/org/apache/kafka/raft/RaftConfigTest.java
delete mode 100644 raft/src/test/java/org/apache/kafka/raft/RaftTestUtil.java