This is an automated email from the ASF dual-hosted git repository.
hubcio pushed a change to branch fix/4292-go-group-membership
in repository https://gitbox.apache.org/repos/asf/iggy.git
omit 9662d460b fix(go): stop manual commits and cancels from dropping
membership
add 32278f5dd refactor(server): move recovery readers to partitions, add
ShardHost (#4312)
add 91df1da99 feat(gateways): support idempotent Kafka producers, refuse
transactions (#4250)
add b2742e529 ci: resolve the PR triage trigger from the API, not the
artifact (#4257)
add 47731e34d feat(gateways): coordinate Kafka consumer groups (#4263)
add 3c2e7e8b5 chore(deps): Bump the web group across 1 directory with 5
updates (#4296)
add 89a794765 chore(deps): Bump @types/node from 26.5.1 to 26.6.1 in
/foreign/node in the node group across 1 directory (#4298)
add 7704c779c fix(go): stop manual commits and cancels from dropping
membership
add a2923ef76 fix(go): stop abandoned requests from stalling or resending
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9662d460b)
\
N -- N -- N refs/heads/fix/4292-go-group-membership (a2923ef76)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/pr-triage-apply.yml | 233 ++-
.github/workflows/pr-triage-collect.yml | 6 +-
.github/workflows/stale-prs-unmark-on-activity.yml | 101 +-
Cargo.lock | 1 +
core/configs/src/common/system.rs | 3 -
core/configs/src/server_config/server.rs | 76 +-
.../tests/cluster/crash_recovery_corruption.rs | 2 +-
core/metadata/src/stm/authz.rs | 8 +-
core/metadata/src/stm/mod.rs | 14 +-
core/metadata/src/stm/stream.rs | 37 +-
core/metadata/src/stm/user.rs | 21 +-
core/partitions/src/iggy_index.rs | 6 +-
core/partitions/src/iggy_partition.rs | 1 -
core/partitions/src/lib.rs | 12 +
core/{server => partitions}/src/offset_recovery.rs | 22 +-
core/partitions/src/partition_storage.rs | 725 +++++++
.../{server => partitions}/src/segment_recovery.rs | 703 +++++--
core/partitions/src/types.rs | 48 +
core/server/src/boot/mod.rs | 63 +-
core/server/src/boot/recovery.rs | 41 +-
core/server/src/consumer_group.rs | 9 +-
core/server/src/dispatch/authz.rs | 65 +-
core/server/src/dispatch/host.rs | 213 ++
core/server/src/dispatch/mod.rs | 226 +--
core/server/src/dispatch/partition.rs | 12 +-
core/server/src/dispatch/session_ops.rs | 16 +-
core/server/src/dispatch/submit.rs | 250 ++-
core/server/src/dispatch/test_support.rs | 1 -
core/server/src/http/reads.rs | 125 +-
core/server/src/lib.rs | 14 +-
core/server/src/namespace.rs | 218 +-
core/server/src/partition_helpers.rs | 792 +-------
core/server/src/partition_reconciler.rs | 19 +-
core/server/src/server_error.rs | 320 +--
core/server/src/session_manager.rs | 2 +-
core/server/src/shell.rs | 57 +-
core/shard/src/builder.rs | 26 +-
core/shard/src/host.rs | 103 +
core/shard/src/lib.rs | 109 +-
core/shard/src/poll/completion_tests.rs | 11 +-
core/shard/src/router.rs | 6 +-
core/simulator/src/replica.rs | 63 +-
core/simulator/src/storage/purge.rs | 17 +-
foreign/go/README.md | 48 +-
foreign/go/client/tcp/tcp_connect_test.go | 2 +-
foreign/go/client/tcp/tcp_core.go | 336 ++--
foreign/go/client/tcp/tcp_core_review_test.go | 2 +-
foreign/go/client/tcp/tcp_core_test.go | 223 ++-
foreign/go/client/tcp/tcp_failover_test.go | 10 +-
foreign/go/client/tcp/tcp_offset_management.go | 20 +-
.../go/client/tcp/tcp_offset_management_test.go | 63 +
foreign/go/client/tcp/tcp_partition_management.go | 11 +-
foreign/go/client/tcp/tcp_poll_routing.go | 1 +
foreign/go/client/tcp/tcp_poll_routing_test.go | 5 +
foreign/go/client/tcp/tcp_session_management.go | 6 +-
foreign/go/client/tcp/tcp_stream_management.go | 5 +-
foreign/go/client/tcp/tcp_topic_cache_test.go | 37 +
foreign/go/client/tcp/tcp_topic_management.go | 5 +-
foreign/go/contracts/client.go | 16 +
foreign/go/internal/vsr/session.go | 3 +-
foreign/node/package-lock.json | 9 +-
foreign/node/package.json | 2 +-
gateways/kafka/Cargo.toml | 10 +-
gateways/kafka/README.md | 52 +-
gateways/kafka/docs/CONSUMER_GROUPS.md | 133 ++
gateways/kafka/docs/IDEMPOTENCE.md | 139 +-
gateways/kafka/docs/MANUAL_TESTING.md | 48 +-
gateways/kafka/docs/SCOPE.md | 86 +-
gateways/kafka/docs/TEST_SUITE.md | 2 +
gateways/kafka/docs/kafka_api_keys_reference.md | 45 +-
gateways/kafka/scripts/ci-wire-fixtures.sh | 2 +-
gateways/kafka/src/group/mod.rs | 493 +++++
gateways/kafka/src/group/state.rs | 2089 ++++++++++++++++++++
gateways/kafka/src/lib.rs | 1 +
gateways/kafka/src/main.rs | 84 +-
gateways/kafka/src/protocol/api.rs | 72 +-
gateways/kafka/src/protocol/bounds_guard.rs | 403 +++-
.../src/protocol/handlers/find_coordinator.rs | 169 ++
gateways/kafka/src/protocol/handlers/heartbeat.rs | 78 +
.../src/protocol/handlers/init_producer_id.rs | 207 ++
gateways/kafka/src/protocol/handlers/join_group.rs | 158 ++
gateways/kafka/src/protocol/handlers/mod.rs | 28 +-
gateways/kafka/src/protocol/handlers/produce.rs | 19 +-
gateways/kafka/src/protocol/handlers/sync_group.rs | 89 +
gateways/kafka/src/server.rs | 79 +-
gateways/kafka/tests/api_handler_tests.rs | 13 +-
gateways/kafka/tests/common/codec.rs | 11 +
gateways/kafka/tests/common/scope.rs | 11 +-
gateways/kafka/tests/common/wire.rs | 216 +-
gateways/kafka/tests/consumer_group_tests.rs | 1157 +++++++++++
.../kafka/tests/create_topics_real_bridge_tests.rs | 4 +
gateways/kafka/tests/golden_wire_fixtures_tests.rs | 59 +-
gateways/kafka/tests/idempotence_tests.rs | 439 ++++
.../kafka/tests/list_offsets_real_bridge_tests.rs | 4 +
gateways/kafka/tests/listener_robustness_tests.rs | 8 +-
gateways/kafka/tests/metadata_real_bridge_tests.rs | 24 +-
gateways/kafka/tests/produce_real_bridge_tests.rs | 4 +
gateways/kafka/tests/server_e2e_tests.rs | 4 +-
gateways/kafka/tests/version_firewall_tests.rs | 49 +-
gateways/kafka/tools/kafka-tool/src/main.rs | 32 +-
gateways/kafka/tools/kafka-tool/src/response.rs | 18 +-
web/package-lock.json | 40 +-
web/package.json | 10 +-
103 files changed, 9594 insertions(+), 2596 deletions(-)
rename core/{server => partitions}/src/offset_recovery.rs (92%)
create mode 100644 core/partitions/src/partition_storage.rs
rename core/{server => partitions}/src/segment_recovery.rs (89%)
create mode 100644 core/server/src/dispatch/host.rs
create mode 100644 core/shard/src/host.rs
create mode 100644 foreign/go/client/tcp/tcp_offset_management_test.go
create mode 100644 gateways/kafka/docs/CONSUMER_GROUPS.md
create mode 100644 gateways/kafka/src/group/mod.rs
create mode 100644 gateways/kafka/src/group/state.rs
create mode 100644 gateways/kafka/src/protocol/handlers/find_coordinator.rs
create mode 100644 gateways/kafka/src/protocol/handlers/heartbeat.rs
create mode 100644 gateways/kafka/src/protocol/handlers/init_producer_id.rs
create mode 100644 gateways/kafka/src/protocol/handlers/join_group.rs
create mode 100644 gateways/kafka/src/protocol/handlers/sync_group.rs
create mode 100644 gateways/kafka/tests/consumer_group_tests.rs
create mode 100644 gateways/kafka/tests/idempotence_tests.rs
