This is an automated email from the ASF dual-hosted git repository.
hubcio pushed a change to branch perf/task-per-partition
in repository https://gitbox.apache.org/repos/asf/iggy.git
omit c2065e3d3 test(partitions): keep a quarantine test future under macOS
clippy cap
omit e1d1832ef perf(partitions): keep shard traffic moving during file I/O
add 8152a6074 feat(gateways): describe Iggy permissions as Kafka ACLs
(#4245)
add 32278f5dd refactor(server): move recovery readers to partitions, add
ShardHost (#4312)
add 91df1da99 feat(gateways): support idempotent Kafka producers, refuse
transactions (#4250)
add b2742e529 ci: resolve the PR triage trigger from the API, not the
artifact (#4257)
add 47731e34d feat(gateways): coordinate Kafka consumer groups (#4263)
add 3c2e7e8b5 chore(deps): Bump the web group across 1 directory with 5
updates (#4296)
add 89a794765 chore(deps): Bump @types/node from 26.5.1 to 26.6.1 in
/foreign/node in the node group across 1 directory (#4298)
add 2f6923905 feat(gateways): handle Kafka LeaveGroup for consumer groups
(#4270)
add 6cf56d631 feat(ci): add /skill review command that runs repo skills
(#4244)
add 419a06b72 perf(partitions): keep shard traffic moving during file I/O
add bd23c1a51 test(partitions): keep a quarantine test future under macOS
clippy cap
add 068a7015e fix(partitions): let shutdown drains and transfer offers
finish
add 14500cd5e fix(partitions): complete shutdown and state transfer
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c2065e3d3)
\
N -- N -- N refs/heads/perf/task-per-partition (14500cd5e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.config/nextest.toml | 12 +
.github/actions/rust/pre-merge/action.yml | 23 +
.github/review-bot/README.md | 67 +
.github/review-bot/comment-style.md | 43 +
.github/review-bot/prompt.md | 70 +
.github/workflows/pr-skill-review-post.yml | 457 +++
.github/workflows/pr-skill-review-run.yml | 542 ++++
.github/workflows/pr-triage-apply.yml | 233 +-
.github/workflows/pr-triage-collect.yml | 6 +-
.github/workflows/stale-prs-unmark-on-activity.yml | 101 +-
Cargo.lock | 1 +
core/configs/src/common/system.rs | 3 -
core/configs/src/server_config/server.rs | 76 +-
core/consensus/src/metadata_helpers.rs | 23 +-
.../tests/cluster/crash_recovery_corruption.rs | 2 +-
core/metadata/src/stm/authz.rs | 8 +-
core/metadata/src/stm/mod.rs | 14 +-
core/metadata/src/stm/stream.rs | 37 +-
core/metadata/src/stm/user.rs | 21 +-
core/partitions/src/consumer_offset_capacity.rs | 4 +-
core/partitions/src/iggy_index.rs | 6 +-
core/partitions/src/iggy_partition.rs | 1188 +++++++-
core/partitions/src/iggy_partitions.rs | 6 +
core/partitions/src/io.rs | 71 +-
core/partitions/src/journal.rs | 7 +
core/partitions/src/lib.rs | 12 +
core/{server => partitions}/src/offset_recovery.rs | 22 +-
core/partitions/src/partition_storage.rs | 725 +++++
.../{server => partitions}/src/segment_recovery.rs | 703 +++--
core/partitions/src/state_transfer.rs | 348 ++-
core/partitions/src/types.rs | 48 +
core/server/src/boot/mod.rs | 63 +-
core/server/src/boot/recovery.rs | 41 +-
core/server/src/consumer_group.rs | 9 +-
core/server/src/dispatch/authz.rs | 65 +-
core/server/src/dispatch/host.rs | 213 ++
core/server/src/dispatch/mod.rs | 226 +-
core/server/src/dispatch/partition.rs | 12 +-
core/server/src/dispatch/session_ops.rs | 16 +-
core/server/src/dispatch/submit.rs | 250 +-
core/server/src/dispatch/test_support.rs | 1 -
core/server/src/http/reads.rs | 125 +-
core/server/src/lib.rs | 14 +-
core/server/src/namespace.rs | 218 +-
core/server/src/partition_helpers.rs | 792 +-----
core/server/src/partition_reconciler.rs | 23 +-
core/server/src/server_error.rs | 320 +--
core/server/src/session_manager.rs | 2 +-
core/server/src/shell.rs | 57 +-
core/shard/src/builder.rs | 26 +-
core/shard/src/host.rs | 103 +
core/shard/src/lib.rs | 204 +-
core/shard/src/partition_io.rs | 219 +-
core/shard/src/poll/completion_tests.rs | 11 +-
core/shard/src/router.rs | 14 +-
core/simulator/src/replica.rs | 63 +-
core/simulator/src/storage/purge.rs | 60 +-
foreign/node/package-lock.json | 9 +-
foreign/node/package.json | 2 +-
gateways/kafka/Cargo.toml | 10 +-
gateways/kafka/README.md | 81 +-
gateways/kafka/docs/ACL_MAPPING.md | 195 ++
gateways/kafka/docs/CONSUMER_GROUPS.md | 191 ++
gateways/kafka/docs/IDEMPOTENCE.md | 139 +-
gateways/kafka/docs/MANUAL_TESTING.md | 106 +-
gateways/kafka/docs/SCOPE.md | 92 +-
gateways/kafka/docs/TEST_SUITE.md | 31 +
gateways/kafka/docs/kafka_api_keys_reference.md | 48 +-
gateways/kafka/scripts/ci-wire-fixtures.sh | 2 +-
gateways/kafka/src/auth.rs | 247 +-
gateways/kafka/src/group/mod.rs | 632 +++++
gateways/kafka/src/group/state.rs | 2956 ++++++++++++++++++++
gateways/kafka/src/lib.rs | 1 +
gateways/kafka/src/main.rs | 84 +-
gateways/kafka/src/protocol/acl.rs | 600 ++++
gateways/kafka/src/protocol/api.rs | 160 +-
gateways/kafka/src/protocol/bounds_guard.rs | 602 +++-
.../src/protocol/handlers/find_coordinator.rs | 169 ++
gateways/kafka/src/protocol/handlers/heartbeat.rs | 78 +
.../src/protocol/handlers/init_producer_id.rs | 207 ++
gateways/kafka/src/protocol/handlers/join_group.rs | 158 ++
.../kafka/src/protocol/handlers/leave_group.rs | 211 ++
gateways/kafka/src/protocol/handlers/mod.rs | 30 +-
gateways/kafka/src/protocol/handlers/produce.rs | 19 +-
gateways/kafka/src/protocol/handlers/sync_group.rs | 89 +
gateways/kafka/src/protocol/mod.rs | 1 +
gateways/kafka/src/server.rs | 196 +-
gateways/kafka/tests/api_handler_tests.rs | 13 +-
gateways/kafka/tests/common/codec.rs | 11 +
gateways/kafka/tests/common/scope.rs | 12 +-
gateways/kafka/tests/common/wire.rs | 250 +-
gateways/kafka/tests/consumer_group_tests.rs | 1641 +++++++++++
.../kafka/tests/create_topics_real_bridge_tests.rs | 4 +
gateways/kafka/tests/golden_wire_fixtures_tests.rs | 61 +-
gateways/kafka/tests/idempotence_tests.rs | 439 +++
gateways/kafka/tests/kafka_client_e2e_tests.rs | 725 +++++
.../kafka/tests/list_offsets_real_bridge_tests.rs | 4 +
gateways/kafka/tests/listener_robustness_tests.rs | 8 +-
gateways/kafka/tests/metadata_real_bridge_tests.rs | 24 +-
gateways/kafka/tests/produce_real_bridge_tests.rs | 4 +
gateways/kafka/tests/sasl_tests.rs | 624 ++++-
gateways/kafka/tests/server_e2e_tests.rs | 4 +-
gateways/kafka/tests/version_firewall_tests.rs | 54 +-
gateways/kafka/tools/kafka-tool/src/main.rs | 67 +-
gateways/kafka/tools/kafka-tool/src/response.rs | 18 +-
web/package-lock.json | 40 +-
web/package.json | 10 +-
107 files changed, 16640 insertions(+), 2745 deletions(-)
create mode 100644 .github/review-bot/README.md
create mode 100644 .github/review-bot/comment-style.md
create mode 100644 .github/review-bot/prompt.md
create mode 100644 .github/workflows/pr-skill-review-post.yml
create mode 100644 .github/workflows/pr-skill-review-run.yml
rename core/{server => partitions}/src/offset_recovery.rs (92%)
create mode 100644 core/partitions/src/partition_storage.rs
rename core/{server => partitions}/src/segment_recovery.rs (89%)
create mode 100644 core/server/src/dispatch/host.rs
create mode 100644 core/shard/src/host.rs
create mode 100644 gateways/kafka/docs/ACL_MAPPING.md
create mode 100644 gateways/kafka/docs/CONSUMER_GROUPS.md
create mode 100644 gateways/kafka/src/group/mod.rs
create mode 100644 gateways/kafka/src/group/state.rs
create mode 100644 gateways/kafka/src/protocol/acl.rs
create mode 100644 gateways/kafka/src/protocol/handlers/find_coordinator.rs
create mode 100644 gateways/kafka/src/protocol/handlers/heartbeat.rs
create mode 100644 gateways/kafka/src/protocol/handlers/init_producer_id.rs
create mode 100644 gateways/kafka/src/protocol/handlers/join_group.rs
create mode 100644 gateways/kafka/src/protocol/handlers/leave_group.rs
create mode 100644 gateways/kafka/src/protocol/handlers/sync_group.rs
create mode 100644 gateways/kafka/tests/consumer_group_tests.rs
create mode 100644 gateways/kafka/tests/idempotence_tests.rs
create mode 100644 gateways/kafka/tests/kafka_client_e2e_tests.rs
