This is an automated email from the ASF dual-hosted git repository.
hubcio pushed a change to branch kafka-gateway-perf
in repository https://gitbox.apache.org/repos/asf/iggy.git
from ca96e78ce fix(gateways): address review comments on the Produce pool
add 789dfe6b5 feat(server): expose per-topic size and message count on
/metrics (#4480)
add c748fe201 feat(swift): add the VSR protocol layer with request and
reply codecs (#4355)
add fa86c2998 feat(cli): support IGGY_TOKEN environment variable (#4478)
add fe5612964 perf(connectors): stop cloning JSON leaves when the caller
already owns them (#4399)
add 69ab058ca fix(sdk): drop the oldest diagnostic event instead of
blocking (#4501)
add 4ac7ee87a feat(cluster): add three-node Docker Compose cluster (#4499)
add b9bb99719 ci: add job timeouts and stagger the stale-PR cron (#4466)
add a89b26a4a feat(ci): close PRs that skip the issue-first step (#4403)
add c03409660 fix(bench): pace warmup and rewind consumers (#4314)
new e873f9922 Merge branch 'master' into kafka-gateway-perf
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.claude/skills/connector-sdk/SKILL.md | 4 +-
.github/workflows/_common.yml | 15 +
.github/workflows/_detect.yml | 1 +
.github/workflows/post-merge.yml | 1 +
.github/workflows/pr-title.yml | 1 +
.github/workflows/pr-triage-apply.yml | 278 +++++++++++--
.github/workflows/pre-merge.yml | 1 +
.github/workflows/stale-prs.yml | 3 +-
AGENTS.md | 6 +-
.../src/actors/consumer/benchmark_consumer.rs | 146 ++++++-
.../bench/src/actors/consumer/client/high_level.rs | 84 ++--
core/bench/src/actors/consumer/client/interface.rs | 4 +
core/bench/src/actors/consumer/client/low_level.rs | 60 +++
.../src/actors/producer/benchmark_producer.rs | 15 +-
.../benchmark_producing_consumer.rs | 38 +-
core/bench/src/args/common.rs | 6 +-
core/bench/src/utils/rate_limiter.rs | 261 +++++++++++-
core/cli/src/args/mod.rs | 21 +-
core/cli/src/credentials.rs | 13 +
core/common/src/traits/client.rs | 11 +
core/common/src/utils/topic_size.rs | 32 ++
core/configs/src/configs_impl/file_provider.rs | 7 +
core/configs/src/server_config/server.rs | 1 +
core/connectors/sdk/src/convert.rs | 128 +++++-
core/connectors/sdk/src/encoders/avro.rs | 4 +-
core/connectors/sdk/src/lib.rs | 2 +-
core/connectors/sinks/delta_sink/src/sink.rs | 42 +-
core/connectors/sinks/http_sink/src/lib.rs | 58 +--
core/connectors/sinks/meilisearch_sink/src/lib.rs | 28 +-
core/connectors/sinks/s3_sink/src/formatter.rs | 95 +++--
core/connectors/sinks/s3_sink/src/sink.rs | 158 ++++++-
core/connectors/sinks/surrealdb_sink/src/lib.rs | 15 +-
core/integration/tests/bench.rs | 190 +++++++++
core/integration/tests/cli/common/mod.rs | 11 +
.../tests/cli/general/test_help_command.rs | 17 +-
.../tests/cli/user/test_login_options.rs | 208 +++++++++-
core/integration/tests/server/mod.rs | 2 +-
core/integration/tests/server/topic_metrics_vsr.rs | 178 +++++++-
core/sdk/src/diagnostic_events.rs | 54 +++
core/sdk/src/http/http_client.rs | 8 +-
core/sdk/src/lib.rs | 1 +
core/sdk/src/quic/quic_client.rs | 7 +-
core/sdk/src/tcp/tcp_client.rs | 35 +-
core/sdk/src/websocket/websocket_client.rs | 8 +-
core/server/config.toml | 4 +-
core/server/src/http/handlers.rs | 107 +++--
core/server/src/http/metrics.rs | 210 +++++++++-
core/server/src/segment_cleaner.rs | 41 +-
docker-compose.cluster.yml | 191 +++++++++
foreign/swift/README.md | 13 +-
.../Sources/Iggy/Models/ResourceOptions.swift | 12 -
foreign/swift/Sources/Iggy/Protocol/Batch.swift | 264 ++++++++++++
.../swift/Sources/Iggy/Protocol/CommandCode.swift | 143 +++++++
.../Sources/Iggy/Protocol/ConsensusOperation.swift | 154 +++++++
.../Sources/Iggy/Protocol/ConsensusSession.swift | 89 ++++
.../Sources/Iggy/Protocol/ProtocolVersion.swift | 46 +++
foreign/swift/Sources/Iggy/Protocol/Requests.swift | 348 ++++++++++++++++
.../swift/Sources/Iggy/Protocol/Responses.swift | 459 +++++++++++++++++++++
foreign/swift/Sources/Iggy/Protocol/VSRFrame.swift | 313 ++++++++++++++
foreign/swift/Sources/Iggy/Wire/ByteCodec.swift | 63 ++-
foreign/swift/Tests/IggyTests/Fixtures/golden.json | 1 +
foreign/swift/Tests/IggyTests/ModelTests.swift | 8 +-
foreign/swift/Tests/IggyTests/ProtocolTests.swift | 310 ++++++++++++++
.../Tests/IggyTests/ResponseVectorTests.swift | 322 +++++++++++++++
.../Tests/IggyTests/Support/GoldenFixture.swift | 4 +
.../swift/Tests/IggyTests/WireVectorTests.swift | 290 +++++++++++++
foreign/swift/Tools/golden-vectors/src/main.rs | 11 +
67 files changed, 5307 insertions(+), 354 deletions(-)
create mode 100644 core/sdk/src/diagnostic_events.rs
create mode 100644 docker-compose.cluster.yml
create mode 100644 foreign/swift/Sources/Iggy/Protocol/Batch.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/CommandCode.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/ConsensusOperation.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/ConsensusSession.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/ProtocolVersion.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/Requests.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/Responses.swift
create mode 100644 foreign/swift/Sources/Iggy/Protocol/VSRFrame.swift
create mode 100644 foreign/swift/Tests/IggyTests/ProtocolTests.swift
create mode 100644 foreign/swift/Tests/IggyTests/ResponseVectorTests.swift
create mode 100644 foreign/swift/Tests/IggyTests/WireVectorTests.swift
