This is an automated email from the ASF dual-hosted git repository.
hubcio pushed a change to branch server-ng-pr5-responses-recut
in repository https://gitbox.apache.org/repos/asf/iggy.git
omit 051a5270f Merge branch 'master' into server-ng-pr5-responses-recut
omit 41cf2c5ba refactor(server): split responses.rs by role and unify reply
framing
add 6d894501b chore(deps): Bump the github-actions group with 3 updates
(#4099)
add 1290e4fff chore(deps): remove Microsoft.SourceLink.GitHub package
reference (#4113)
add 7a77f4592 fix(connectors): use DLL_EXTENSION for plugin path suffix
(#4114)
add 62f945a34 chore: add justinmclean to .asf.yaml collaborators (#4115)
add 46a907596 fix(connectors): bring quickwit_sink up to convention (#3523)
add df4c75d34 feat(python): expose partition management (#4017)
add 3f0646fce chore(ci): add team-review-slim, cheaper team-review and
plain english (#4095)
add e9f3362e3 feat(connectors)!: add shared retry_async helper to the
connector SDK (#4104)
add d693eb93d test(integration): cleanup & drop the doris nextest
test-group (#4116)
add d75890f67 fix(repo): include gateways so the source release tarball
builds (#4126)
add e0027506f feat(cluster)!: let topics require durable acks and flatten
config (#4092)
add f87ef77c3 chore(deps): Bump js-yaml from 4.3.1 to 4.3.2 in
/foreign/node (#4107)
add e37396b1c chore(deps): Bump joi from 17.13.4 to 17.13.7 in /web (#4106)
add 73a0bed8b fix(consensus): count an unservable header as a nack (#4109)
add ff2e7481c fix(shard): refuse a frame no consensus plane claims (#4103)
add 91c3ca54b test(simulator): cover durability failures no existing test
can reach (#4132)
add dc2b38209 fix(integration): pull MinIO fixtures from quay instead of
Docker Hub (#4148)
add cfd3dff6a feat(cpp): add stream, topic, and partition functions to
high level client (#4022)
add ac5c7bf3a feat(connectors): add the HTTP source webhook gateway
connector (#3798)
add 309662d33 fix(ci): run integration tests when a binary they launch
changes (#4131)
add 6138eb9fd chore(deps): Bump the node group across 2 directories with 3
updates (#4125)
add 3b9320072 chore(deps): Bump github.com/klauspost/compress from 1.19.2
to 1.20.0 in /bdd/go in the go group across 1 directory (#4147)
add 2019e145d chore(deps): Bump the web group across 1 directory with 7
updates (#4124)
add dc54783f2 fix(server): resolve non-Linux clippy errors in shard
binding (#4144)
add 2b2e61253 fix(connectors): draw the retry delay inside the cap instead
of clamping (#4129)
add a4f38467b chore(deps): Bump the python group across 3 directories with
1 update (#4110)
add 262117cd1 perf(partitions): cut persisted-mode disk traffic per
acknowledgment (#4146)
add 67e14c26b fix(connectors): close the source instance a failed start
leaves behind (#4064)
add bb5ed1702 fix(server): preserve write responses and validate CLI input
(#4150)
add 9a4fd0f75 docs(integration): say that the test harness runs prebuilt
binaries (#4160)
add 585ab6922 fix(sdk): preserve consumer progress and client error
handling (#4151)
add bab0e331e fix(connectors): report failures and correct format
conversion (#4152)
add af237a124 fix(partitions): complete polls on the owning shard (#4119)
add 30bdb469b fix(configs): allow sibling IGGY variables (#4149)
add 2588e9926 feat(python): add high-level producer API (#4156)
add 78151b951 fix(ci): support multiline README commands (#4162)
add c2bd0c0cd fix(ci): don't mark PRs stale while they wait on review
(#4172)
add a9c2a53ea refactor(server): split responses.rs by role and unify reply
framing
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (051a5270f)
\
N -- N -- N refs/heads/server-ng-pr5-responses-recut (a9c2a53ea)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 3 +
.claude/skills/connector-sdk/SKILL.md | 6 +-
.claude/skills/connector-sink/SKILL.md | 3 +-
.claude/skills/connector-source/SKILL.md | 36 +-
.claude/skills/connector-testing/SKILL.md | 51 +
.claude/skills/team-review-slim/SKILL.md | 230 +
.claude/skills/team-review/SKILL.md | 184 +-
.config/nextest.toml | 15 -
.github/actions/go/pre-merge/action.yml | 8 +-
.github/actions/java-gradle/pre-merge/action.yml | 4 +-
.github/actions/rust/pre-merge/action.yml | 15 +
.github/config/components.yml | 3 +-
.github/workflows/_common.yml | 4 +-
.github/workflows/_test.yml | 10 +
.github/workflows/_test_examples.yml | 10 +
.github/workflows/coverage-baseline.yml | 4 +-
.github/workflows/edge-release.yml | 2 +-
.github/workflows/post-merge.yml | 2 +-
.github/workflows/stale-prs.yml | 4 +-
AGENTS.md | 5 +-
Cargo.lock | 54 +-
Cargo.toml | 12 +-
README.md | 44 +-
.../features/step_definitions/messaging_steps.cpp | 31 +-
bdd/docker-compose.cluster.yml | 4 +-
bdd/docker-compose.server.yml | 2 +-
bdd/go/go.mod | 2 +-
bdd/go/go.sum | 4 +-
bdd/python/uv.lock | 40 +-
core/ai/mcp/Cargo.toml | 2 +-
core/ai/mcp/README.md | 45 +-
core/ai/mcp/src/error.rs | 4 +
core/ai/mcp/src/log.rs | 167 +-
core/ai/mcp/src/main.rs | 118 +-
core/ai/mcp/src/service/mod.rs | 20 +-
core/ai/mcp/src/service/requests.rs | 4 +-
core/ai/mcp/src/systemd.rs | 2 +-
core/bench/Cargo.toml | 3 +-
core/bench/README.md | 60 +
core/bench/dashboard/frontend/index.html | 2 +-
core/bench/src/args/common.rs | 31 +-
core/bench/src/args/defaults.rs | 6 +-
core/bench/src/args/examples.rs | 355 +-
.../kinds/balanced/producer_and_consumer_group.rs | 4 +-
.../kinds/end_to_end/producing_consumer_group.rs | 2 +-
core/bench/src/args/kinds/pinned/consumer.rs | 6 +-
core/bench/src/args/transport.rs | 21 +-
core/bench/src/benchmarks/benchmark.rs | 9 +-
core/bench/src/benchmarks/common.rs | 4 +-
core/bench/src/utils/mod.rs | 130 +-
core/binary_protocol/Cargo.toml | 2 +-
core/binary_protocol/src/consensus/header.rs | 43 +-
core/binary_protocol/src/consensus/operation.rs | 42 +-
core/binary_protocol/src/primitives/options.rs | 27 +-
.../src/requests/topics/update_topic.rs | 14 +-
.../src/responses/messages/send_messages.rs | 16 +-
core/binary_protocol/src/version.rs | 4 +-
core/cli/Cargo.toml | 2 +-
core/cli/src/args/consumer_group.rs | 6 +-
core/cli/src/args/consumer_offset.rs | 4 +-
core/cli/src/args/message.rs | 56 +-
core/cli/src/args/mod.rs | 4 +-
core/cli/src/args/personal_access_token.rs | 4 +-
core/cli/src/args/segment.rs | 37 +-
core/cli/src/args/stream.rs | 4 +-
core/cli/src/args/system.rs | 2 +-
core/cli/src/args/topic.rs | 99 +-
.../src/commands/binary_message/send_messages.rs | 23 +-
.../cli/src/commands/binary_topics/create_topic.rs | 10 +-
core/cli/src/main.rs | 2 +
core/common/Cargo.toml | 2 +-
core/common/src/consumer_group_client_state.rs | 3 +-
core/common/src/http/messages/poll_messages.rs | 4 +
core/common/src/traits/binary_impls/messages.rs | 10 +-
core/common/src/traits/binary_transport.rs | 3 +-
core/common/src/traits/client.rs | 2 +-
core/common/src/traits/message_client.rs | 36 +-
core/common/src/types/args/mod.rs | 6 +-
.../configuration/tcp_config/tcp_client_config.rs | 2 +-
core/common/src/types/message/partitioning.rs | 12 +-
core/common/src/types/message/partitioning_kind.rs | 4 +-
core/common/src/types/message/polling_strategy.rs | 7 +-
.../{cluster/role.rs => options/durability.rs} | 47 +-
core/common/src/types/options/mod.rs | 326 +-
core/configs/Cargo.toml | 3 +
core/configs/src/common/defaults.rs | 90 +-
core/configs/src/common/displays.rs | 50 +-
core/configs/src/common/mod.rs | 2 +-
core/configs/src/common/server.rs | 2 +-
core/configs/src/common/system.rs | 219 +-
core/configs/src/common/validators.rs | 40 +-
core/configs/src/configs_impl/file_provider.rs | 184 +-
core/configs/src/configs_impl/mod.rs | 2 +-
.../configs/src/configs_impl/typed_env_provider.rs | 3 +-
core/configs/src/lib.rs | 2 +-
core/configs/src/server_config/defaults.rs | 18 +-
core/configs/src/server_config/displays.rs | 19 +-
core/configs/src/server_config/partition.rs | 101 +-
core/configs/src/server_config/server.rs | 265 +-
core/configs/src/server_config/sharding.rs | 97 +-
core/configs/src/server_config/validators.rs | 57 +-
core/connectors/README.md | 49 +-
core/connectors/runtime/README.md | 49 +-
.../connectors/http_source_github.toml | 60 +
.../connectors/http_source_partner.toml | 55 +
.../example_config/connectors/quickwit_sink.toml | 22 +-
.../src/configs/connectors/local_provider.rs | 136 +-
core/connectors/runtime/src/log.rs | 117 +-
core/connectors/runtime/src/main.rs | 39 +-
core/connectors/runtime/src/manager/sink.rs | 55 +-
core/connectors/runtime/src/manager/source.rs | 266 +-
core/connectors/runtime/src/metrics.rs | 2 +-
core/connectors/runtime/src/sink.rs | 37 +-
core/connectors/runtime/src/source.rs | 309 +-
core/connectors/runtime/src/state.rs | 2 +-
core/connectors/runtime/src/state/http.rs | 70 +-
core/connectors/sdk/Cargo.toml | 7 +-
core/connectors/sdk/README.md | 291 +-
core/connectors/sdk/src/decoders/proto.rs | 136 +-
core/connectors/sdk/src/encoders/proto.rs | 206 +-
core/connectors/sdk/src/lib.rs | 2 +-
core/connectors/sdk/src/retry.rs | 654 +-
core/connectors/sdk/src/sink.rs | 7 +
core/connectors/sdk/src/source.rs | 10 +
core/connectors/sdk/src/transforms/avro_convert.rs | 48 +-
.../connectors/sdk/src/transforms/filter_fields.rs | 6 +-
.../sdk/src/transforms/json/filter_fields.rs | 53 +
.../connectors/sdk/src/transforms/proto_convert.rs | 199 +-
core/connectors/sdk/tests/protobuf_integration.rs | 683 ++-
core/connectors/sinks/doris_sink/README.md | 4 +-
core/connectors/sinks/doris_sink/src/lib.rs | 59 +-
core/connectors/sinks/http_sink/README.md | 115 +-
core/connectors/sinks/http_sink/config.toml | 2 +-
core/connectors/sinks/http_sink/src/lib.rs | 9 +-
core/connectors/sinks/influxdb_sink/README.md | 6 +-
core/connectors/sinks/influxdb_sink/src/lib.rs | 11 +-
core/connectors/sinks/meilisearch_sink/src/lib.rs | 42 +-
core/connectors/sinks/quickwit_sink/Cargo.toml | 10 +-
core/connectors/sinks/quickwit_sink/README.md | 64 +-
core/connectors/sinks/quickwit_sink/config.toml | 9 +
core/connectors/sinks/quickwit_sink/src/lib.rs | 957 ++-
core/connectors/sinks/rabbitmq_sink/src/lib.rs | 14 +-
core/connectors/sinks/s3_sink/src/sink.rs | 6 +-
core/connectors/sinks/surrealdb_sink/src/lib.rs | 8 +-
core/connectors/sources/README.md | 3 +-
.../{random_source => http_source}/Cargo.toml | 19 +-
core/connectors/sources/http_source/README.md | 382 ++
core/connectors/sources/http_source/config.toml | 68 +
core/connectors/sources/http_source/src/auth.rs | 463 ++
core/connectors/sources/http_source/src/lib.rs | 2536 ++++++++
.../sources/http_source/src/management.rs | 1535 +++++
core/connectors/sources/http_source/src/metrics.rs | 497 ++
core/connectors/sources/http_source/src/routes.rs | 666 ++
core/connectors/sources/http_source/src/server.rs | 3128 ++++++++++
core/connectors/sources/http_source/src/state.rs | 1437 +++++
core/connectors/sources/http_source/src/types.rs | 275 +
core/connectors/sources/influxdb_source/README.md | 4 +-
core/connectors/sources/influxdb_source/src/lib.rs | 11 +-
core/connectors/sources/random_source/README.md | 10 +-
core/connectors/sources/random_source/src/lib.rs | 31 +-
core/consensus/src/dvc_merge.rs | 86 +-
core/consensus/src/impls.rs | 369 +-
core/consensus/src/plane_helpers.rs | 379 +-
core/cpu_allocation/src/lib.rs | 4 +-
core/harness_derive/src/attrs.rs | 2 +-
core/integration/Cargo.toml | 1 +
core/integration/src/bench_utils.rs | 2 +-
core/integration/src/harness/config/resolve.rs | 40 +-
core/integration/src/harness/disk.rs | 13 +-
core/integration/src/harness/handle/server.rs | 24 +-
.../src/harness/orchestrator/builder.rs | 4 +-
core/integration/tests/bench.rs | 114 +
.../test_consumer_group_create_command.rs | 10 +-
.../test_consumer_group_help_command.rs | 2 +-
.../test_consumer_offset_get_command.rs | 4 +-
.../test_consumer_offset_set_command.rs | 4 +-
.../tests/cli/general/test_help_command.rs | 8 +-
.../cli/message/test_message_flush_command.rs | 30 +-
.../tests/cli/message/test_message_help_command.rs | 2 +-
.../tests/cli/message/test_message_send_command.rs | 44 +-
.../test_pat_create_command.rs | 4 +-
.../tests/cli/stream/test_stream_create_command.rs | 6 +-
.../tests/cli/system/test_me_command.rs | 2 +-
.../tests/cli/system/test_snapshot_cmd.rs | 2 +-
.../tests/cli/topic/test_topic_create_command.rs | 44 +-
.../tests/cli/topic/test_topic_update_command.rs | 20 +-
core/integration/tests/cluster/crash_durability.rs | 382 +-
.../tests/cluster/crash_recovery_corruption.rs | 227 +-
.../tests/cluster/failover_client_continuity.rs | 2 +-
.../tests/cluster/fast_primary_rejoin.rs | 11 +-
.../tests/cluster/metadata_checkpoint_restart.rs | 2 +-
.../cluster/multi_shard_partition_convergence.rs | 4 +-
.../tests/cluster/parked_frame_redispatch.rs | 8 +-
core/integration/tests/cluster/partition_dedup.rs | 12 +-
.../tests/cluster/partition_state_transfer.rs | 6 +-
.../tests/cluster/register_forwarding.rs | 14 +-
.../tests/cluster/staggered_bootstrap.rs | 49 +-
core/integration/tests/config_provider/mod.rs | 6 +-
.../tests/connectors/fixtures/delta/fixture.rs | 4 +-
.../tests/connectors/fixtures/http/container.rs | 23 +
.../tests/connectors/fixtures/http/mod.rs | 5 +
.../tests/connectors/fixtures/http/source.rs | 125 +
.../tests/connectors/fixtures/iceberg/container.rs | 4 +-
core/integration/tests/connectors/fixtures/mod.rs | 11 +-
.../connectors/fixtures/quickwit/container.rs | 86 +-
.../tests/connectors/fixtures/quickwit/mod.rs | 5 +-
.../connectors/fixtures/redshift/container.rs | 2 +-
.../tests/connectors/fixtures/redshift/sink.rs | 4 +-
.../tests/connectors/fixtures/s3/fixture.rs | 2 +-
.../integration/tests/connectors/http/http_sink.rs | 124 +-
.../tests/connectors/http/http_source.rs | 580 ++
core/integration/tests/connectors/http/mod.rs | 3 +
.../tests/connectors/{random => http}/source.toml | 2 +-
.../http/source_config/http_github.toml} | 41 +-
.../http/source_config/http_partner.toml} | 37 +-
.../tests/connectors/quickwit/quickwit_sink.rs | 128 +-
.../tests/connectors/random/random_source.rs | 120 +-
.../tests/connectors/runtime/error_isolation.rs | 82 +-
.../tests/connectors/runtime/http_state.rs | 32 +-
...nvalid_state.toml => sink_transform_error.toml} | 2 +-
.../stdout.toml} | 26 +-
.../tests/data_integrity/storage_compat.rs | 228 +-
core/integration/tests/mcp/mod.rs | 221 +-
core/integration/tests/mod.rs | 1 +
core/integration/tests/sdk/consumer_offset.rs | 61 +
core/integration/tests/sdk/options.rs | 15 +-
core/integration/tests/server/a2a_jwt/config.toml | 33 +-
.../tests/server/cluster_metadata_vsr.rs | 2 +-
.../tests/server/cluster_view_durability_vsr.rs | 2 +-
.../tests/server/http_read_your_writes.rs | 4 +-
core/integration/tests/server/http_view_header.rs | 4 +-
core/integration/tests/server/http_vsr.rs | 158 +-
core/integration/tests/server/message_retrieval.rs | 2 +-
core/integration/tests/server/mod.rs | 1 +
.../tests/server/partition_view_durability_vsr.rs | 2 +-
.../concurrent_produce_consume_scenario.rs | 2 +-
...h_multiple_clients_polling_messages_scenario.rs | 6 +-
.../tests/server/scenarios/encryption_scenario.rs | 9 +-
.../server/scenarios/log_rotation_scenario.rs | 8 +-
.../server/scenarios/message_cleanup_scenario.rs | 156 +-
.../server/scenarios/purge_delete_scenario.rs | 2 +-
.../scenarios/read_during_persistence_scenario.rs | 2 +-
.../scenarios/reconnect_after_restart_scenario.rs | 4 +-
.../scenarios/restart_offset_skip_scenario.rs | 2 +-
core/integration/tests/server/telemetry.rs | 63 +
.../tests/server/topic_admission_vsr.rs | 20 +-
core/journal/Cargo.toml | 6 +-
core/journal/src/durable_storage.rs | 452 ++
core/journal/src/lib.rs | 4 +
core/journal/src/partition_journal.rs | 3506 +++++++++++
core/journal/src/partition_journal/segments.rs | 858 +++
core/metadata/src/impls/metadata.rs | 32 +-
core/metadata/src/stm/snapshot.rs | 30 +-
core/metadata/src/stm/stream.rs | 121 +-
core/partitions/Cargo.toml | 4 +-
core/partitions/src/consumer_offset_capacity.rs | 141 +-
core/partitions/src/iggy_index_writer.rs | 23 +-
core/partitions/src/iggy_partition.rs | 6415 ++++++++++++++++----
core/partitions/src/iggy_partitions.rs | 169 +-
core/partitions/src/install_backup.rs | 234 +
core/partitions/src/journal.rs | 26 +-
core/partitions/src/lib.rs | 8 +-
core/partitions/src/messages_writer.rs | 58 +-
core/partitions/src/offset_storage.rs | 69 +-
core/partitions/src/persistence.rs | 1698 ++++++
core/partitions/src/poll_plan.rs | 696 +--
core/partitions/src/state_transfer.rs | 532 +-
core/partitions/src/types.rs | 24 +-
core/sdk/Cargo.toml | 2 +-
core/sdk/README.md | 27 +-
core/sdk/src/clients/client.rs | 32 +-
core/sdk/src/clients/consumer.rs | 10 +-
core/sdk/src/clients/producer.rs | 21 +-
core/sdk/src/clients/producer_builder.rs | 4 +-
core/sdk/src/http/messages.rs | 99 +-
core/sdk/src/http/topics.rs | 2 +-
core/sdk/src/prelude.rs | 8 +-
.../stream_builder/build/build_iggy_consumer.rs | 2 +-
.../stream_builder/config/config_iggy_consumer.rs | 35 +-
.../stream_builder/config/config_iggy_producer.rs | 5 +-
core/sdk/src/vsr.rs | 55 +-
core/sdk/src/websocket/websocket_client.rs | 37 +
core/server/Cargo.toml | 3 +-
core/server/config.toml | 326 +-
core/server/src/args.rs | 16 +-
core/server/src/boot/credentials.rs | 2 +-
core/server/src/boot/listeners.rs | 2 +-
core/server/src/boot/mod.rs | 51 +-
core/server/src/boot/recovery.rs | 87 +-
core/server/src/boot/threads.rs | 50 +-
core/server/src/config_writer.rs | 2 +-
core/server/src/consumer_group.rs | 786 ++-
core/server/src/dispatch/failure.rs | 8 +-
core/server/src/dispatch/mod.rs | 62 +-
core/server/src/dispatch/partition.rs | 910 +--
core/server/src/dispatch/reads.rs | 10 +-
core/server/src/dispatch/session_ops.rs | 3 +-
core/server/src/dispatch/test_support.rs | 3 +-
core/server/src/http.rs | 6 +-
core/server/src/http/error.rs | 52 +-
core/server/src/http/forward.rs | 24 +-
core/server/src/http/handlers.rs | 55 +-
core/server/src/http/reads.rs | 217 +
core/server/src/http/state.rs | 4 +-
core/server/src/main.rs | 3 +-
core/server/src/partition_helpers.rs | 573 +-
core/server/src/partition_reconciler.rs | 39 +-
core/server/src/reply_frame.rs | 2 +-
core/server/src/responses.rs | 35 +-
core/server/src/segment_recovery.rs | 366 +-
core/server/src/server_error.rs | 75 +-
core/server/src/shard_allocator.rs | 20 +-
core/server/src/shell.rs | 4 +-
core/server/src/snapshot.rs | 28 +-
core/server/tests/sdk_e2e.rs | 4 +-
core/server_common/src/consensus_message.rs | 6 +-
core/server_common/src/fs_utils.rs | 46 +
core/server_common/src/iobuf.rs | 4 +
core/server_common/src/lib.rs | 1 +
core/server_common/src/log/logger.rs | 8 +-
core/server_common/src/memory_pool.rs | 4 +-
core/server_common/src/poll.rs | 279 +
.../src/segment_storage/messages_reader.rs | 13 +-
core/server_common/src/segment_storage/mod.rs | 55 +
core/server_common/src/send_messages.rs | 10 +-
core/shard/Cargo.toml | 1 +
core/shard/src/builder.rs | 15 +-
core/shard/src/lib.rs | 775 ++-
core/shard/src/metrics.rs | 253 +-
core/shard/src/poll.rs | 257 +
core/shard/src/poll/completion.rs | 507 ++
core/shard/src/poll/completion_tests.rs | 506 ++
core/shard/src/poll/test_support.rs | 110 +
core/shard/src/poll/timeout_tests.rs | 532 ++
core/shard/src/router.rs | 114 +-
core/simulator/Cargo.toml | 1 +
core/simulator/src/bin/simulator-ui.rs | 21 +-
core/simulator/src/bus.rs | 22 +
core/simulator/src/lib.rs | 574 +-
core/simulator/src/replica.rs | 12 +-
core/simulator/src/storage.rs | 671 ++
core/simulator/src/storage/tests.rs | 2937 +++++++++
core/simulator/src/workload/invariants.rs | 30 +
examples/csharp/README.md | 31 +-
.../Utils.cs | 7 +-
.../Utils.cs | 32 +-
.../src/Iggy_SDK.Examples.Shared/ExampleHelpers.cs | 29 +-
.../Utils.cs | 7 +-
.../Utils.cs | 29 +-
.../Utils.cs | 7 +-
.../Utils.cs | 29 +-
.../Iggy_SDK.Examples.TcpTls.Consumer/Program.cs | 2 +-
examples/go/README.md | 31 +-
examples/go/getting-started/consumer/main.go | 2 +-
examples/go/getting-started/consumer/main_test.go | 89 +
examples/go/go.mod | 2 +-
examples/go/go.sum | 4 +-
examples/java/README.md | 34 +-
examples/java/build.gradle.kts | 6 +
examples/java/settings.gradle.kts | 8 +
.../apache/iggy/examples/async/AsyncConsumer.java | 14 +-
.../consumer/GettingStartedConsumer.java | 5 +-
.../consumer/MessageEnvelopeConsumer.java | 5 +-
.../consumer/MessageHeadersConsumer.java | 3 +-
.../multitenant/consumer/MultiTenantConsumer.java | 3 +-
.../multitenant/producer/MultiTenantProducer.java | 3 +-
.../iggy/examples/streambuilder/StreamBasic.java | 3 +-
.../examples/tcptls/consumer/TcpTlsConsumer.java | 11 +-
.../examples/tcptls/producer/TcpTlsProducer.java | 6 +-
.../apache/iggy/examples/ConsumerOffsetTest.java | 213 +
.../iggy/examples/MultiTenantAccessTest.java | 141 +
examples/node/README.md | 58 +-
examples/node/package-lock.json | 12 +-
examples/node/package.json | 5 +-
examples/node/src/basic/consumer.ts | 11 +-
examples/node/src/getting-started/consumer.ts | 7 +-
examples/node/src/message-envelope/consumer.ts | 9 +-
examples/node/src/message-headers/consumer.ts | 9 +-
examples/node/src/multi-tenant/consumer.ts | 9 +-
examples/node/src/sink-data-producer/producer.ts | 2 +-
examples/node/src/tcp-tls/consumer.ts | 13 +-
examples/node/src/tcp-tls/producer.ts | 9 +-
examples/node/tests/consumer-offset.test.mjs | 106 +
examples/php/README.md | 7 +-
examples/php/src/common.php | 18 +-
examples/python/README.md | 80 +-
examples/python/high-level/background_producer.py | 108 +
examples/python/high-level/consumer.py | 93 +
examples/python/high-level/producer.py | 122 +
examples/python/pyproject.toml | 2 +-
examples/python/uv.lock | 42 +-
examples/rust/README.md | 30 +-
examples/rust/src/basic/consumer/main.rs | 3 +
examples/rust/src/basic/producer/main.rs | 3 +
.../stream-builder/stream-consumer-config/main.rs | 18 +-
.../stream-builder/stream-producer-config/main.rs | 10 +-
examples/rust/src/tcp-tls/consumer/main.rs | 4 +-
examples/rust/src/tcp-tls/producer/main.rs | 4 +-
foreign/cpp/Cargo.toml | 2 +-
foreign/cpp/MODULE.bazel | 2 +-
foreign/cpp/README.md | 8 +-
foreign/cpp/include/iggy.hpp | 1638 ++++-
foreign/cpp/src/client.cpp | 192 +-
foreign/cpp/src/client.rs | 144 +-
foreign/cpp/src/lib.rs | 64 +-
foreign/cpp/src/type_conversion.rs | 175 +-
foreign/cpp/src/type_conversions.cpp | 118 +
foreign/cpp/tests/e2e/client.cpp | 86 +-
foreign/cpp/tests/e2e/consumer_group.cpp | 162 +-
foreign/cpp/tests/e2e/message.cpp | 156 +-
foreign/cpp/tests/e2e/partition.cpp | 438 +-
foreign/cpp/tests/e2e/stream.cpp | 1039 ++--
foreign/cpp/tests/e2e/test_helpers.hpp | 34 +-
foreign/cpp/tests/e2e/topic.cpp | 1804 +++---
foreign/cpp/tests/unit/unit_tests.cpp | 358 +-
foreign/csharp/Directory.Build.props | 4 -
foreign/csharp/Directory.Packages.props | 1 -
.../Fixtures/VsrCluster.cs | 4 +-
.../Iggy_SDK.Tests.Integration/OptionsTests.cs | 21 +-
foreign/csharp/Iggy_SDK/Consumers/IggyConsumer.cs | 21 +-
.../Iggy_SDK/Consumers/IggyConsumerBuilder.cs | 4 +-
.../Iggy_SDK/Consumers/IggyConsumerConfig.cs | 4 +-
.../Iggy_SDK/Contracts/SendMessagesResponse.cs | 4 +-
foreign/csharp/Iggy_SDK/Contracts/TopicOptions.cs | 52 +-
.../Iggy_SDK/Enums/{Protocol.cs => Durability.cs} | 19 +-
foreign/csharp/Iggy_SDK/IggyClient/IIggyTopic.cs | 4 +-
.../Implementations/HttpMessageStream.cs | 22 +-
.../Implementations/TcpMessageStream.Vsr.cs | 5 +-
.../IggyClient/Implementations/TcpMessageStream.cs | 2 +
foreign/csharp/Iggy_SDK/Iggy_SDK.csproj | 2 +-
.../csharp/Iggy_SDK/Publishers/IggyPublisher.cs | 41 +-
.../Iggy_SDK/Publishers/IggyPublisherBuilder.cs | 12 +-
.../Iggy_SDK/Publishers/IggyPublisherConfig.cs | 10 +-
.../Iggy_SDK/Vsr/ConsumerGroupClientState.cs | 4 +-
.../ClientTests/ExampleHelpersTests.cs | 80 +
.../ClientTests/HttpTopicOptionsTests.cs | 74 +-
.../ConsumerTests/IggyConsumerBuilderTests.cs | 38 +
.../csharp/Iggy_SDK_Tests/Iggy_SDK_Tests.csproj | 1 +
.../Iggy_SDK_Tests/MapperTests/BinaryMapper.cs | 4 +-
.../MapperTests/OptionsBlockGoldenVectorTests.cs | 26 +-
.../MapperTests/ResourceOptionsConverterTests.cs | 8 +-
.../PublisherTests/IggyTypedPublisherTests.cs | 83 +
.../UtilityTests/TopicOptionsTests.cs | 20 +-
foreign/csharp/README.md | 291 +-
foreign/go/README.md | 30 +-
.../binary_response_deserializer.go | 4 +-
foreign/go/client/tcp/tcp_core.go | 10 +-
foreign/go/client/tcp/tcp_group_polling.go | 4 +-
foreign/go/client/tcp/tcp_messaging.go | 5 +-
foreign/go/contracts/client.go | 12 +-
foreign/go/contracts/compression_algorithm_test.go | 14 +-
foreign/go/contracts/topic_options.go | 19 +-
foreign/go/contracts/topic_options_test.go | 24 +-
foreign/go/contracts/version.go | 2 +-
foreign/go/go.mod | 2 +-
foreign/go/go.sum | 4 +-
foreign/go/internal/command/topic.go | 20 +-
foreign/go/internal/command/topic_test.go | 20 +-
foreign/go/tests/e2e_helpers_test.go | 2 +-
foreign/go/tests/e2e_test.go | 18 +-
foreign/java/README.md | 35 +-
.../iggy-connector-flink/docker-compose.yml | 2 +-
.../iggy-connector-pinot/docker-compose.yml | 2 +-
.../connector/pinot/IggyPinotIntegrationTest.java | 2 +-
foreign/java/gradle.properties | 2 +-
.../apache/iggy/client/async/MessagesClient.java | 13 +-
.../iggy/client/async/tcp/TopicsTcpClient.java | 8 +-
.../client/blocking/http/TopicsHttpClient.java | 2 +-
.../java/org/apache/iggy/topic/Durability.java} | 15 +-
.../java/org/apache/iggy/topic/TopicOptions.java | 37 +-
.../apache/iggy/client/BaseIntegrationTest.java | 2 +-
.../iggy/client/blocking/SystemClientBaseTest.java | 2 +-
.../iggy/client/blocking/TopicsClientBaseTest.java | 12 +-
.../client/blocking/tcp/TopicsTcpClientTest.java | 4 +-
.../iggy/serde/OptionsBlockGoldenVectorTest.java | 16 +-
.../org/apache/iggy/topic/TopicOptionsTest.java | 20 +-
foreign/node/README.md | 18 +-
foreign/node/package-lock.json | 152 +-
foreign/node/package.json | 4 +-
.../node/src/wire/message/send-messages.command.ts | 5 +-
foreign/node/src/wire/options.utils.test.ts | 15 +-
.../src/wire/topic/create-topic.command.test.ts | 42 +-
.../node/src/wire/topic/create-topic.command.ts | 27 +-
foreign/node/src/wire/topic/index.ts | 2 +-
foreign/node/src/wire/topic/topic.utils.ts | 7 +
foreign/php/Cargo.toml | 2 +-
foreign/php/README.md | 44 +-
foreign/php/iggy-php.stubs.php | 15 +-
foreign/php/src/client.rs | 9 +-
.../Auth/AuthResponse.cs => php/src/durability.rs} | 27 +-
foreign/php/src/lib.rs | 2 +
foreign/php/src/send_message.rs | 5 +-
foreign/php/tests/IggySdkTest.php | 62 +
foreign/python/Cargo.toml | 4 +-
foreign/python/README.md | 158 +-
foreign/python/apache_iggy.pyi | 345 +-
foreign/python/pyproject.toml | 2 +-
foreign/python/src/bin/stub_gen.rs | 8 +-
foreign/python/src/client.rs | 338 +-
foreign/python/src/durability.rs | 58 +
foreign/python/src/lib.rs | 15 +-
foreign/python/src/partitioning.rs | 27 +-
foreign/python/src/producer.rs | 1307 ++++
foreign/python/src/send_message.rs | 44 +-
foreign/python/tests/test_partition.py | 228 +
foreign/python/tests/test_producer.py | 1608 +++++
foreign/python/tests/test_topic.py | 21 +-
foreign/python/uv.lock | 40 +-
helm/charts/iggy/README.md | 13 +-
helm/charts/iggy/README.md.gotmpl | 8 +-
helm/charts/iggy/templates/_helpers.tpl | 19 +-
helm/charts/iggy/values.yaml | 4 +
scripts/ci/license-headers.sh | 6 +-
scripts/ci/test-helm.sh | 47 +-
.../performance/run-standard-performance-suite.sh | 53 +-
scripts/performance/utils.sh | 9 +-
scripts/prepare-release.sh | 1 +
scripts/utils.sh | 40 +-
web/README.md | 22 +-
web/package-lock.json | 193 +-
web/package.json | 15 +-
web/src/lib/api/ApiSchema.ts | 7 +-
web/src/lib/components/Breadcrumbs.svelte | 5 +-
.../components/Modals/DeletePartitionsModal.svelte | 2 +-
.../components/Modals/StreamSettingsModal.svelte | 2 +-
.../components/Modals/TopicSettingsModal.svelte | 7 +-
.../src/lib/utils/base64Utils.test.mjs | 27 +-
web/src/lib/utils/base64Utils.ts | 3 +-
.../topics/[topicId=i32]/+page.svelte | 2 +-
529 files changed, 55663 insertions(+), 9851 deletions(-)
create mode 100644 .claude/skills/team-review-slim/SKILL.md
copy core/common/src/types/{cluster/role.rs => options/durability.rs} (53%)
create mode 100644
core/connectors/runtime/example_config/connectors/http_source_github.toml
create mode 100644
core/connectors/runtime/example_config/connectors/http_source_partner.toml
copy core/connectors/sources/{random_source => http_source}/Cargo.toml (80%)
create mode 100644 core/connectors/sources/http_source/README.md
create mode 100644 core/connectors/sources/http_source/config.toml
create mode 100644 core/connectors/sources/http_source/src/auth.rs
create mode 100644 core/connectors/sources/http_source/src/lib.rs
create mode 100644 core/connectors/sources/http_source/src/management.rs
create mode 100644 core/connectors/sources/http_source/src/metrics.rs
create mode 100644 core/connectors/sources/http_source/src/routes.rs
create mode 100644 core/connectors/sources/http_source/src/server.rs
create mode 100644 core/connectors/sources/http_source/src/state.rs
create mode 100644 core/connectors/sources/http_source/src/types.rs
create mode 100644 core/integration/tests/bench.rs
create mode 100644 core/integration/tests/connectors/fixtures/http/source.rs
create mode 100644 core/integration/tests/connectors/http/http_source.rs
copy core/integration/tests/connectors/{random => http}/source.toml (94%)
copy core/{connectors/sources/random_source/config.toml =>
integration/tests/connectors/http/source_config/http_github.toml} (53%)
copy core/{connectors/sources/random_source/config.toml =>
integration/tests/connectors/http/source_config/http_partner.toml} (59%)
copy core/integration/tests/connectors/runtime/{source_invalid_state.toml =>
sink_transform_error.toml} (92%)
copy
core/integration/tests/connectors/runtime/{sink_invalid_config/stdout_valid.toml
=> sink_transform_error_config/stdout.toml} (72%)
create mode 100644 core/integration/tests/server/telemetry.rs
create mode 100644 core/journal/src/durable_storage.rs
create mode 100644 core/journal/src/partition_journal.rs
create mode 100644 core/journal/src/partition_journal/segments.rs
create mode 100644 core/partitions/src/install_backup.rs
create mode 100644 core/partitions/src/persistence.rs
create mode 100644 core/server_common/src/poll.rs
create mode 100644 core/shard/src/poll.rs
create mode 100644 core/shard/src/poll/completion.rs
create mode 100644 core/shard/src/poll/completion_tests.rs
create mode 100644 core/shard/src/poll/test_support.rs
create mode 100644 core/shard/src/poll/timeout_tests.rs
create mode 100644 core/simulator/src/storage.rs
create mode 100644 core/simulator/src/storage/tests.rs
create mode 100644 examples/go/getting-started/consumer/main_test.go
create mode 100644
examples/java/src/test/java/org/apache/iggy/examples/ConsumerOffsetTest.java
create mode 100644
examples/java/src/test/java/org/apache/iggy/examples/MultiTenantAccessTest.java
create mode 100644 examples/node/tests/consumer-offset.test.mjs
create mode 100644 examples/python/high-level/background_producer.py
create mode 100644 examples/python/high-level/consumer.py
create mode 100644 examples/python/high-level/producer.py
create mode 100644 foreign/cpp/src/type_conversions.cpp
copy foreign/csharp/Iggy_SDK/Enums/{Protocol.cs => Durability.cs} (72%)
create mode 100644
foreign/csharp/Iggy_SDK_Tests/ClientTests/ExampleHelpersTests.cs
copy
foreign/java/{bench/src/main/java/org/apache/iggy/bench/common/enums/TransportKind.java
=> java-sdk/src/main/java/org/apache/iggy/topic/Durability.java} (81%)
copy foreign/{csharp/Iggy_SDK/Contracts/Auth/AuthResponse.cs =>
php/src/durability.rs} (64%)
create mode 100644 foreign/python/src/durability.rs
create mode 100644 foreign/python/src/producer.rs
create mode 100644 foreign/python/tests/test_partition.py
create mode 100644 foreign/python/tests/test_producer.py
copy foreign/node/src/wire/command.utils.test.ts =>
web/src/lib/utils/base64Utils.test.mjs (61%)