This is an automated email from the ASF dual-hosted git repository.
hubcio pushed a change to branch send_messages_confirmation
in repository https://gitbox.apache.org/repos/asf/iggy.git
omit a105a91d0 docs(sdk): state plainly that the legacy server sends no
confirmation
omit 8d80e5d15 ci(repo): lint foreign Rust crates and fix the
license-header scan
omit 1dc44d742 test(integration): assert the legacy server reports no
confirmations
omit ffc3809c3 fix(sdk): drop the fabricated send confirmation from foreign
clients
omit 64bc9b18c fix(server-ng): stop confirming sends that never committed
omit e3ec3382e feat(server-ng): confirm committed sends with partition and
offset
add 75a2fa286 feat(connectors): retry transient Doris Stream Load failures
in-request (#3574)
add ddead57af fix(ci): make README CLI preflight execute its commands
(#3792)
add e2bbaea1c ci(rust): skip unnecessary setup steps (#3749)
add a684e550f feat(python): add user header and origin timestamp support
(#3613)
add 3ca8695d3 feat(connectors): add Meilisearch sink connector (#3497)
add 54d8a49dd feat(server-ng): close the partition materialisation race at
the owner (#3786)
add 198364f22 chore(deps): Bump the web group across 1 directory with 16
updates (#3807)
add 4199fed86 chore(deps): Bump fast-uri from 3.1.4 to 3.1.5 in
/foreign/node (#3812)
add e4e25648b chore(deps): Bump the csharp group with 1 update (#3810)
add b452d150d fix(node): TLS + VSR connection support (#3813)
add c51b75456 perf(server-ng): cap sealed-segment read handles with
per-partition LRU (#3806)
add 60b878923 perf(server-ng): compute batch checksum in a single produce
pass (#3746)
add fb1473a6c feat(server-ng): confirm committed sends with partition and
offset
add 4864bf0e0 fix(server-ng): stop confirming sends that never committed
add 3ffaa1456 fix(sdk): drop the fabricated send confirmation from foreign
clients
add b3bbf49f4 test(integration): assert the legacy server reports no
confirmations
add 3abe29155 ci(repo): lint foreign Rust crates and fix the
license-header scan
add 3b65df37a docs(sdk): state plainly that the legacy server sends no
confirmation
add eaffb0247 chore(repo): bump sdk, common, binary_protocol, server-ng,
node, python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a105a91d0)
\
N -- N -- N refs/heads/send_messages_confirmation (eaffb0247)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/actions/rust/pre-merge/action.yml | 6 +
.../actions/utils/setup-rust-with-cache/action.yml | 14 +-
.github/workflows/coverage-baseline.yml | 1 +
Cargo.lock | 98 +-
Cargo.toml | 12 +-
bdd/python/uv.lock | 2 +-
core/binary_protocol/Cargo.toml | 2 +-
core/common/Cargo.toml | 2 +-
core/connectors/README.md | 1 +
.../example_config/connectors/doris_sink.toml | 9 +
core/connectors/sinks/README.md | 1 +
core/connectors/sinks/doris_sink/README.md | 31 +-
core/connectors/sinks/doris_sink/config.toml | 9 +
core/connectors/sinks/doris_sink/src/lib.rs | 901 ++++++++++--
.../Cargo.toml | 14 +-
core/connectors/sinks/meilisearch_sink/README.md | 105 ++
.../config.toml | 18 +-
core/connectors/sinks/meilisearch_sink/src/lib.rs | 1412 ++++++++++++++++++
core/integration/tests/cluster/mod.rs | 1 +
.../cluster/multi_shard_partition_convergence.rs | 223 +++
.../tests/connectors/doris/doris_sink.rs | 9 +-
.../connectors/fixtures/meilisearch/container.rs | 180 +++
.../fixtures/{quickwit => meilisearch}/mod.rs | 4 +-
.../tests/connectors/fixtures/meilisearch/sink.rs | 90 ++
core/integration/tests/connectors/fixtures/mod.rs | 2 +
.../connectors/meilisearch/meilisearch_sink.rs | 81 ++
.../tests/connectors/{delta => meilisearch}/mod.rs | 2 +-
.../connectors/{delta => meilisearch}/sink.toml | 2 +-
core/integration/tests/connectors/mod.rs | 1 +
core/metadata/src/stm/stream.rs | 16 +-
core/partitions/src/iggy_index_reader.rs | 180 ++-
core/partitions/src/iggy_partition.rs | 566 +++++++-
core/partitions/src/iggy_partitions.rs | 23 +-
core/partitions/src/journal.rs | 13 +-
core/partitions/src/log.rs | 341 ++++-
core/partitions/src/poll_plan.rs | 212 ++-
core/sdk/Cargo.toml | 2 +-
core/sdk/src/prelude.rs | 6 +-
core/server-ng/Cargo.toml | 9 +-
core/server-ng/config.toml | 3 +-
core/server-ng/src/dispatch.rs | 76 +-
core/server-ng/src/partition_reconciler.rs | 1531 +++++++++++++++++++-
core/server-ng/src/responses.rs | 2 +-
core/server_common/src/send_messages2.rs | 987 +++++++++++--
core/shard/src/lib.rs | 835 ++++++++++-
core/shard/src/metrics.rs | 139 +-
core/shard/src/router.rs | 40 +-
core/simulator/src/client.rs | 4 +-
core/simulator/src/lib.rs | 17 +
examples/java/README.md | 2 +-
examples/node/README.md | 2 +-
examples/python/README.md | 23 +
examples/python/basic/producer.py | 50 +-
examples/python/getting-started/producer.py | 50 +-
examples/python/message-headers/common.py | 240 +++
.../message-headers/plain-headers/consumer.py | 77 +
.../message-headers/plain-headers/producer.py | 59 +
.../message-headers/typed-headers/consumer.py | 77 +
.../message-headers/typed-headers/producer.py | 64 +
examples/python/pyproject.toml | 5 +
examples/python/uv.lock | 2 +-
examples/rust/README.md | 2 +-
examples/rust/src/tcp-tls/consumer/main.rs | 2 +-
examples/rust/src/tcp-tls/producer/main.rs | 2 +-
foreign/csharp/Directory.Packages.props | 2 +-
foreign/node/README.md | 6 +-
foreign/node/package-lock.json | 655 ++++-----
foreign/node/package.json | 2 +-
foreign/node/src/client/client.config.test.ts | 19 +-
foreign/node/src/client/client.config.ts | 3 -
foreign/node/src/client/client.socket.test.ts | 50 +-
foreign/node/src/e2e/tls.system.e2e.ts | 4 +
foreign/python/Cargo.toml | 5 +-
foreign/python/Dockerfile.test | 2 +-
foreign/python/apache_iggy.pyi | 397 ++++-
foreign/python/docker-compose.test.yml | 11 +-
foreign/python/pyproject.toml | 2 +-
foreign/python/src/lib.rs | 5 +
foreign/python/src/receive_message.rs | 26 +
foreign/python/src/send_message.rs | 41 +-
foreign/python/src/user_headers.rs | 791 ++++++++++
foreign/python/tests/test_consumer_group.py | 98 ++
foreign/python/tests/test_message_operations.py | 402 ++++-
foreign/python/uv.lock | 2 +-
scripts/ci/python-sdk-version-sync.sh | 2 +-
scripts/ci/sync-python-interpreter-version.sh | 2 +-
scripts/ci/sync-rustc-version.sh | 2 +-
scripts/ci/third-party-licenses.sh | 2 +-
scripts/ci/uv-lock-check.sh | 2 +-
scripts/run-examples-from-readme.sh | 31 +-
scripts/utils.sh | 8 +-
web/package-lock.json | 613 ++++----
web/package.json | 30 +-
93 files changed, 10765 insertions(+), 1342 deletions(-)
copy core/connectors/sinks/{surrealdb_sink => meilisearch_sink}/Cargo.toml
(84%)
create mode 100644 core/connectors/sinks/meilisearch_sink/README.md
copy core/connectors/sinks/{elasticsearch_sink =>
meilisearch_sink}/config.toml (77%)
create mode 100644 core/connectors/sinks/meilisearch_sink/src/lib.rs
create mode 100644
core/integration/tests/cluster/multi_shard_partition_convergence.rs
create mode 100644
core/integration/tests/connectors/fixtures/meilisearch/container.rs
copy core/integration/tests/connectors/fixtures/{quickwit =>
meilisearch}/mod.rs (89%)
create mode 100644
core/integration/tests/connectors/fixtures/meilisearch/sink.rs
create mode 100644
core/integration/tests/connectors/meilisearch/meilisearch_sink.rs
copy core/integration/tests/connectors/{delta => meilisearch}/mod.rs (97%)
copy core/integration/tests/connectors/{delta => meilisearch}/sink.toml (94%)
create mode 100644 examples/python/message-headers/common.py
create mode 100644 examples/python/message-headers/plain-headers/consumer.py
create mode 100644 examples/python/message-headers/plain-headers/producer.py
create mode 100644 examples/python/message-headers/typed-headers/consumer.py
create mode 100644 examples/python/message-headers/typed-headers/producer.py
create mode 100644 foreign/python/src/user_headers.rs
