This is an automated email from the ASF dual-hosted git repository.
suyanhanx pushed a change to branch empty-file-test
in repository https://gitbox.apache.org/repos/asf/incubator-opendal.git
omit f11f868d1 fix append close
omit 8a49a6910 fmt
omit 614ec11c1 remove empty file write test
omit 5ce8ce12d fmt
omit 235fd206c test(blocking): tests for blocking append
add 292cd8846 ci(services/tikv): add tikv integration test with tls (#3026)
add 3bced977b refactor: Relax bounds on Writer::{sink, copy} (#3027)
add 8407928cc docs: add service doc for gdrive & onedrive (#3028)
add 40d87937c chore(bindings/cpp): update CMakeLists.txt to prepare
release (#3030)
add 587e2d977 refactor: Refactor oio::Write into poll-based to create more
room for optimization (#3029)
add 4a52ba64c chore: fix typo of SftpWriter error message (#3032)
add bf85c1fd3 refactor: Polish multipart writer to allow oneshot
optimization (#3031)
add 57581b90a feat(service/gdrive): add gdrive list support (#3025)
add 088881f42 refactor: Polish implementation details of WriteBuf and add
vector chunks support (#3034)
add 2b83c710d refactor: Add ChunkedBytes to improve the exact buf write
(#3035)
add 9535d0222 refactor: Polish RangeWrite implementation to remove the
extra buffer logic (#3038)
add fb04515a3 ci: restrict workflow that need password (#3039)
add 082ebca8f feat(services/etcd): Enable etcd connection pool (#3041)
add f9c68be75 fix(services/oss): set content_md5 in lister (#3043)
add fda9670d6 refactor: Remove the requirement of passing `content_length`
to writer (#3044)
add e8f695e36 feat: Add buffer support for all services (#3045)
add 0e0753af4 fix: Correct the name of azdfs to azdls (#3046)
add e895dced5 ci: Don't release while tag contains rc (#3048)
add 56d711907 fix: Don't apply blocking layer when service support
blocking (#3050)
add eae0115cc feat(bindings/java): auto enable blocking layer (#3049)
add 08bf79ba4 test(bindings/java): fix mapped port (#3051)
add 7d5524f35 fix: call `flush` before `sync_all` (#3053)
add 9ac7bb9d8 ci(bindings/java): skip RedisServiceTest on macos and
windows (#3054)
add 459431e30 ci: Disable PHP build temporarily (#3058)
add 91435233e ci(bindings/java): release workflow always uses bash (#3056)
add aad56c48a ci(binding/java): Enable release when OPENDAL_RELEASE is on
(#3057)
add f7e33bf0a ci(binding/java): Use cargo profile instead of --release
(#3059)
add a8518bd47 ci: Move platform build checks from java binding to rust
core (#3060)
add 8175aa35c chore: Polish some details of layers implementation (#3061)
add 12bd76774 docs(services/sftp): update comments about password login
(#3065)
new 2d59e9ae4 test for blocking append & fix fs
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f11f868d1)
\
N -- N -- N refs/heads/empty-file-test (2d59e9ae4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/bindings_c.yml | 1 +
.github/workflows/bindings_cpp.yml | 9 +-
.github/workflows/bindings_java.yml | 23 +-
.github/workflows/bindings_nodejs.yml | 2 +-
.github/workflows/bindings_php.yml | 24 +-
.github/workflows/bindings_python.yml | 2 +-
.github/workflows/ci.yml | 89 ++-
.github/workflows/docs.yml | 2 +-
.github/workflows/publish.yml | 9 +-
.github/workflows/release_java.yml | 24 +-
.github/workflows/service_test_azblob.yml | 2 +-
...rvice_test_azdfs.yml => service_test_azdls.yml} | 20 +-
.github/workflows/service_test_cos.yml | 2 +-
.github/workflows/service_test_dropbox.yml | 2 +-
.github/workflows/service_test_gdrive.yml | 2 +-
.github/workflows/service_test_s3.yml | 2 +-
.github/workflows/service_test_supabase.yml | 2 +-
.github/workflows/service_test_tikv.yml | 68 ++-
.github/workflows/service_test_wasabi.yml | 2 +-
.github/workflows/service_test_webhdfs.yml | 4 +-
.typos.toml | 1 +
README.md | 4 +-
bin/oli/README.md | 2 +-
bin/oli/src/config/mod.rs | 4 +-
bindings/cpp/CMakeLists.txt | 148 +++--
bindings/cpp/CONTRIBUTING.md | 6 +-
bindings/cpp/README.md | 51 +-
bindings/cpp/src/lib.rs | 3 +-
bindings/cpp/src/lister.rs | 3 +-
bindings/cpp/src/reader.rs | 3 +-
bindings/cpp/src/types.rs | 3 +-
bindings/java/Cargo.toml | 94 +++-
bindings/java/pom.xml | 35 +-
bindings/java/src/blocking_operator.rs | 10 +-
bindings/java/src/error.rs | 7 +-
bindings/java/src/metadata.rs | 3 +-
bindings/java/src/operator.rs | 9 +-
.../java/org/apache/opendal/RedisServiceTest.java | 80 +++
bindings/java/tools/build.py | 13 +-
core/Cargo.toml | 6 +-
core/README.md | 4 +-
core/benches/oio/utils.rs | 19 +-
core/benches/oio/write.rs | 2 +-
core/fuzz/fuzz_writer.rs | 2 +-
core/src/layers/blocking.rs | 15 +-
core/src/layers/complete.rs | 602 +++++++++++----------
core/src/layers/concurrent_limit.rs | 12 +-
core/src/layers/error_context.rs | 49 +-
core/src/layers/logging.rs | 49 +-
core/src/layers/madsim.rs | 22 +-
core/src/layers/metrics.rs | 15 +-
core/src/layers/minitrace.rs | 36 +-
core/src/layers/mod.rs | 24 +-
core/src/layers/oteltrace.rs | 45 +-
core/src/layers/prometheus.rs | 15 +-
core/src/layers/retry.rs | 132 +++--
core/src/layers/throttle.rs | 22 +-
core/src/layers/timeout.rs | 103 +++-
core/src/layers/tracing.rs | 12 +-
core/src/layers/type_eraser.rs | 26 +-
core/src/raw/adapters/kv/backend.rs | 135 +++--
core/src/raw/adapters/typed_kv/api.rs | 8 +-
core/src/raw/adapters/typed_kv/backend.rs | 86 ++-
core/src/raw/http_util/body.rs | 4 +
core/src/raw/http_util/client.rs | 1 +
core/src/raw/http_util/multipart.rs | 1 +
core/src/raw/oio/buf/chunked_bytes.rs | 521 ++++++++++++++++++
core/src/{services/cos => raw/oio/buf}/mod.rs | 10 +-
core/src/raw/oio/{buf.rs => buf/write_buf.rs} | 197 ++++---
core/src/raw/oio/cursor.rs | 560 -------------------
core/src/raw/oio/mod.rs | 4 +-
core/src/raw/oio/page/api.rs | 9 +-
core/src/raw/oio/read/cloneable_read.rs | 11 +-
core/src/raw/oio/read/into_read_from_stream.rs | 12 +-
core/src/raw/oio/write/api.rs | 123 ++++-
core/src/raw/oio/write/append_object_write.rs | 97 ++--
core/src/raw/oio/write/compose_write.rs | 45 +-
core/src/raw/oio/write/exact_buf_write.rs | 105 +---
core/src/raw/oio/write/mod.rs | 5 +
core/src/raw/oio/write/multipart_upload_write.rs | 274 ++++++++--
core/src/raw/oio/write/one_shot_write.rs | 92 +++-
core/src/raw/oio/write/range_write.rs | 286 ++++++++++
core/src/raw/ops.rs | 35 +-
core/src/services/azblob/backend.rs | 15 +-
core/src/services/azblob/core.rs | 15 +-
core/src/services/azblob/writer.rs | 100 +---
core/src/services/{azdfs => azdls}/backend.rs | 107 ++--
core/src/services/{azdfs => azdls}/core.rs | 28 +-
core/src/services/{azdfs => azdls}/docs.md | 12 +-
core/src/services/{azdfs => azdls}/error.rs | 12 +-
core/src/services/{azdfs => azdls}/mod.rs | 2 +-
core/src/services/{azdfs => azdls}/pager.rs | 20 +-
core/src/services/{azdfs => azdls}/writer.rs | 42 +-
core/src/services/cos/backend.rs | 34 +-
core/src/services/cos/writer.rs | 19 +-
core/src/services/dropbox/backend.rs | 14 +-
core/src/services/dropbox/writer.rs | 20 +-
core/src/services/etcd/backend.rs | 52 +-
core/src/services/fs/backend.rs | 50 +-
core/src/services/fs/writer.rs | 124 +++--
core/src/services/ftp/backend.rs | 20 +-
core/src/services/ftp/writer.rs | 25 +-
core/src/services/gcs/backend.rs | 47 +-
core/src/services/gcs/core.rs | 32 +-
core/src/services/gcs/writer.rs | 134 ++---
core/src/services/gdrive/backend.rs | 31 +-
core/src/services/gdrive/builder.rs | 69 +--
core/src/services/gdrive/core.rs | 65 ++-
core/src/services/gdrive/docs.md | 65 +++
core/src/services/gdrive/error.rs | 32 +-
core/src/services/gdrive/mod.rs | 1 +
core/src/services/gdrive/pager.rs | 102 ++++
core/src/services/gdrive/writer.rs | 33 +-
core/src/services/ghac/backend.rs | 9 +-
core/src/services/ghac/writer.rs | 143 +++--
core/src/services/hdfs/writer.rs | 25 +-
core/src/services/ipmfs/backend.rs | 19 +-
core/src/services/ipmfs/writer.rs | 22 +-
core/src/services/mod.rs | 8 +-
core/src/services/obs/backend.rs | 34 +-
core/src/services/obs/writer.rs | 19 +-
core/src/services/onedrive/backend.rs | 11 +-
core/src/services/onedrive/builder.rs | 46 +-
core/src/services/{ftp => onedrive}/docs.md | 24 +-
core/src/services/onedrive/writer.rs | 19 +-
core/src/services/oss/backend.rs | 34 +-
core/src/services/oss/pager.rs | 1 +
core/src/services/oss/writer.rs | 19 +-
core/src/services/s3/backend.rs | 34 +-
core/src/services/s3/writer.rs | 16 +-
core/src/services/sftp/backend.rs | 3 +-
core/src/services/sftp/docs.md | 5 +-
core/src/services/sftp/writer.rs | 37 +-
core/src/services/supabase/backend.rs | 11 +-
core/src/services/supabase/writer.rs | 34 +-
core/src/services/tikv/fixtures/gen_cert.sh | 85 +++
.../tikv/fixtures/{pd.toml => pd-tls.toml} | 9 +
core/src/services/tikv/fixtures/ssl/ca-key.pem | 27 +
core/src/services/tikv/fixtures/ssl/ca.pem | 22 +
core/src/services/tikv/fixtures/ssl/client-key.pem | 27 +
core/src/services/tikv/fixtures/ssl/client.pem | 21 +
.../services/tikv/fixtures/ssl/pd-server-key.pem | 27 +
core/src/services/tikv/fixtures/ssl/pd-server.pem | 21 +
.../services/tikv/fixtures/ssl/tikv-server-key.pem | 27 +
.../src/services/tikv/fixtures/ssl/tikv-server.pem | 22 +
.../tikv/fixtures/{tikv.toml => tikv-tls.toml} | 9 +
core/src/services/vercel_artifacts/backend.rs | 15 +-
core/src/services/vercel_artifacts/writer.rs | 28 +-
core/src/services/wasabi/backend.rs | 11 +-
core/src/services/wasabi/writer.rs | 21 +-
core/src/services/webdav/backend.rs | 14 +-
core/src/services/webdav/writer.rs | 32 +-
core/src/services/webhdfs/backend.rs | 11 +-
core/src/services/webhdfs/writer.rs | 22 +-
core/src/types/capability.rs | 83 +--
core/src/types/operator/blocking_operator.rs | 2 +-
core/src/types/operator/builder.rs | 4 +-
core/src/types/operator/operator.rs | 6 +-
core/src/types/operator/operator_functions.rs | 28 +-
core/src/types/operator/operator_futures.rs | 50 +-
core/src/types/scheme.rs | 12 +-
core/src/types/writer.rs | 249 ++-------
core/tests/behavior/main.rs | 4 +-
core/tests/behavior/utils.rs | 9 +-
core/tests/behavior/write.rs | 21 +-
.../index.md | 2 +-
website/docs/services/{azdfs.mdx => azdls.mdx} | 10 +-
website/docs/services/{dropbox.mdx => gdrive.mdx} | 13 +-
.../docs/services/{dropbox.mdx => onedrive.mdx} | 13 +-
.../HomepageFeatures/_feature_services.mdx | 2 +-
170 files changed, 4424 insertions(+), 3033 deletions(-)
rename .github/workflows/{service_test_azdfs.yml => service_test_azdls.yml}
(75%)
create mode 100644
bindings/java/src/test/java/org/apache/opendal/RedisServiceTest.java
create mode 100644 core/src/raw/oio/buf/chunked_bytes.rs
copy core/src/{services/cos => raw/oio/buf}/mod.rs (88%)
rename core/src/raw/oio/{buf.rs => buf/write_buf.rs} (54%)
create mode 100644 core/src/raw/oio/write/range_write.rs
rename core/src/services/{azdfs => azdls}/backend.rs (82%)
rename core/src/services/{azdfs => azdls}/core.rs (94%)
rename core/src/services/{azdfs => azdls}/docs.md (75%)
rename core/src/services/{azdfs => azdls}/error.rs (92%)
rename core/src/services/{azdfs => azdls}/mod.rs (95%)
rename core/src/services/{azdfs => azdls}/pager.rs (92%)
rename core/src/services/{azdfs => azdls}/writer.rs (70%)
create mode 100644 core/src/services/gdrive/docs.md
create mode 100644 core/src/services/gdrive/pager.rs
copy core/src/services/{ftp => onedrive}/docs.md (55%)
create mode 100755 core/src/services/tikv/fixtures/gen_cert.sh
copy core/src/services/tikv/fixtures/{pd.toml => pd-tls.toml} (64%)
create mode 100644 core/src/services/tikv/fixtures/ssl/ca-key.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/ca.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/client-key.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/client.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/pd-server-key.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/pd-server.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/tikv-server-key.pem
create mode 100644 core/src/services/tikv/fixtures/ssl/tikv-server.pem
copy core/src/services/tikv/fixtures/{tikv.toml => tikv-tls.toml} (70%)
rename website/docs/services/{azdfs.mdx => azdls.mdx} (87%)
copy website/docs/services/{dropbox.mdx => gdrive.mdx} (77%)
copy website/docs/services/{dropbox.mdx => onedrive.mdx} (77%)
