This is an automated email from the ASF dual-hosted git repository.
prantogg pushed a change to branch pranav/add-s3-write-support
in repository https://gitbox.apache.org/repos/asf/sedona-spatialbench.git
from 51b63a1 feat: add s3 write support
add e35711c Prepare the project for 0.1.0 release (#66)
add 8ca864a docs: add uncompressed data sizes of tables (#68)
add 02be703 Fix the failed Python build (#69)
add adb867c feature: add a benchmark github action to compare a few
spatial lib (#72)
add b68b814 feature: Add Spatial Polars to the automated benchmark
framework (#73)
add 8342248 fix: Update docs and readme (#74)
add b79630f spatial polars Q11 query fix (#75)
add ae57d71 feature: Add DuckDB and SedonaDB nightly support (#76)
add 8331bb7 [CI] Add pre-commit with basic checks (#77)
add a48d3ee misc: fix typos (#78)
add 593ca69 misc: fix spelling (#81)
add 8ddbc1b Update `.asf.yaml` clean up `collaborators` list (#85)
add 9dc2391 [CI] Add Dependabot config for `github-actions` ecosystem
(#84)
add e681aa7 [CI] Add pre-commit hook to trim trailing whitespace (#79)
add 7499d13 Add basic EditorConfig file (#80)
add 8e7d954 Bump the github-dependencies group across 1 directory with 5
updates (#87)
add 426338b Unify navigation bar and theme with main Apache Sedona site
(#88)
add f734d86 Merge branch 'main' into pranav/add-s3-write-support
add 13ae2bd fix: add license header to s3_writer.rs and fix typo in
plan.rs
add aa2c0c5 fix: skip local dir creation for S3 output paths
add 85e571c refactor: use from_env() and share S3 client across files
add 08ec40f refactor: unify S3 and local write paths
add 2f99044 feat: stream multipart uploads instead of buffering in memory
add f6c859f feat: add S3 write support to zone table generation
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 4 +-
rust-toolchain.toml => .editorconfig | 16 +-
rust-toolchain.toml => .github/dependabot.yml | 19 +-
.github/workflows/benchmark.yml | 461 +++++++++++++++
.github/workflows/build-py-packages.yml | 46 +-
.github/workflows/packaging.yml | 12 +-
.github/workflows/pre-commit.yml | 53 ++
.github/workflows/rust.yml | 12 +-
.../workflows/spatialbench-cli-publish-pypi.yml | 6 +-
.github/workflows/spatialbench-publish-crates.yml | 4 +-
.gitignore | 2 +-
.pre-commit-config.yaml | 95 +++
ARCHITECTURE.md | 2 +-
CONTRIBUTING.md | 2 +-
Cargo.toml | 3 +-
LICENSE | 2 +-
README.md | 36 +-
benchmark/run_benchmark.py | 649 ++++++++++++++++++++
benchmark/summarize_results.py | 314 ++++++++++
dev/release/README.md | 173 ++++--
dev/release/check-rat-report.py | 1 -
dev/release/rat_exclude_files.txt | 21 +-
dev/release/run-rat.sh | 17 +-
dev/release/sign-assets.sh | 149 -----
dev/release/upload-candidate.sh | 84 ---
dev/release/upload-release.sh | 55 --
dev/release/verify-release-candidate.sh | 27 +-
docs/contributors-guide.md | 4 +-
docs/datasets-generators.md | 14 +
docs/image/footer/logo-footer.svg | 10 +
docs/image/header/logo-mobile.svg | 10 +
docs/image/logo.svg | 10 +
docs/index.md | 11 +
docs/javascripts/katex.js | 2 +-
docs/overrides/main.html | 83 +++
docs/overrides/partials/copyright.html | 29 +
docs/overrides/partials/footer.html | 42 ++
docs/overrides/partials/header.html | 126 ++++
docs/overrides/partials/nav.html | 56 ++
docs/queries.md | 1 -
docs/quickstart.md | 7 +-
docs/requirements.txt | 4 -
docs/single-node-benchmarks.md | 36 +-
docs/stylesheets/extra.css | 359 +++++++++--
mkdocs.yml | 14 +-
raster/generator.py | 19 +-
spatialbench-arrow/Cargo.toml | 26 +-
spatialbench-arrow/README.md | 29 +-
spatialbench-arrow/src/building.rs | 19 +-
spatialbench-arrow/src/conversions.rs | 19 +-
spatialbench-arrow/src/customer.rs | 19 +-
spatialbench-arrow/src/driver.rs | 19 +-
spatialbench-arrow/src/lib.rs | 17 +
spatialbench-arrow/src/trip.rs | 19 +-
spatialbench-arrow/src/vehicle.rs | 19 +-
spatialbench-arrow/tests/reparse.rs | 19 +-
spatialbench-cli/Cargo.toml | 25 +-
spatialbench-cli/src/csv.rs | 17 +
spatialbench-cli/src/generate.rs | 100 +---
spatialbench-cli/src/main.rs | 57 +-
spatialbench-cli/src/output_plan.rs | 62 +-
spatialbench-cli/src/parquet.rs | 109 +---
spatialbench-cli/src/plan.rs | 21 +-
spatialbench-cli/src/runner.rs | 40 +-
spatialbench-cli/src/s3_writer.rs | 442 ++++++++++----
spatialbench-cli/src/spatial_config_file.rs | 17 +
spatialbench-cli/src/statistics.rs | 17 +
spatialbench-cli/src/tbl.rs | 17 +
spatialbench-cli/src/zone/config.rs | 35 ++
spatialbench-cli/src/zone/datasource.rs | 17 +
spatialbench-cli/src/zone/main.rs | 17 +
spatialbench-cli/src/zone/mod.rs | 21 +-
spatialbench-cli/src/zone/partition.rs | 17 +
spatialbench-cli/src/zone/stats.rs | 17 +
spatialbench-cli/src/zone/transform.rs | 17 +
spatialbench-cli/src/zone/writer.rs | 63 +-
spatialbench-cli/tests/cli_integration.rs | 17 +
spatialbench-config.yml | 2 +-
.../geopandas_queries.py | 4 +-
.../print_queries.py | 11 +-
.../spatial_polars.py | 35 +-
spatialbench/Cargo.toml | 21 +-
spatialbench/data/README.md | 23 +-
spatialbench/src/csv.rs | 17 +
spatialbench/src/dates.rs | 17 +
spatialbench/src/decimal.rs | 17 +
spatialbench/src/distribution.rs | 23 +-
spatialbench/src/dists.dss | 28 +-
spatialbench/src/generators.rs | 19 +-
spatialbench/src/kde.rs | 17 +
spatialbench/src/lib.rs | 17 +
spatialbench/src/q_and_a/answers_sf1.rs | 655 +++++++++++----------
spatialbench/src/q_and_a/mod.rs | 17 +
spatialbench/src/q_and_a/queries.rs | 17 +
spatialbench/src/random.rs | 19 +-
spatialbench/src/spatial/cache.rs | 17 +
spatialbench/src/spatial/config.rs | 17 +
spatialbench/src/spatial/defaults.rs | 17 +
spatialbench/src/spatial/distributions.rs | 17 +
spatialbench/src/spatial/generator.rs | 17 +
spatialbench/src/spatial/geometry.rs | 17 +
spatialbench/src/spatial/mod.rs | 17 +
spatialbench/src/spatial/overrides.rs | 17 +
spatialbench/src/spatial/utils/affine.rs | 17 +
spatialbench/src/spatial/utils/antimeridian.rs | 17 +
spatialbench/src/spatial/utils/continent.rs | 17 +
spatialbench/src/spatial/utils/mod.rs | 17 +
spatialbench/src/spatial/utils/random.rs | 17 +
spatialbench/src/text.rs | 17 +
spatialbench/tests/geometry_tests.rs | 17 +
spatialbench/tests/integration_tests.rs | 17 +
111 files changed, 4463 insertions(+), 1220 deletions(-)
copy rust-toolchain.toml => .editorconfig (66%)
copy rust-toolchain.toml => .github/dependabot.yml (75%)
create mode 100644 .github/workflows/benchmark.yml
create mode 100644 .github/workflows/pre-commit.yml
create mode 100644 .pre-commit-config.yaml
create mode 100755 benchmark/run_benchmark.py
create mode 100755 benchmark/summarize_results.py
delete mode 100755 dev/release/sign-assets.sh
delete mode 100755 dev/release/upload-candidate.sh
delete mode 100755 dev/release/upload-release.sh
create mode 100644 docs/image/footer/logo-footer.svg
create mode 100644 docs/image/header/logo-mobile.svg
create mode 100644 docs/image/logo.svg
create mode 100644 docs/overrides/main.html
create mode 100644 docs/overrides/partials/copyright.html
create mode 100644 docs/overrides/partials/footer.html
create mode 100644 docs/overrides/partials/header.html
create mode 100644 docs/overrides/partials/nav.html
rename geopandas.py => spatialbench-queries/geopandas_queries.py (99%)
rename print_queries.py => spatialbench-queries/print_queries.py (96%)
rename spatial_polars.py => spatialbench-queries/spatial_polars.py (96%)
