This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/native/main/cc-1.2.52
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
omit a687b72a2 chore(deps): bump cc from 1.2.50 to 1.2.52 in /native
add fbde8b0fb perf: minor optimizations in `process_sorted_row_partition`
(#3059)
add b038ac531 chore: Respect to legacySizeOfNull option for size function
(#3036)
add c112f473d docs: Add documentation to contributor guide explaining
native + JVM shuffle implementation (#3055)
add cf8cba0bc chore: Add PySpark-based benchmarks, starting with ETL
example (#3065)
add b95d38205 chore(deps): bump the proto group in /native with 2 updates
(#3071)
add 710a31e00 chore(deps): bump cc from 1.2.50 to 1.2.52 in /native
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a687b72a2)
\
N -- N -- N refs/heads/dependabot/cargo/native/main/cc-1.2.52
(710a31e00)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
benchmarks/pyspark/README.md | 97 +++++
benchmarks/pyspark/generate_data.py | 446 +++++++++++++++++++++
benchmarks/pyspark/run_all_benchmarks.sh | 118 ++++++
benchmarks/pyspark/run_benchmark.py | 104 +++++
docs/source/contributor-guide/index.md | 2 +
docs/source/contributor-guide/jvm_shuffle.md | 199 +++++++++
docs/source/contributor-guide/native_shuffle.md | 243 +++++++++++
native/Cargo.lock | 31 +-
native/core/Cargo.toml | 2 +-
native/core/src/execution/shuffle/row.rs | 36 +-
native/proto/Cargo.toml | 4 +-
.../main/scala/org/apache/comet/serde/arrays.scala | 37 +-
.../shuffle/CometShuffleExchangeExec.scala | 11 +-
.../apache/comet/CometArrayExpressionSuite.scala | 19 +
14 files changed, 1301 insertions(+), 48 deletions(-)
create mode 100644 benchmarks/pyspark/README.md
create mode 100755 benchmarks/pyspark/generate_data.py
create mode 100755 benchmarks/pyspark/run_all_benchmarks.sh
create mode 100755 benchmarks/pyspark/run_benchmark.py
create mode 100644 docs/source/contributor-guide/jvm_shuffle.md
create mode 100644 docs/source/contributor-guide/native_shuffle.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
