This is an automated email from the ASF dual-hosted git repository.
marong pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from e2f90e961 [GLUTEN-6072][BUILD] Fix permission denied error when
install AWS SDK (#6073)
add e4388e656 [VL] Enable sort-based shuffle in micro benchmark (#5942)
No new revisions were added by this update.
Summary of changes:
cpp/core/CMakeLists.txt | 1 +
cpp/core/jni/JniWrapper.cc | 18 +-
cpp/core/shuffle/LocalPartitionWriter.cc | 3 +-
cpp/core/shuffle/Partitioner.cc | 3 +
cpp/core/shuffle/Partitioning.cc | 4 +
cpp/core/shuffle/Partitioning.h | 2 +-
cpp/core/shuffle/Payload.cc | 2 +
...undRobinPartitioner.cc => RandomPartitioner.cc} | 12 +-
...RoundRobinPartitioner.h => RandomPartitioner.h} | 17 +-
cpp/velox/CMakeLists.txt | 1 +
cpp/velox/benchmarks/CMakeLists.txt | 2 -
cpp/velox/benchmarks/GenericBenchmark.cc | 445 +++++++++++++--------
cpp/velox/benchmarks/ParquetWriteBenchmark.cc | 2 +-
cpp/velox/benchmarks/ShuffleSplitBenchmark.cc | 394 ------------------
cpp/velox/benchmarks/common/BenchmarkUtils.cc | 23 +-
cpp/velox/benchmarks/common/BenchmarkUtils.h | 13 +-
cpp/velox/benchmarks/common/FileReaderIterator.h | 2 -
.../benchmarks/common/ParquetReaderIterator.h | 2 +-
cpp/velox/compute/VeloxRuntime.cc | 22 +-
cpp/velox/shuffle/VeloxShuffleWriter.cc | 42 ++
cpp/velox/shuffle/VeloxShuffleWriter.h | 9 +
docs/developers/MicroBenchmarks.md | 101 ++++-
22 files changed, 502 insertions(+), 618 deletions(-)
copy cpp/core/shuffle/{RoundRobinPartitioner.cc => RandomPartitioner.cc} (82%)
copy cpp/core/shuffle/{RoundRobinPartitioner.h => RandomPartitioner.h} (77%)
delete mode 100644 cpp/velox/benchmarks/ShuffleSplitBenchmark.cc
create mode 100644 cpp/velox/shuffle/VeloxShuffleWriter.cc
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
