This is an automated email from the ASF dual-hosted git repository.
marong pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from 90961bc90 [VL] RAS: Optimize offload rule code to gain better
compatibility with rewrite rules (#5836)
add fbb4ec588 [VL] Enable local sort-based shuffle (#5811)
No new revisions were added by this update.
Summary of changes:
.../backendsapi/clickhouse/CHMetricsApi.scala | 3 ++-
.../clickhouse/CHSparkPlanExecApi.scala | 6 +++--
.../gluten/backendsapi/velox/VeloxMetricsApi.scala | 18 ++++++++++-----
.../backendsapi/velox/VeloxSparkPlanExecApi.scala | 22 +++++++++++-------
cpp/core/jni/JniWrapper.cc | 3 ---
cpp/core/shuffle/LocalPartitionWriter.cc | 26 +++++++++++++++++-----
cpp/core/shuffle/LocalPartitionWriter.h | 2 ++
cpp/core/shuffle/Payload.cc | 4 ++++
cpp/core/shuffle/Payload.h | 2 +-
cpp/core/shuffle/ShuffleReader.cc | 4 ----
cpp/core/shuffle/ShuffleReader.h | 1 -
cpp/core/shuffle/Spill.cc | 3 +++
cpp/velox/shuffle/VeloxShuffleReader.cc | 26 ++++++----------------
cpp/velox/shuffle/VeloxShuffleReader.h | 10 ++++-----
cpp/velox/shuffle/VeloxSortBasedShuffleWriter.cc | 3 ---
cpp/velox/tests/VeloxShuffleWriterTest.cc | 2 ++
cpp/velox/utils/tests/VeloxShuffleWriterTestBase.h | 3 +--
docs/Configuration.md | 3 ++-
.../org/apache/gluten/backendsapi/MetricsApi.scala | 4 +++-
.../gluten/backendsapi/SparkPlanExecApi.scala | 8 +++++--
.../spark/shuffle/ColumnarShuffleDependency.scala | 3 ++-
.../spark/shuffle/GlutenShuffleWriterWrapper.scala | 15 ++++++++++---
.../execution/ColumnarShuffleExchangeExec.scala | 19 +++++++++++-----
.../gluten/vectorized/ShuffleReaderMetrics.java | 9 --------
.../gluten/vectorized/ShuffleWriterJniWrapper.java | 5 +++--
.../vectorized/ColumnarBatchSerializer.scala | 26 +++++++++++++---------
.../spark/shuffle/ColumnarShuffleWriter.scala | 12 +++++++---
.../apache/spark/shuffle/utils/ShuffleUtil.scala | 3 ++-
.../spark/sql/execution/utils/ExecUtil.scala | 6 +++--
.../gluten/uniffle/UniffleShuffleManager.java | 5 ++++-
.../writer/VeloxUniffleColumnarShuffleWriter.java | 7 ++++--
.../scala/org/apache/gluten/GlutenConfig.scala | 10 +++++++++
32 files changed, 168 insertions(+), 105 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
