This is an automated email from the ASF dual-hosted git repository.
hongze pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from 9d2fcdeaa [CELEBORN] Fix potential ClassNotFoundException (#6217)
add 529d3f403 [VL] Add a benchmark to track on iterator facility's
performance (#6225)
No new revisions were added by this update.
Summary of changes:
.../backendsapi/velox/VeloxIteratorApi.scala | 3 +-
.../gluten/datasource/ArrowCSVFileFormat.scala | 3 +-
.../gluten/execution/RowToVeloxColumnarExec.scala | 3 +-
.../gluten/execution/VeloxAppendBatchesExec.scala | 3 +-
.../execution/VeloxBroadcastBuildSideRDD.scala | 2 +-
.../gluten/execution/VeloxColumnarToRowExec.scala | 2 +-
.../api/python/ColumnarArrowEvalPythonExec.scala | 3 +-
.../execution/ColumnarCachedBatchSerializer.scala | 3 +-
.../execution/datasources/VeloxWriteQueue.scala | 2 +-
.../scala/org/apache/gluten/utils/Iterators.scala | 228 ---------------------
.../apache/gluten/utils/iterator/Iterators.scala | 53 +++++
.../apache/gluten/utils/iterator/IteratorsV1.scala | 222 ++++++++++++++++++++
.../utils/{ => iterator}/IteratorSuite.scala | 30 +--
.../spark/utils/iterator/IteratorBenchmark.scala | 129 ++++++++++++
.../sql/execution/ColumnarBuildSideRelation.scala | 3 +-
.../spark/sql/execution/utils/ExecUtil.scala | 2 +-
16 files changed, 438 insertions(+), 253 deletions(-)
delete mode 100644
gluten-core/src/main/scala/org/apache/gluten/utils/Iterators.scala
create mode 100644
gluten-core/src/main/scala/org/apache/gluten/utils/iterator/Iterators.scala
create mode 100644
gluten-core/src/main/scala/org/apache/gluten/utils/iterator/IteratorsV1.scala
rename gluten-core/src/test/scala/org/apache/gluten/utils/{ =>
iterator}/IteratorSuite.scala (86%)
create mode 100644
gluten-core/src/test/scala/org/apache/spark/utils/iterator/IteratorBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
