This is an automated email from the ASF dual-hosted git repository.
hongze pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 201f322b0 [VL] Remove docs about threshold-based spill
201f322b0 is described below
commit 201f322b0e8495e277237672f286828d683600a4
Author: Hongze Zhang <[email protected]>
AuthorDate: Fri Mar 22 10:42:15 2024 +0800
[VL] Remove docs about threshold-based spill
---
docs/get-started/Velox.md | 3 ---
1 file changed, 3 deletions(-)
diff --git a/docs/get-started/Velox.md b/docs/get-started/Velox.md
index 8a9001310..acaf9f798 100644
--- a/docs/get-started/Velox.md
+++ b/docs/get-started/Velox.md
@@ -345,9 +345,6 @@ Using the following configuration options to customize
spilling:
| spark.gluten.sql.columnar.backend.velox.aggregationSpillEnabled |
true | Whether spill is enabled on aggregations
|
| spark.gluten.sql.columnar.backend.velox.joinSpillEnabled |
true | Whether spill is enabled on joins
|
| spark.gluten.sql.columnar.backend.velox.orderBySpillEnabled |
true | Whether spill is enabled on sorts
|
-| spark.gluten.sql.columnar.backend.velox.aggregationSpillMemoryThreshold | 0
| Memory limit before spilling to disk for aggregations, per Spark
task. Unit: byte
|
-| spark.gluten.sql.columnar.backend.velox.joinSpillMemoryThreshold | 0
| Memory limit before spilling to disk for joins, per Spark task.
Unit: byte
|
-| spark.gluten.sql.columnar.backend.velox.orderBySpillMemoryThreshold | 0
| Memory limit before spilling to disk for sorts, per Spark task.
Unit: byte
|
| spark.gluten.sql.columnar.backend.velox.maxSpillLevel | 4
| The max allowed spilling level with zero being the initial
spilling level
|
| spark.gluten.sql.columnar.backend.velox.maxSpillFileSize |
20MB | The max allowed spill file size. If it is zero, then there is
no limit
|
| spark.gluten.sql.columnar.backend.velox.minSpillRunSize |
268435456 | The min spill run size limit used to select partitions for
spilling
|
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
