This is an automated email from the ASF dual-hosted git repository.
zhouyuan pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/gluten.git
The following commit(s) were added to refs/heads/main by this push:
new a8bf7ea290 [MINOR] Fix typo in shuffleInputOutput config name (#12239)
a8bf7ea290 is described below
commit a8bf7ea290d7c432470ede5f98dc623cc58239f6
Author: Shilong Duan <[email protected]>
AuthorDate: Fri Jun 5 16:29:03 2026 +0800
[MINOR] Fix typo in shuffleInputOutput config name (#12239)
This PR fixes a typo in the Velox backend configuration key:
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOuptut.minSize
is renamed to:
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOutput.minSize
---
.../src/main/scala/org/apache/gluten/config/VeloxConfig.scala | 2 +-
docs/velox-configuration.md | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git
a/backends-velox/src/main/scala/org/apache/gluten/config/VeloxConfig.scala
b/backends-velox/src/main/scala/org/apache/gluten/config/VeloxConfig.scala
index 52c964dfe2..0e9c22154e 100644
--- a/backends-velox/src/main/scala/org/apache/gluten/config/VeloxConfig.scala
+++ b/backends-velox/src/main/scala/org/apache/gluten/config/VeloxConfig.scala
@@ -372,7 +372,7 @@ object VeloxConfig extends ConfigRegistry {
.createOptional
val COLUMNAR_VELOX_RESIZE_BATCHES_SHUFFLE_INPUT_OUTPUT_MIN_SIZE =
-
buildConf("spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOuptut.minSize")
+
buildConf("spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOutput.minSize")
.doc(
s"The minimum batch size for shuffle input and output. " +
s"If size of an input batch is " +
diff --git a/docs/velox-configuration.md b/docs/velox-configuration.md
index 7f72729956..952a6c7f9c 100644
--- a/docs/velox-configuration.md
+++ b/docs/velox-configuration.md
@@ -63,7 +63,7 @@ nav_order: 16
| spark.gluten.sql.columnar.backend.velox.resizeBatches.copyRanges.enabled
| 🔄 Dynamic | true | Enables a VeloxResizeBatchesExec fast
path that combines eligible batches using Velox vector copyRanges instead of
generic RowVector append. When possible, it collects the small input batches
for one VeloxResizeBatchesExec output, allocates the output RowVector once, and
bulk-copies child vector ranges. This is most useful for shuffle-read outputs
where plain hash shuff [...]
| spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInput
| 🔄 Dynamic | true | If true, combine small columnar
batches together before sending to shuffle. The default minimum output batch
size is equal to 0.25 * spark.gluten.sql.columnar.maxBatchSize
[...]
| spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInput.minSize
| 🔄 Dynamic | <undefined> | The minimum batch size for shuffle. If
size of an input batch is smaller than the value, it will be combined with
other batches before sending to shuffle. Only functions when
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInput is set to
true. Default value: 0.25 * <max batch size>
[...]
-|
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOuptut.minSize
| 🔄 Dynamic | <undefined> | The minimum batch size for shuffle input
and output. If size of an input batch is smaller than the value, it will be
combined with other batches before sending to shuffle. The same applies for
batches output by shuffle read. Only functions when
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInput or
spark.gluten.sql.columnar.backend.velox.resizeBatches.shu [...]
+|
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInputOutput.minSize
| 🔄 Dynamic | <undefined> | The minimum batch size for shuffle input
and output. If size of an input batch is smaller than the value, it will be
combined with other batches before sending to shuffle. The same applies for
batches output by shuffle read. Only functions when
spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleInput or
spark.gluten.sql.columnar.backend.velox.resizeBatches.shu [...]
| spark.gluten.sql.columnar.backend.velox.resizeBatches.shuffleOutput
| 🔄 Dynamic | false | If true, combine small columnar
batches together right after shuffle read. The default minimum output batch
size is equal to 0.25 * spark.gluten.sql.columnar.maxBatchSize
[...]
| spark.gluten.sql.columnar.backend.velox.showTaskMetricsWhenFinished
| 🔄 Dynamic | false | Show velox full task metrics when
finished.
[...]
| spark.gluten.sql.columnar.backend.velox.spillFileSystem
| 🔄 Dynamic | local | The filesystem used to store spill
data. local: The local file system. heap-over-local: Write file to JVM heap if
having extra heap space. Otherwise write to local file system.
[...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
