This is an automated email from the ASF dual-hosted git repository.
pan3793 pushed a commit to branch branch-4.x
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.x by this push:
new 6c544491073a [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle
config version
6c544491073a is described below
commit 6c544491073a44ef66dd1acc2eba3513cd1da6bd
Author: Chao Sun <[email protected]>
AuthorDate: Fri Jun 12 11:28:53 2026 +0800
[SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
## Why are the changes needed?
`spark.sql.shuffle.spreadNullJoinKeys.enabled` was introduced on the Spark
4.3 development line, but its configuration metadata incorrectly says that it
was introduced in Spark 4.1.0.
This follow-up addresses the review comment on apache/spark#55927 so the
documented version matches the first Spark release that contains the
configuration.
## What changes were proposed in this PR?
Update the configuration's `version` metadata from `4.1.0` to `4.3.0`.
## How was this PR tested?
- Ran `git diff --check`.
- No runtime tests were added because this change only corrects
configuration metadata and does not affect behavior.
Closes #56462 from sunchao/dev/chao/codex/spark-56903-config-version.
Authored-by: Chao Sun <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
(cherry picked from commit 3d4c8b0ce633cc95a3a7f35c28bf746d2698e9c5)
Signed-off-by: Cheng Pan <[email protected]>
---
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index 971eddf7bef9..4ea181330acb 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -1007,7 +1007,7 @@ object SQLConf {
"equi-joins may require an extra shuffle. If one input is already hash
partitioned, " +
"only the other input may be reshuffled into the null-aware layout, so
the pre-shuffled " +
"input can keep its NULL skew.")
- .version("4.1.0")
+ .version("4.3.0")
.withBindingPolicy(ConfigBindingPolicy.SESSION)
.booleanConf
.createWithDefault(false)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
