This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new e8310ea [SPARK-37865][SQL][FOLLOWUP] Fix compilation error for union
deduplication correctness bug fixup
e8310ea is described below
commit e8310ea1895a6f74a3c0a12774a20690c2f543f2
Author: Karen Feng <[email protected]>
AuthorDate: Mon Mar 14 13:55:44 2022 +0800
[SPARK-37865][SQL][FOLLOWUP] Fix compilation error for union deduplication
correctness bug fixup
### What changes were proposed in this pull request?
Fixes compilation error following
https://github.com/apache/spark/pull/35760.
### Why are the changes needed?
Compilation error:
https://github.com/apache/spark/runs/5473941519?check_suite_focus=true
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Unit tests
Closes #35842 from karenfeng/SPARK-37865-branch-3.0.
Authored-by: Karen Feng <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
---
.../main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
index 2f33394..edcc4fb 100644
---
a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
+++
b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
@@ -1343,7 +1343,7 @@ class Analyzer(
}
u.copy(children = newChildren)
- case u @ Union(children, _, _)
+ case u @ Union(children)
// if there are duplicate output columns, give them unique expr ids
if children.exists(c => c.output.map(_.exprId).distinct.length <
c.output.length) =>
val newChildren = children.map { c =>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
