Mihailo Aleksic created SPARK-54075:
---------------------------------------
Summary: Make ResolvedCollation evaluable
Key: SPARK-54075
URL: https://issues.apache.org/jira/browse/SPARK-54075
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.0.1
Reporter: Mihailo Aleksic
Fix For: 4.1.0
In this PR I propose to make ResolvedCollation evaluable. By making
ResolvedCollation evaluable, it can now pass the canEvaluateWithinJoin check,
allowing the optimizer to use efficient hash joins for queries with inline
COLLATE in join conditions (before this change we would fallback to
BroadcastNestedLoopJoin).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
