ulysses you created SPARK-34030:
-----------------------------------
Summary: Fold RepartitionExpression num partition should at
Optimizer
Key: SPARK-34030
URL: https://issues.apache.org/jira/browse/SPARK-34030
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: ulysses you
We meet some ploblem when backport SPARK-33806. It is because the
UnresolvedFunction.foldable will throw a exception. It's ok with master branch,
but it's better to do it at Optimizer. Some reason:
# It's not always safe to call Expression.foldable before analysis.
# fold num partition to 1 more like a optimize behavior.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
