j-esse commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum
size for repeatedly substituted aliases in SQL expressions
URL: https://github.com/apache/spark/pull/23556#discussion_r265745285
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
##########
@@ -658,7 +658,8 @@ object CollapseProject extends Rule[LogicalPlan] {
def apply(plan: LogicalPlan): LogicalPlan = plan transformUp {
Review comment:
@HyukjinKwon The purpose is to improve the rule so that it only applies
when it will yield a performance improvement (and not apply when it could cause
memory issues). This was the preferred solution, since if we excluded the rule
entirely we wouldn't benefit from it in the instances where it would be
beneficial.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
