cloud-fan commented on code in PR #34558: URL: https://github.com/apache/spark/pull/34558#discussion_r1198524171
########## sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/EquivalentExpressions.scala: ########## @@ -149,9 +149,13 @@ class EquivalentExpressions( // There are some special expressions that we should not recurse into all of its children. // 1. CodegenFallback: it's children will not be used to generate code (call eval() instead) // 2. ConditionalExpression: use its children that will always be evaluated. + // 3. HigherOrderFunction: lambda functions operate in the context of local lambdas and can't + // be called outside of that scope, only the arguments can be evaluated ahead of + // time. private def childrenToRecurse(expr: Expression): Seq[Expression] = expr match { case _: CodegenFallback => Nil case c: ConditionalExpression => c.alwaysEvaluatedInputs.map(skipForShortcut) + case h: HigherOrderFunction => h.arguments Review Comment: do we need to do the same for `commonChildrenToRecurse`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org