agubichev commented on code in PR #43111:
URL: https://github.com/apache/spark/pull/43111#discussion_r1341561643
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/DecorrelateInnerQuery.scala:
##########
@@ -710,6 +711,12 @@ object DecorrelateInnerQuery extends PredicateHelper {
case a @ Aggregate(groupingExpressions, aggregateExpressions, child)
=>
val outerReferences = collectOuterReferences(a.expressions)
val newOuterReferences = parentOuterReferences ++ outerReferences
+ // Find all the aggregate expressions that are subject to the
"COUNT bug",
+ // i.e. those that have non-None default result.
+ val countBugSusceptibleAggs =
aggregateExpressions.flatMap(_.collect {
+ case a@AggregateExpression(function, _, _, _, _)
+ if function.defaultResult.nonEmpty => a
Review Comment:
discussed it offline.
These are scalar subqueries so outside the scope of the PR, filed
https://issues.apache.org/jira/browse/SPARK-45381 to track OSS vs DBR
difference in one of your examples
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
