Github user stanzhai commented on the issue:

    https://github.com/apache/spark/pull/19301
  
    
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala#L211
    
    ```scala
          val aggregateExpressions = resultExpressions.flatMap { expr =>
            expr.collect {
              case agg: AggregateExpression => agg
            }
          }.distinct
    ```
    
    Before the fix, the exprId of each aggregate expression is different which 
can cause distinct fail.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to