Github user dilipbiswal commented on the issue:

    https://github.com/apache/spark/pull/22047
  
    @gatorsmile I tried to implement the rewrites suggested in the original PR. 
It does not seem very straightforward to me. The basic issue is, we are unable 
to replace the aggregate expression  to a scalar expression over aggregates. We 
only support limited number of true aggregate expressions under window.
    
    For example -we are unable to rewrite .
    ```
    select key, value, some(value) over(partition by key order by value) from 
src group by key, value
    ```
    to
    ```
    select key, value, coalesce(max(c1) == true, false) over(partition by key 
order by value) from src group by key, value
    ```
    I tried a similar frame work to replace aggregate expressions like 
`ReplaceExpressions`. Please let me know what you think.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to