[ 
https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yin Huai updated SPARK-11469:
-----------------------------
    Description: Right now, we have a projection collapsing optimization rule, 
that will collapse multiple project operators by evaluating an expression 
multiple times. However, there are cases that we do not want to do it (e.g. for 
rand). This work is to let users define such UDF functions.

> Initial implementation of allowing users to define UDFs that will not be 
> evaluated more than once
> -------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-11469
>                 URL: https://issues.apache.org/jira/browse/SPARK-11469
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Yin Huai
>            Assignee: Yin Huai
>             Fix For: 1.6.0
>
>
> Right now, we have a projection collapsing optimization rule, that will 
> collapse multiple project operators by evaluating an expression multiple 
> times. However, there are cases that we do not want to do it (e.g. for rand). 
> This work is to let users define such UDF functions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to