[
https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992949#comment-14992949
]
Yin Huai edited comment on SPARK-11469 at 11/6/15 2:10 AM:
-----------------------------------------------------------
I have reverted (see
https://github.com/apache/spark/commit/b655117d02b7429b6ca245812ab77458c022717f
and
https://github.com/apache/spark/commit/6091e91fca58078a0f1d9c35d68c0ae7205a534c).
was (Author: yhuai):
I has been reverted (see
https://github.com/apache/spark/commit/b655117d02b7429b6ca245812ab77458c022717f
and
https://github.com/apache/spark/commit/6091e91fca58078a0f1d9c35d68c0ae7205a534c).
> Initial implementation of allowing users to define UDFs that will not be
> evaluated more than once
> -------------------------------------------------------------------------------------------------
>
> Key: SPARK-11469
> URL: https://issues.apache.org/jira/browse/SPARK-11469
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Yin Huai
>
> Right now, we have a projection collapsing optimization rule, that will
> collapse multiple project operators by evaluating an expression multiple
> times. However, there are cases that we do not want to do it (e.g. for rand).
> This work is to let users define such UDF functions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
