[
https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-9192:
-------------------------------
Description:
Some expressions have mutable states and need to be initialized first(like
Rand, WeekOfYear). Currently we use `@transient lazy val` to make it
automatically get initialized when first use it, and reset it after
serialize-deserialize.
However, this approach is kind of ugly and accessing a lazy val is not
efficient, we should have a explicit initialization phase for expressions.
was:
Some expressions have mutable states and need to be initialized first(like
Rand, WeekOfYear). Currently we use `@transient lazy val` to make it
automatically get initialized when first use it, and reset it after
serialize-deserialize.
However, this approach is kind of ugly and access a lazy val is not efficient,
we should have a explicit initialization phase for expressions.
> add initialization phase for expression
> ---------------------------------------
>
> Key: SPARK-9192
> URL: https://issues.apache.org/jira/browse/SPARK-9192
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Wenchen Fan
>
> Some expressions have mutable states and need to be initialized first(like
> Rand, WeekOfYear). Currently we use `@transient lazy val` to make it
> automatically get initialized when first use it, and reset it after
> serialize-deserialize.
> However, this approach is kind of ugly and accessing a lazy val is not
> efficient, we should have a explicit initialization phase for expressions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
