[
https://issues.apache.org/jira/browse/SPARK-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-897.
-------------------------------
Resolution: Fixed
Fix Version/s: (was: 1.0.0)
1.1.0
> Preemptively serialize closures to help users identify non-serializable
> errors early on
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-897
> URL: https://issues.apache.org/jira/browse/SPARK-897
> Project: Spark
> Issue Type: Improvement
> Reporter: Reynold Xin
> Assignee: William Benton
> Fix For: 1.1.0
>
>
> We can do a preemptive serialization of the closures in map, mapParititons
> and all other RDD functions that take closures as arguments to help users
> catch non-serializable errors early on. Right now those exceptions are
> triggered when an action is triggered, which makes it harder to debug.
--
This message was sent by Atlassian JIRA
(v6.2#6252)