Tom White created SPARK-8625:
--------------------------------
Summary: Propagate user exceptions in tasks back to driver
Key: SPARK-8625
URL: https://issues.apache.org/jira/browse/SPARK-8625
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 1.4.0
Reporter: Tom White
Runtime exceptions that are thrown by user code in Spark are presented to the
user as strings (message and stacktrace), rather than the exception object
itself. If the exception stores information about the error in fields then
these cannot be retrieved.
Exceptions are Serializable, so it would be feasible to return the original
object back to the driver as the cause field in SparkException. This would
allow the client to retrieve information from the original exception.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]