Kyle Weaver created BEAM-8983:
---------------------------------
Summary: Spark uber jar job server: query exceptions from master
Key: BEAM-8983
URL: https://issues.apache.org/jira/browse/BEAM-8983
Project: Beam
Issue Type: Improvement
Components: runner-spark
Reporter: Kyle Weaver
Assignee: Kyle Weaver
As far as I know, the Spark REST API does not return exceptions from the
cluster after a jar is actually run. While these exceptions can be viewed in
Spark's web UI, ideally they would also be visible in Beam's output.
To do this, we will need to find a REST endpoint that does return those
exceptions, and then map the submissionId to its corresponding job id.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)