[
https://issues.apache.org/jira/browse/BEAM-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17547542#comment-17547542
]
Kenneth Knowles commented on BEAM-6484:
---------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/19279
> Spark's pipeline result throws exceptions
> -----------------------------------------
>
> Key: BEAM-6484
> URL: https://issues.apache.org/jira/browse/BEAM-6484
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Jozef Vilcek
> Priority: P3
>
> Spark's pipeline result seems to allow throwing Exceptions from
> `waitUntilFinish()` methods.
> [https://github.com/apache/beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/SparkPipelineResult.java#L101]
> Documentation on PipelineResult does not mention this possibility. As a
> result, when I am running pipelines from Scio, it does swallow such
> exceptions because if does not expect them
> [https://github.com/spotify/scio/issues/1617]
> Should the Spark Runner just log those exceptions and update it's state of is
> documentation about `PipelineResult.waitUntilFinish()` not up to date?
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
