[
https://issues.apache.org/jira/browse/BEAM-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024818#comment-17024818
]
Ankur Goenka commented on BEAM-8970:
------------------------------------
{code:java}
['--runner=SparkRunner',
'--output_executable_path=~/path/to/output.jar']
{code}
Would be the best way forward.
Once you have the jar, you can use regular jar submission mode as described in
spark documentation here
https://spark.apache.org/docs/latest/running-on-yarn.html
The entry class would be
{code:java}
--class org.apache.beam.runners.spark.SparkPipelineRunner
{code}
> Spark portable runner supports Yarn
> -----------------------------------
>
> Key: BEAM-8970
> URL: https://issues.apache.org/jira/browse/BEAM-8970
> Project: Beam
> Issue Type: Wish
> Components: runner-spark
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: Major
> Labels: portability-spark
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
