[
https://issues.apache.org/jira/browse/BEAM-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506627#comment-17506627
]
David Huntsperger commented on BEAM-7104:
-----------------------------------------
[~pabloem] Will you have bandwidth to work on this documentation? If not, I
think we should resolve as "Won't Do." Nice to have, but we won't have
resources for it any time soon.
> Document Deployment of a Flink and Spark Clusters with Portable Beam
> --------------------------------------------------------------------
>
> Key: BEAM-7104
> URL: https://issues.apache.org/jira/browse/BEAM-7104
> Project: Beam
> Issue Type: Improvement
> Components: website
> Reporter: Pablo Estrada
> Priority: P3
> Labels: gsod, gsod2019
>
> The Apache Beam vision has been to provide a framework for users to write and
> execute pipelines on the programming language of your choice, and the runner
> of your choice. As the reality of Beam has evolved towards this vision, the
> way in which Beam is run on top of runners such as Apache Spark and Apache
> Flink has changed.
> These changes are documented in the wiki and in design documents, and are
> accessible for Beam contributors; but they are not available in the
> user-facing documentation. This has been a barrier of adoption for other
> users of Beam.
> This project involves improving the Flink Runner page[1] to include
> strategies to deploy Beam on a few different environments: A Kubernetes
> cluster, a Google Cloud Dataproc cluster, and an AWS EMR cluster. There are
> other places in the documentation that should be updated in this regard[4][5].
> After working on the Flink Runner, then similar updates should be made to the
> Spark Runner page[2], and the getting started documentation[3].
> [1] https://beam.apache.org/documentation/runners/flink/
> [2] https://beam.apache.org/documentation/runners/spark/
> [3] https://beam.apache.org/get-started/beam-overview/
> [4] https://beam.apache.org/documentation/sdks/python-streaming/
> [5]
> https://beam.apache.org/documentation/sdks/python-streaming/#unsupported-features
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
