Repository: beam-site Updated Branches: refs/heads/asf-site 97641db9f -> 3ecf363c2
Update flink page ref from language-python to language-py and add toggle Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/f936a3dc Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/f936a3dc Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/f936a3dc Branch: refs/heads/asf-site Commit: f936a3dc1ac825d20b9db3a0bfbddd2b32b3da71 Parents: 97641db Author: melissa <meliss...@google.com> Authored: Tue Apr 18 16:22:19 2017 -0700 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Wed Apr 19 11:29:24 2017 +0200 ---------------------------------------------------------------------- src/documentation/runners/flink.md | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/beam-site/blob/f936a3dc/src/documentation/runners/flink.md ---------------------------------------------------------------------- diff --git a/src/documentation/runners/flink.md b/src/documentation/runners/flink.md index ed52689..f844c6b 100644 --- a/src/documentation/runners/flink.md +++ b/src/documentation/runners/flink.md @@ -6,6 +6,14 @@ redirect_from: /learn/runners/flink/ --- # Using the Apache Flink Runner +<nav class="language-switcher"> + <strong>Adapt for:</strong> + <ul> + <li data-type="language-java">Java SDK</li> + <li data-type="language-py">Python SDK</li> + </ul> +</nav> + The Apache Flink Runner can be used to execute Beam pipelines using [Apache Flink](https://flink.apache.org). When using the Flink Runner you will create a jar file containing your job that can be executed on a regular Flink cluster. It's also possible to execute a Beam pipeline using Flink's local execution mode without setting up a cluster. This is helpful for development and debugging of your pipeline. The Flink Runner and Flink are suitable for large scale, continuous jobs, and provide: @@ -38,8 +46,7 @@ For more information, the [Flink Documentation](https://ci.apache.org/projects/f ### Specify your dependency -You must specify your dependency on the Flink Runner. - +<span class="language-java">When using Java, you must specify your dependency on the Flink Runner in your `pom.xml`.</span> ```java <dependency> <groupId>org.apache.beam</groupId> @@ -49,6 +56,8 @@ You must specify your dependency on the Flink Runner. </dependency> ``` +<span class="language-py">This section is not applicable to the Beam SDK for Python.</span> + ## Executing a pipeline on a Flink cluster For executing a pipeline on a Flink cluster you need to package your program along will all dependencies in a so-called fat jar. How you do this depends on your build system but if you follow along the [Beam Quickstart]({{ site.baseurl }}/get-started/quickstart/) this is the command that you have to run: @@ -129,7 +138,7 @@ When executing your pipeline with the Flink Runner, you can set these pipeline o </tr> </table> -See the reference documentation for the <span class="language-java">[FlinkPipelineOptions]({{ site.baseurl }}/documentation/sdks/javadoc/{{ site.release_latest }}/index.html?org/apache/beam/runners/flink/FlinkPipelineOptions.html)</span><span class="language-python">[PipelineOptions](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/utils/pipeline_options.py)</span> interface (and its subinterfaces) for the complete list of pipeline configuration options. +See the reference documentation for the <span class="language-java">[FlinkPipelineOptions]({{ site.baseurl }}/documentation/sdks/javadoc/{{ site.release_latest }}/index.html?org/apache/beam/runners/flink/FlinkPipelineOptions.html)</span><span class="language-py">[PipelineOptions](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/utils/pipeline_options.py)</span> interface (and its subinterfaces) for the complete list of pipeline configuration options. ## Additional information and caveats
