This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 97aeb9b1b2e Publishing website 2026/08/03 18:15:09 at commit a6b3399
97aeb9b1b2e is described below
commit 97aeb9b1b2e192e674247e59048dd5036b8f9e21
Author: runner <runner@main-runner-2404-9kmqn-dd2tj>
AuthorDate: Mon Aug 3 18:15:09 2026 +0000
Publishing website 2026/08/03 18:15:09 at commit a6b3399
---
.../documentation/runners/flink/index.html | 19 ++++++++++---------
website/generated-content/sitemap.xml | 2 +-
2 files changed, 11 insertions(+), 10 deletions(-)
diff --git a/website/generated-content/documentation/runners/flink/index.html
b/website/generated-content/documentation/runners/flink/index.html
index 7a044a2ef35..7878fc7b204 100644
--- a/website/generated-content/documentation/runners/flink/index.html
+++ b/website/generated-content/documentation/runners/flink/index.html
@@ -58,7 +58,7 @@ Flink <a
href=https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/
in your <code>pom.xml</code> or <code>build.gradle</code>. Use the Beam
version and the artifact id
from the <a href=#flink-version-compatibility>compatibility table</a> below.
For example:</p><div class='language-java snippet'><div class="notebook-skip
code-snippet"><a class=copy type=button data-bs-toggle=tooltip
data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><div class=highlight><pre tabindex=0
class=chroma><code class=language-java data-lang=java><span class=line><span
class=cl><span class=o><</span><span class=n>dependency</span><span clas
[...]
</span></span><span class=line><span class=cl> <span class=o><</span><span
class=n>groupId</span><span class=o>></span><span class=n>org</span><span
class=o>.</span><span class=na>apache</span><span class=o>.</span><span
class=na>beam</span><span class=o></</span><span class=n>groupId</span><span
class=o>></span>
-</span></span><span class=line><span class=cl> <span class=o><</span><span
class=n>artifactId</span><span class=o>></span><span
class=n>beam</span><span class=o>-</span><span class=n>runners</span><span
class=o>-</span><span class=n>flink</span><span class=o>-</span><span
class=n>1</span><span class=o>.</span><span class=na>18</span><span
class=o></</span><span class=n>artifactId</span><span class=o>></span>
+</span></span><span class=line><span class=cl> <span class=o><</span><span
class=n>artifactId</span><span class=o>></span><span
class=n>beam</span><span class=o>-</span><span class=n>runners</span><span
class=o>-</span><span class=n>flink</span><span class=o>-</span><span
class=n>1</span><span class=o>.</span><span class=na>20</span><span
class=o></</span><span class=n>artifactId</span><span class=o>></span>
</span></span><span class=line><span class=cl> <span class=o><</span><span
class=n>version</span><span class=o>></span><span class=n>2</span><span
class=o>.</span><span class=na>75</span><span class=o>.</span><span
class=na>0</span><span class=o></</span><span class=n>version</span><span
class=o>></span>
</span></span><span class=line><span class=cl><span class=o></</span><span
class=n>dependency</span><span
class=o>></span></span></span></code></pre></div></div></div><p
class=language-py>You will need Docker to be installed in your execution
environment.
To run an embedded flink cluster or use the Flink runner for Python < 3.6
@@ -80,7 +80,7 @@ WordCount example:</p><div class='language-java snippet'><div
class="notebook-sk
<code>flinkMaster</code>. Otherwise an embedded Flink cluster will be started
for the job.</p><p class=language-py>To run a pipeline on Flink, set the runner
to <code>FlinkRunner</code>
and <code>flink_master</code> to the master URL of a Flink cluster.
In addition, optionally set <code>environment_type</code> set to
<code>LOOPBACK</code>. For example,
-after starting up a <a
href=https://ci.apache.org/projects/flink/flink-docs-release-1.18/getting-started/tutorials/local_setup.html>local
flink cluster</a>,
+after starting up a <a
href=https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/try-flink/local_installation/>local
flink cluster</a>,
one could run:</p><div class='language-py snippet'><div class="notebook-skip
code-snippet"><a class=copy type=button data-bs-toggle=tooltip
data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><div class=highlight><pre tabindex=0
class=chroma><code class=language-py data-lang=py><span class=line><span
class=cl><span class=kn>import</span> <span class=nn>apache_beam</span> <span
class=k>as</span> <span class=nn>beam</span>
</span></span><span class=line><span class=cl><span class=kn>from</span> <span
class=nn>apache_beam.options.pipeline_options</span> <span
class=kn>import</span> <span class=n>PipelineOptions</span>
</span></span><span class=line><span class=cl>
@@ -92,15 +92,16 @@ one could run:</p><div class='language-py snippet'><div
class="notebook-skip cod
</span></span><span class=line><span class=cl><span class=k>with</span> <span
class=n>beam</span><span class=o>.</span><span class=n>Pipeline</span><span
class=p>(</span><span class=n>options</span><span class=p>)</span> <span
class=k>as</span> <span class=n>p</span><span class=p>:</span>
</span></span><span class=line><span class=cl> <span
class=o>...</span></span></span></code></pre></div></div></div><p
class=language-py>To run on an embedded Flink cluster, simply omit the
<code>flink_master</code> option
and an embedded Flink cluster will be automatically started and shut down for
the job.</p><p class=language-py>The optional <code>flink_version</code> option
may be required as well for older versions of Python.</p><p
class=language-portable>Starting with Beam 2.18.0, pre-built Flink Job Service
Docker images are available at Docker Hub:
-<a href=https://hub.docker.com/r/apache/beam_flink1.16_job_server>Flink
1.16</a>.
-<a href=https://hub.docker.com/r/apache/beam_flink1.17_job_server>Flink
1.17</a>.
-<a href=https://hub.docker.com/r/apache/beam_flink1.18_job_server>Flink
1.18</a>.</p><p class=language-portable>To run a pipeline on an embedded Flink
cluster:</p><p class=language-portable>(1) Start the JobService endpoint:
<code>docker run --net=host
apache/beam_flink1.18_job_server:latest</code></p><p
class=language-portable>The JobService is the central instance where you submit
your Beam pipeline to.
+<a href=https://hub.docker.com/r/apache/beam_flink1.19_job_server>Flink
1.19</a>.
+<a href=https://hub.docker.com/r/apache/beam_flink1.20_job_server>Flink
1.20</a>.
+For Flink 2 and later the images share one repository, with the Beam and Flink
versions in the tag,
+for example <a
href=https://hub.docker.com/layers/apache/beam_flink_job_server/2.75.0-flink2.0>beam_flink_job_server:2.75.0-flink2.0</a>.</p><p
class=language-portable>To run a pipeline on an embedded Flink cluster:</p><p
class=language-portable>(1) Start the JobService endpoint: <code>docker run
--net=host apache/beam_flink1.20_job_server:latest</code></p><p
class=language-portable>The JobService is the central instance where you submit
your Beam pipeline to.
It creates a Flink job from your pipeline and executes it.
You might encounter an error message like <code>Caused by:
java.io.IOException: Insufficient number of network buffers:...</code>.
This can be resolved by providing a Flink configuration file to override the
default settings.
You can find an example configuration file <a
href=https://github.com/apache/beam/blob/master/runners/flink/src/test/resources/flink-conf.yaml>here</a>.
To start the Job Service endpoint with your custom configuration, mount a
local directory containing your Flink configuration to the
<code>/flink-conf</code> path in the Docker container and pass this as
<code>--flink-conf-dir</code>:
-<code>docker run --net=host -v <your_flink_conf_dir>:/flink-conf
beam-flink-runner apache/beam_flink1.18_job_server:latest --flink-conf-dir
/flink-conf</code></p><p class=language-portable>(2) Submit the Python pipeline
to the above endpoint by using the <code>PortableRunner</code>,
<code>job_endpoint</code> set to <code>localhost:8099</code> (this is the
default address of the JobService).
+<code>docker run --net=host -v <your_flink_conf_dir>:/flink-conf
beam-flink-runner apache/beam_flink1.20_job_server:latest --flink-conf-dir
/flink-conf</code></p><p class=language-portable>(2) Submit the Python pipeline
to the above endpoint by using the <code>PortableRunner</code>,
<code>job_endpoint</code> set to <code>localhost:8099</code> (this is the
default address of the JobService).
Optionally set <code>environment_type</code> set to <code>LOOPBACK</code>. For
example:</p><div class='language-portable snippet'><div class="notebook-skip
code-snippet"><a class=copy type=button data-bs-toggle=tooltip
data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><pre tabindex=0><code class=language-portable
data-lang=portable>import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
@@ -110,7 +111,7 @@ options = PipelineOptions([
"--environment_type=LOOPBACK"
])
with beam.Pipeline(options) as p:
- ...</code></pre></div></div><p class=language-portable>To run on a
separate <a
href=https://ci.apache.org/projects/flink/flink-docs-release-1.18/getting-started/tutorials/local_setup.html>Flink
cluster</a>:</p><p class=language-portable>(1) Start a Flink cluster which
exposes the Rest interface (e.g. <code>localhost:8081</code> by default).</p><p
class=language-portable>(2) Start JobService with Flink Rest endpoint:
<code>docker run --net=host apache/beam_flink1.18_job_server:latest [...]
+ ...</code></pre></div></div><p class=language-portable>To run on a
separate <a
href=https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/try-flink/local_installation/>Flink
cluster</a>:</p><p class=language-portable>(1) Start a Flink cluster which
exposes the Rest interface (e.g. <code>localhost:8081</code> by default).</p><p
class=language-portable>(2) Start JobService with Flink Rest endpoint:
<code>docker run --net=host apache/beam_flink1.20_job_server:latest --flink-ma
[...]
from apache_beam.options.pipeline_options import PipelineOptions
options = PipelineOptions([
@@ -127,8 +128,8 @@ Many sources like <code>PubSubIO</code> rely on their
checkpoints to be acknowle
reference class:</p><div class=language-java><table class="table
table-bordered"><tr><td><code>allowNonRestoredState</code></td><td>Flag
indicating whether non restored state is allowed if the savepoint contains
state for an operator that is no longer part of the pipeline.</td><td>Default:
<code>false</code></td></tr><tr><td><code>attachedMode</code></td><td>Specifies
if the pipeline is submitted in attached or detached mode</td><td>Default:
<code>true</code></td></tr><tr><td><code>autoB [...]
<a
href=https://beam.apache.org/releases/javadoc/2.75.0/index.html?org/apache/beam/sdk/options/PipelineOptions.html>PipelineOptions</a>
reference.</p><h2 id=flink-version-compatibility>Flink Version
Compatibility</h2><p>The Flink cluster version has to match the minor version
used by the FlinkRunner.
-The minor version is the first two numbers in the version string, e.g. in
<code>1.18.0</code> the
-minor version is <code>1.18</code>.</p><p>We try to track the latest version
of Apache Flink at the time of the Beam release.
+The minor version is the first two numbers in the version string, e.g. in
<code>1.20.0</code> the
+minor version is <code>1.20</code>.</p><p>We try to track the latest version
of Apache Flink at the time of the Beam release.
A Flink version is supported by Beam for the time it is supported by the Flink
community.
The Flink community supports the last two minor versions. When support for a
Flink version is dropped, it may be deprecated and removed also from Beam.
To find out which version of Flink is compatible with Beam please see the
table below:</p><table class="table table-bordered"><tr><th>Flink
Version</th><th>Artifact Id</th><th>Supported Beam
Versions</th></tr><tr><td>2.2.x</td><td>beam-runners-flink-2.2</td><td>≥
2.75.0</td></tr><tr><td>2.1.x</td><td>beam-runners-flink-2.1</td><td>≥
2.75.0</td></tr><tr><td>2.0.x</td><td>beam-runners-flink-2.0</td><td>≥
2.72.0</td></tr><tr><td>1.20.x</td><td>beam-runners-flink-1.20</td><td>≥ 2
[...]
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index f3d9fc4a9b6..d8444d3ee9b 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-summit-2026-interview-with-raj-katakam/</loc><lastmod>2026-08-03T08:00:47-04:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2026-08-03T08:00:47-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2026-08-03T08:00:47-04:00</lastmod></url><url><loc>/categories/</loc><lastmod>2026-08-03T08:00:47-04:00<
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-summit-2026-interview-with-raj-katakam/</loc><lastmod>2026-08-03T13:23:43-04:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2026-08-03T13:23:43-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2026-08-03T13:23:43-04:00</lastmod></url><url><loc>/categories/</loc><lastmod>2026-08-03T13:23:43-04:00<
[...]
\ No newline at end of file
