This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 23686b8 Publishing website 2020/10/26 18:04:02 at commit ba24b08
23686b8 is described below
commit 23686b81c22cf43204da2e2beb8d2becf9511068
Author: jenkins <[email protected]>
AuthorDate: Mon Oct 26 18:04:03 2020 +0000
Publishing website 2020/10/26 18:04:02 at commit ba24b08
---
website/generated-content/beam-2.25.0.md | 85 ---------------
.../generated-content/blog/beam-2.25.0/index.html | 31 ++++++
website/generated-content/blog/index.html | 4 +-
website/generated-content/blog/index.xml | 117 +++++++++++++--------
.../generated-content/categories/blog/index.xml | 100 +++++++++++++-----
website/generated-content/categories/index.xml | 2 +-
website/generated-content/feed.xml | 107 +++++++++++++------
website/generated-content/index.html | 2 +-
.../generated-content/roadmap/go-sdk/index.html | 2 +-
website/generated-content/roadmap/index.xml | 2 +-
website/generated-content/sitemap.xml | 2 +-
11 files changed, 264 insertions(+), 190 deletions(-)
diff --git a/website/generated-content/beam-2.25.0.md
b/website/generated-content/beam-2.25.0.md
deleted file mode 100644
index d757147..0000000
--- a/website/generated-content/beam-2.25.0.md
+++ /dev/null
@@ -1,85 +0,0 @@
----
-title: "Apache Beam 2.25.0"
-date: 2020-10-23 14:00:00 -0800
-categories:
- - blog
-authors:
- - Robin Qiu
----
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-We are happy to present the new 2.25.0 release of Apache Beam. This release
includes both improvements and new functionality.
-See the [download page](/get-started/downloads/#2250-2020-10-23) for this
release.
-For more information on changes in 2.25.0, check out the
-[detailed release
notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12347147).
-
-## Highlights
-
-* Splittable DoFn is now the default for executing the Read transform for Java
based runners (Direct, Flink, Jet, Samza, Twister2). The expected output of the
Read transform is unchanged. Users can opt-out using
`--experiments=use_deprecated_read`. The Apache Beam community is looking for
feedback for this change as the community is planning to make this change
permanent with no opt-out. If you run into an issue requiring the opt-out,
please send an e-mail to [[email protected]](mailt [...]
-
-## I/Os
-
-* Added cross-language support to Java's KinesisIO, now available in the
Python module `apache_beam.io.kinesis`
([BEAM-10138](https://issues.apache.org/jira/browse/BEAM-10138),
[BEAM-10137](https://issues.apache.org/jira/browse/BEAM-10137)).
-* Update Snowflake JDBC dependency for SnowflakeIO
([BEAM-10864](https://issues.apache.org/jira/browse/BEAM-10864))
-* Added cross-language support to Java's SnowflakeIO.Write, now available in
the Python module `apache_beam.io.snowflake`
([BEAM-9898](https://issues.apache.org/jira/browse/BEAM-9898)).
-* Added delete function to Java's `ElasticsearchIO#Write`. Now, Java's
ElasticsearchIO can be used to selectively delete documents using
`withIsDeleteFn` function
([BEAM-5757](https://issues.apache.org/jira/browse/BEAM-5757)).
-* Java SDK: Added new IO connector for InfluxDB - InfluxDbIO
([BEAM-2546](https://issues.apache.org/jira/browse/BEAM-2546)).
-
-## New Features / Improvements
-
-* Support for repeatable fields in JSON decoder for `ReadFromBigQuery` added.
(Python) ([BEAM-10524](https://issues.apache.org/jira/browse/BEAM-10524))
-* Added an opt-in, performance-driven runtime type checking system for the
Python SDK ([BEAM-10549](https://issues.apache.org/jira/browse/BEAM-10549)).
- More details will be in an upcoming [blog
post](https://beam.apache.org/blog/python-performance-runtime-type-checking/index.html).
-* Added support for Python 3 type annotations on PTransforms using typed
PCollections ([BEAM-10258](https://issues.apache.org/jira/browse/BEAM-10258)).
- More details will be in an upcoming [blog
post](https://beam.apache.org/blog/python-improved-annotations/index.html).
-* Improved the Interactive Beam API where recording streaming jobs now start a
long running background recording job. Running ib.show() or ib.collect()
samples from the recording
([BEAM-10603](https://issues.apache.org/jira/browse/BEAM-10603)).
-* In Interactive Beam, ib.show() and ib.collect() now have "n" and "duration"
as parameters. These mean read only up to "n" elements and up to "duration"
seconds of data read from the recording
([BEAM-10603](https://issues.apache.org/jira/browse/BEAM-10603)).
-* Initial preview of
[Dataframes](https://s.apache.org/simpler-python-pipelines-2020#slide=id.g905ac9257b_1_21)
support.
- See also example at apache_beam/examples/wordcount_dataframe.py
-* Fixed support for type hints on `@ptransform_fn` decorators in the Python
SDK.
- ([BEAM-4091](https://issues.apache.org/jira/browse/BEAM-4091))
- This has not enabled by default to preserve backwards compatibility; use the
- `--type_check_additional=ptransform_fn` flag to enable. It may be enabled by
- default in future versions of Beam.
-
-## Breaking Changes
-
-* Python 2 and Python 3.5 support dropped
([BEAM-10644](https://issues.apache.org/jira/browse/BEAM-10644),
[BEAM-9372](https://issues.apache.org/jira/browse/BEAM-9372)).
-* Pandas 1.x allowed. Older version of Pandas may still be used, but may not
be as well tested.
-
-## Deprecations
-
-* Python transform ReadFromSnowflake has been moved from
`apache_beam.io.external.snowflake` to `apache_beam.io.snowflake`. The previous
path will be removed in the future versions.
-
-## Known Issues
-
-* Dataflow streaming timers once against not strictly time ordered when set
earlier mid-bundle, as the fix for
[BEAM-8543](https://issues.apache.org/jira/browse/BEAM-8543) introduced more
severe bugs and has been rolled back.
-
-
-## List of Contributors
-
-According to git shortlog, the following people contributed to the 2.25.0
release. Thank you to all contributors!
-
-Ahmet Altay, Alan Myrvold, Aldair Coronel Ruiz, Alexey Romanenko, Andrew
Pilloud, Ankur Goenka,
-Ayoub ENNASSIRI, Bipin Upadhyaya, Boyuan Zhang, Brian Hulette, Brian
Michalski, Chad Dombrova,
-Chamikara Jayalath, Damon Douglas, Daniel Oliveira, David Cavazos, David
Janicek, Doug Roeper, Eric
-Roshan-Eisner, Etta Rapp, Eugene Kirpichov, Filipe Regadas, Heejong Lee, Ihor
Indyk, Irvi Firqotul
-Aini, Ismaël Mejía, Jan Lukavský, Jayendra, Jiadai Xia, Jithin Sukumar, Jozsef
Bartok, Kamil
-Gałuszka, Kamil Wasilewski, Kasia Kucharczyk, Kenneth Jung, Kenneth Knowles,
Kevin Puthusseri, Kevin
-Sijo Puthusseri, KevinGG, Kyle Weaver, Leiyi Zhang, Lourens Naudé, Luke Cwik,
Matthew Ouyang,
-Maximilian Michels, Michal Walenia, Milan Cermak, Monica Song, Nelson Osacky,
Neville Li, Ning Kang,
-Pablo Estrada, Piotr Szuberski, Qihang, Rehman, Reuven Lax, Robert Bradshaw,
Robert Burke, Rui Wang,
-Saavan Nanavati, Sam Bourne, Sam Rohde, Sam Whittle, Sergiy Kolesnikov, Sindy
Li, Siyuan Chen, Steve
-Niemitz, Terry Xian, Thomas Weise, Tobiasz Kędzierski, Truc Le, Tyson
Hamilton, Udi Meiri, Valentyn
-Tymofieiev, Yichi Zhang, Yifan Mai, Yueyang Qiu, annaqin418, danielxjd,
dennis, dp, fuyuwei,
-lostluck, nehsyc, odeshpande, odidev, pulasthi, purbanow, rworley-monster,
sclukas77, terryxian78,
-tvalentyn, yoshiki.obata
diff --git a/website/generated-content/blog/beam-2.25.0/index.html
b/website/generated-content/blog/beam-2.25.0/index.html
new file mode 100644
index 0000000..c6293ff
--- /dev/null
+++ b/website/generated-content/blog/beam-2.25.0/index.html
@@ -0,0 +1,31 @@
+<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport
content="width=device-width,initial-scale=1"><title>Apache Beam
2.25.0</title><meta name=description content="Apache Beam is an open source,
unified model and set of language-specific SDKs for defining and executing data
processing workflows, and also data ingestion and integration flows, supporting
Enterprise Integration Patterns (EIPs) and Domain Spe [...]
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+•</p></header><div class=post-content itemprop=articleBody><p>We are happy to
present the new 2.25.0 release of Apache Beam. This release includes both
improvements and new functionality.
+See the <a href=/get-started/downloads/#2250-2020-10-23>download page</a> for
this release.
+For more information on changes in 2.25.0, check out the
+<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12347147";>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Splittable DoFn
is now the default for executing the Read transform for Java based runners
(Direct, Flink, Jet, Samza, Twister2). The expected output of the Read
transform is unchanged. Users can opt-out using
<code>--experiments=use_deprecated_read</code>. The Apache Beam community is
looking for feedback for this ch [...]
+More details will be in an upcoming <a
href=https://beam.apache.org/blog/python-performance-runtime-type-checking/index.html>blog
post</a>.</li><li>Added support for Python 3 type annotations on PTransforms
using typed PCollections (<a
href=https://issues.apache.org/jira/browse/BEAM-10258>BEAM-10258</a>).
+More details will be in an upcoming <a
href=https://beam.apache.org/blog/python-improved-annotations/index.html>blog
post</a>.</li><li>Improved the Interactive Beam API where recording streaming
jobs now start a long running background recording job. Running ib.show() or
ib.collect() samples from the recording (<a
href=https://issues.apache.org/jira/browse/BEAM-10603>BEAM-10603</a>).</li><li>In
Interactive Beam, ib.show() and ib.collect() now have “n” and
“duration&rdqu [...]
+See also example at apache_beam/examples/wordcount_dataframe.py</li><li>Fixed
support for type hints on <code>@ptransform_fn</code> decorators in the Python
SDK.
+(<a href=https://issues.apache.org/jira/browse/BEAM-4091>BEAM-4091</a>)
+This has not enabled by default to preserve backwards compatibility; use the
+<code>--type_check_additional=ptransform_fn</code> flag to enable. It may be
enabled by
+default in future versions of Beam.</li></ul><h2 id=breaking-changes>Breaking
Changes</h2><ul><li>Python 2 and Python 3.5 support dropped (<a
href=https://issues.apache.org/jira/browse/BEAM-10644>BEAM-10644</a>, <a
href=https://issues.apache.org/jira/browse/BEAM-9372>BEAM-9372</a>).</li><li>Pandas
1.x allowed. Older version of Pandas may still be used, but may not be as well
tested.</li></ul><h2 id=deprecations>Deprecations</h2><ul><li>Python transform
ReadFromSnowflake has been moved fr [...]
+Ayoub ENNASSIRI, Bipin Upadhyaya, Boyuan Zhang, Brian Hulette, Brian
Michalski, Chad Dombrova,
+Chamikara Jayalath, Damon Douglas, Daniel Oliveira, David Cavazos, David
Janicek, Doug Roeper, Eric
+Roshan-Eisner, Etta Rapp, Eugene Kirpichov, Filipe Regadas, Heejong Lee, Ihor
Indyk, Irvi Firqotul
+Aini, Ismaël Mejía, Jan Lukavský, Jayendra, Jiadai Xia, Jithin Sukumar, Jozsef
Bartok, Kamil
+Gałuszka, Kamil Wasilewski, Kasia Kucharczyk, Kenneth Jung, Kenneth Knowles,
Kevin Puthusseri, Kevin
+Sijo Puthusseri, KevinGG, Kyle Weaver, Leiyi Zhang, Lourens Naudé, Luke Cwik,
Matthew Ouyang,
+Maximilian Michels, Michal Walenia, Milan Cermak, Monica Song, Nelson Osacky,
Neville Li, Ning Kang,
+Pablo Estrada, Piotr Szuberski, Qihang, Rehman, Reuven Lax, Robert Bradshaw,
Robert Burke, Rui Wang,
+Saavan Nanavati, Sam Bourne, Sam Rohde, Sam Whittle, Sergiy Kolesnikov, Sindy
Li, Siyuan Chen, Steve
+Niemitz, Terry Xian, Thomas Weise, Tobiasz Kędzierski, Truc Le, Tyson
Hamilton, Udi Meiri, Valentyn
+Tymofieiev, Yichi Zhang, Yifan Mai, Yueyang Qiu, annaqin418, danielxjd,
dennis, dp, fuyuwei,
+lostluck, nehsyc, odeshpande, odidev, pulasthi, purbanow, rworley-monster,
sclukas77, terryxian78,
+tvalentyn, yoshiki.obata</p></div></article></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div
class=footer__cols__col><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__col
footer__cols__col--md"><div class=footer__cols__col__title>Start</div>< [...]
+<a href=http://www.apache.org>The Apache Software Foundation</a>
+| <a href=/privacy_policy>Privacy Policy</a>
+| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/blog/index.html
b/website/generated-content/blog/index.html
index daa065a..1811860 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -1,7 +1,9 @@
<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport
content="width=device-width,initial-scale=1"><title>Blogs</title><meta
name=description content="Apache Beam is an open source, unified model and set
of language-specific SDKs for defining and executing data processing workflows,
and also data ingestion and integration flows, supporting Enterprise
Integration Patterns (EIPs) and Domain Specific Languag [...]
<span class=sr-only>Toggle navigation</span>
<span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
-<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+•
+Robin Qiu</i></p>We are happy to present the new 2.<p><a class="btn
btn-default btn-sm" href=/blog/beam-2.25.0/ role=button>Read more <span
class="glyphicon glyphicon-menu-right"
aria-hidden=true></span></a></p><hr><h3><a class=post-link
href=/blog/beam-2.24.0/>Apache Beam 2.24.0</a></h3><p><i>Sep 18, 2020
•
Daniel Oliveira</i></p>We are happy to present the new 2.<p><a class="btn
btn-default btn-sm" href=/blog/beam-2.24.0/ role=button>Read more <span
class="glyphicon glyphicon-menu-right"
aria-hidden=true></span></a></p><hr><h3><a class=post-link
href=/blog/pattern-match-beam-sql/>Pattern Matching with Beam
SQL</a></h3><p><i>Aug 27, 2020
•
diff --git a/website/generated-content/blog/index.xml
b/website/generated-content/blog/index.xml
index b8fc2d3..07d0958 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -1,4 +1,77 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache
Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri,
18 Sep 2020 00:00:01 -0800</lastBuildDate><atom:link href="/blog/index.xml"
rel="self" type="application/rss+xml"/><item><title>Blog: Apache Beam
2.24.0</title><link>/blog/beam-2.24.0/</link><pubDate>Fri, 18 Sep 2020 00:00:01
-0800</pubDate><gui [...]
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache
Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri,
23 Oct 2020 14:00:00 -0800</lastBuildDate><atom:link href="/blog/index.xml"
rel="self" type="application/rss+xml"/><item><title>Blog: Apache Beam
2.25.0</title><link>/blog/beam-2.25.0/</link><pubDate>Fri, 23 Oct 2020 14:00:00
-0800</pubDate><gui [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>We are happy to present the new 2.25.0 release of Apache Beam. This
release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2250-2020-10-23">download
page</a> for this release.
+For more information on changes in 2.25.0, check out the
+<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&amp;version=12347147";>detailed
release notes</a>.</p>
+<h2 id="highlights">Highlights</h2>
+<ul>
+<li>Splittable DoFn is now the default for executing the Read transform for
Java based runners (Direct, Flink, Jet, Samza, Twister2). The expected output
of the Read transform is unchanged. Users can opt-out using
<code>--experiments=use_deprecated_read</code>. The Apache Beam community
is looking for feedback for this change as the community is planning to make
this change permanent with no opt-out. If you run into an issue requiring the
opt-out, please send an e-mail to <a [...]
+</ul>
+<h2 id="ios">I/Os</h2>
+<ul>
+<li>Added cross-language support to Java&rsquo;s KinesisIO, now
available in the Python module <code>apache_beam.io.kinesis</code> (<a
href="https://issues.apache.org/jira/browse/BEAM-10138";>BEAM-10138</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-10137";>BEAM-10137</a>).</li>
+<li>Update Snowflake JDBC dependency for SnowflakeIO (<a
href="https://issues.apache.org/jira/browse/BEAM-10864";>BEAM-10864</a>)</li>
+<li>Added cross-language support to Java&rsquo;s SnowflakeIO.Write, now
available in the Python module <code>apache_beam.io.snowflake</code>
(<a
href="https://issues.apache.org/jira/browse/BEAM-9898";>BEAM-9898</a>).</li>
+<li>Added delete function to Java&rsquo;s
<code>ElasticsearchIO#Write</code>. Now, Java&rsquo;s ElasticsearchIO
can be used to selectively delete documents using
<code>withIsDeleteFn</code> function (<a
href="https://issues.apache.org/jira/browse/BEAM-5757";>BEAM-5757</a>).</li>
+<li>Java SDK: Added new IO connector for InfluxDB - InfluxDbIO (<a
href="https://issues.apache.org/jira/browse/BEAM-2546";>BEAM-2546</a>).</li>
+</ul>
+<h2 id="new-features--improvements">New Features / Improvements</h2>
+<ul>
+<li>Support for repeatable fields in JSON decoder for
<code>ReadFromBigQuery</code> added. (Python) (<a
href="https://issues.apache.org/jira/browse/BEAM-10524";>BEAM-10524</a>)</li>
+<li>Added an opt-in, performance-driven runtime type checking system for
the Python SDK (<a
href="https://issues.apache.org/jira/browse/BEAM-10549";>BEAM-10549</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-performance-runtime-type-checking/index.html";>blog
post</a>.</li>
+<li>Added support for Python 3 type annotations on PTransforms using typed
PCollections (<a
href="https://issues.apache.org/jira/browse/BEAM-10258";>BEAM-10258</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-improved-annotations/index.html";>blog
post</a>.</li>
+<li>Improved the Interactive Beam API where recording streaming jobs now
start a long running background recording job. Running ib.show() or
ib.collect() samples from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>In Interactive Beam, ib.show() and ib.collect() now have
&ldquo;n&rdquo; and &ldquo;duration&rdquo; as parameters. These
mean read only up to &ldquo;n&rdquo; elements and up to
&ldquo;duration&rdquo; seconds of data read from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>Initial preview of <a
href="https://s.apache.org/simpler-python-pipelines-2020#slide=id.g905ac9257b_1_21";>Dataframes</a>
support.
+See also example at apache_beam/examples/wordcount_dataframe.py</li>
+<li>Fixed support for type hints on <code>@ptransform_fn</code>
decorators in the Python SDK.
+(<a href="https://issues.apache.org/jira/browse/BEAM-4091";>BEAM-4091</a>)
+This has not enabled by default to preserve backwards compatibility; use the
+<code>--type_check_additional=ptransform_fn</code> flag to enable. It
may be enabled by
+default in future versions of Beam.</li>
+</ul>
+<h2 id="breaking-changes">Breaking Changes</h2>
+<ul>
+<li>Python 2 and Python 3.5 support dropped (<a
href="https://issues.apache.org/jira/browse/BEAM-10644";>BEAM-10644</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-9372";>BEAM-9372</a>).</li>
+<li>Pandas 1.x allowed. Older version of Pandas may still be used, but may
not be as well tested.</li>
+</ul>
+<h2 id="deprecations">Deprecations</h2>
+<ul>
+<li>Python transform ReadFromSnowflake has been moved from
<code>apache_beam.io.external.snowflake</code> to
<code>apache_beam.io.snowflake</code>. The previous path will be removed
in the future versions.</li>
+</ul>
+<h2 id="known-issues">Known Issues</h2>
+<ul>
+<li>Dataflow streaming timers once against not strictly time ordered when
set earlier mid-bundle, as the fix for <a
href="https://issues.apache.org/jira/browse/BEAM-8543";>BEAM-8543</a>
introduced more severe bugs and has been rolled back.</li>
+</ul>
+<h2 id="list-of-contributors">List of Contributors</h2>
+<p>According to git shortlog, the following people contributed to the
2.25.0 release. Thank you to all contributors!</p>
+<p>Ahmet Altay, Alan Myrvold, Aldair Coronel Ruiz, Alexey Romanenko, Andrew
Pilloud, Ankur Goenka,
+Ayoub ENNASSIRI, Bipin Upadhyaya, Boyuan Zhang, Brian Hulette, Brian
Michalski, Chad Dombrova,
+Chamikara Jayalath, Damon Douglas, Daniel Oliveira, David Cavazos, David
Janicek, Doug Roeper, Eric
+Roshan-Eisner, Etta Rapp, Eugene Kirpichov, Filipe Regadas, Heejong Lee, Ihor
Indyk, Irvi Firqotul
+Aini, Ismaël Mejía, Jan Lukavský, Jayendra, Jiadai Xia, Jithin Sukumar, Jozsef
Bartok, Kamil
+Gałuszka, Kamil Wasilewski, Kasia Kucharczyk, Kenneth Jung, Kenneth Knowles,
Kevin Puthusseri, Kevin
+Sijo Puthusseri, KevinGG, Kyle Weaver, Leiyi Zhang, Lourens Naudé, Luke Cwik,
Matthew Ouyang,
+Maximilian Michels, Michal Walenia, Milan Cermak, Monica Song, Nelson Osacky,
Neville Li, Ning Kang,
+Pablo Estrada, Piotr Szuberski, Qihang, Rehman, Reuven Lax, Robert Bradshaw,
Robert Burke, Rui Wang,
+Saavan Nanavati, Sam Bourne, Sam Rohde, Sam Whittle, Sergiy Kolesnikov, Sindy
Li, Siyuan Chen, Steve
+Niemitz, Terry Xian, Thomas Weise, Tobiasz Kędzierski, Truc Le, Tyson
Hamilton, Udi Meiri, Valentyn
+Tymofieiev, Yichi Zhang, Yifan Mai, Yueyang Qiu, annaqin418, danielxjd,
dennis, dp, fuyuwei,
+lostluck, nehsyc, odeshpande, odidev, pulasthi, purbanow, rworley-monster,
sclukas77, terryxian78,
+tvalentyn, yoshiki.obata</p></description></item><item><title>Blog: Apache
Beam 2.24.0</title><link>/blog/beam-2.24.0/</link><pubDate>Fri, 18 Sep 2020
00:00:01 -0800</pubDate><guid>/blog/beam-2.24.0/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -5337,44 +5410,4 @@ limitations under the License.
<p>On management and thought leader side, Beam went from “what’s Beam?” at
previous conferences to “I’m interested in Beam.” or “I’ve formed an informed
opinion on Beam.” at this conference. This is one of the metrics I look for in
early technology adoption.</p>
<img src="/images/blog/IMG_20160927_170455.jpg" alt="So much brainpower
answering questions">
<p>We rounded out the tutorial with live demonstrations of Beam running on
Apache Spark, Apache Flink, the local runner, and DataFlow runner. Then, we
brought in the big brainpower and had a Q and A session.</p>
-<p>If you’re attending a conference, we encourage you to look for a Beam
session. If you want to use these materials to give your own Beam talk or
tutorial, we’re happy to help you. In addition to this tutorial, we have <a
href="/contribute/presentation-materials/">other presentation materials</a>.
You can reach out to us on the <a href="/get-started/support/">user mailing
list</a>.</p></description></item><item><title>Blog: Apache Beam: Six
Months in Incubation</title> [...]
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>It’s been just over six months since Apache Beam was formally accepted
into incubation with the <a href="http://www.apache.org";>Apache Software
Foundation</a>. As a community, we’ve been hard at work getting Beam off the
ground.</p>
-<p>Looking just at raw numbers for those first six months, that’s:</p>
-<ul>
-<li>48,238 lines of preexisting code donated by Cloudera, dataArtisans, and
Google.</li>
-<li>761 pull requests from 45 contributors.</li>
-<li>498 Jira issues opened and 245 resolved.</li>
-<li>1 incubating release (and another 1 in progress).</li>
-<li>4,200 hours of automated tests.</li>
-<li>161 subscribers / 606 messages on user@.</li>
-<li>217 subscribers / 1205 messages on dev@.</li>
-<li>277 stars and 174 forks on GitHub.</li>
-</ul>
-<p>And behind those numbers, there’s been a ton of technical progress,
including:</p>
-<ul>
-<li>Refactoring of the entire codebase, examples, and tests to be truly
runner-independent.</li>
-<li>New functionality in the Apache Flink runner for timestamps/windows in
batch and bounded sources and side inputs in streaming mode.</li>
-<li>Work in progress to upgrade the Apache Spark runner to use Spark
2.0.</li>
-<li>Several new runners from the wider Apache community &ndash; Apache
Gearpump has its own feature branch, Apache Apex has a PR, and conversations
are starting on Apache Storm and others.</li>
-<li>New SDKs/DSLs for exposing the Beam model &ndash; the Python SDK
from Google is in on a feature branch, and there are plans to add the Scio DSL
from Spotify.</li>
-<li>Support for additional data sources and sinks &ndash; Apache Kafka
and JMS are in, there are PRs for Amazon Kinesis, Apache Cassandra, and
MongoDB, and more connectors are being planned.</li>
-</ul>
-<p>But perhaps most importantly, we’re committed to building an involved,
welcoming community. So far, we’ve:</p>
-<ul>
-<li>Started building a vibrant developer community, with detailed design
discussions on features like DoFn reuse semantics, serialization technology,
and an API for accessing state.</li>
-<li>Started building a user community with an active mailing list and
improvements to the website and documentation.</li>
-<li>Had multiple talks on Beam at venues including ApacheCon, Hadoop
Summit, Kafka Summit, JBCN Barcelona, and Strata.</li>
-<li>Presented at multiple existing meetups and are starting to organize
some of our own.</li>
-</ul>
-<p>While it’s nice to reflect back on all we’ve done, we’re working full
<em>stream</em> ahead towards a stable release and graduation from
incubator. And we’d love your help &ndash; join the <a
href="/get-started/support/">mailing lists</a>, check out the <a
href="/contribute/contribution-guide/">contribution guide</a>, and grab a
<a
href="https://issues.apache.org/jira/browse/BEAM-520?jql=project%20%3D%20BEAM%20AND%20resolution%20%3D%20Unresolved%20AND%20lab
[...]
\ No newline at end of file
+<p>If you’re attending a conference, we encourage you to look for a Beam
session. If you want to use these materials to give your own Beam talk or
tutorial, we’re happy to help you. In addition to this tutorial, we have <a
href="/contribute/presentation-materials/">other presentation materials</a>.
You can reach out to us on the <a href="/get-started/support/">user mailing
list</a>.</p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/categories/blog/index.xml
b/website/generated-content/categories/blog/index.xml
index 19c3c39..c7039c8 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -1,4 +1,77 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
blog</title><link>/categories/blog/</link><description>Recent content in blog
on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 18 Sep 2020 00:00:01
-0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self"
type="application/rss+xml"/><item><title>Blog: Apache Beam
2.24.0</title><link>/blog/beam-2.24.0/</link><pubDate>Fri, 18 Sep 2020 00:00:01
[...]
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
blog</title><link>/categories/blog/</link><description>Recent content in blog
on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 23 Oct 2020 14:00:00
-0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self"
type="application/rss+xml"/><item><title>Blog: Apache Beam
2.25.0</title><link>/blog/beam-2.25.0/</link><pubDate>Fri, 23 Oct 2020 14:00:00
[...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>We are happy to present the new 2.25.0 release of Apache Beam. This
release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2250-2020-10-23">download
page</a> for this release.
+For more information on changes in 2.25.0, check out the
+<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&amp;version=12347147";>detailed
release notes</a>.</p>
+<h2 id="highlights">Highlights</h2>
+<ul>
+<li>Splittable DoFn is now the default for executing the Read transform for
Java based runners (Direct, Flink, Jet, Samza, Twister2). The expected output
of the Read transform is unchanged. Users can opt-out using
<code>--experiments=use_deprecated_read</code>. The Apache Beam community
is looking for feedback for this change as the community is planning to make
this change permanent with no opt-out. If you run into an issue requiring the
opt-out, please send an e-mail to <a [...]
+</ul>
+<h2 id="ios">I/Os</h2>
+<ul>
+<li>Added cross-language support to Java&rsquo;s KinesisIO, now
available in the Python module <code>apache_beam.io.kinesis</code> (<a
href="https://issues.apache.org/jira/browse/BEAM-10138";>BEAM-10138</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-10137";>BEAM-10137</a>).</li>
+<li>Update Snowflake JDBC dependency for SnowflakeIO (<a
href="https://issues.apache.org/jira/browse/BEAM-10864";>BEAM-10864</a>)</li>
+<li>Added cross-language support to Java&rsquo;s SnowflakeIO.Write, now
available in the Python module <code>apache_beam.io.snowflake</code>
(<a
href="https://issues.apache.org/jira/browse/BEAM-9898";>BEAM-9898</a>).</li>
+<li>Added delete function to Java&rsquo;s
<code>ElasticsearchIO#Write</code>. Now, Java&rsquo;s ElasticsearchIO
can be used to selectively delete documents using
<code>withIsDeleteFn</code> function (<a
href="https://issues.apache.org/jira/browse/BEAM-5757";>BEAM-5757</a>).</li>
+<li>Java SDK: Added new IO connector for InfluxDB - InfluxDbIO (<a
href="https://issues.apache.org/jira/browse/BEAM-2546";>BEAM-2546</a>).</li>
+</ul>
+<h2 id="new-features--improvements">New Features / Improvements</h2>
+<ul>
+<li>Support for repeatable fields in JSON decoder for
<code>ReadFromBigQuery</code> added. (Python) (<a
href="https://issues.apache.org/jira/browse/BEAM-10524";>BEAM-10524</a>)</li>
+<li>Added an opt-in, performance-driven runtime type checking system for
the Python SDK (<a
href="https://issues.apache.org/jira/browse/BEAM-10549";>BEAM-10549</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-performance-runtime-type-checking/index.html";>blog
post</a>.</li>
+<li>Added support for Python 3 type annotations on PTransforms using typed
PCollections (<a
href="https://issues.apache.org/jira/browse/BEAM-10258";>BEAM-10258</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-improved-annotations/index.html";>blog
post</a>.</li>
+<li>Improved the Interactive Beam API where recording streaming jobs now
start a long running background recording job. Running ib.show() or
ib.collect() samples from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>In Interactive Beam, ib.show() and ib.collect() now have
&ldquo;n&rdquo; and &ldquo;duration&rdquo; as parameters. These
mean read only up to &ldquo;n&rdquo; elements and up to
&ldquo;duration&rdquo; seconds of data read from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>Initial preview of <a
href="https://s.apache.org/simpler-python-pipelines-2020#slide=id.g905ac9257b_1_21";>Dataframes</a>
support.
+See also example at apache_beam/examples/wordcount_dataframe.py</li>
+<li>Fixed support for type hints on <code>@ptransform_fn</code>
decorators in the Python SDK.
+(<a href="https://issues.apache.org/jira/browse/BEAM-4091";>BEAM-4091</a>)
+This has not enabled by default to preserve backwards compatibility; use the
+<code>--type_check_additional=ptransform_fn</code> flag to enable. It
may be enabled by
+default in future versions of Beam.</li>
+</ul>
+<h2 id="breaking-changes">Breaking Changes</h2>
+<ul>
+<li>Python 2 and Python 3.5 support dropped (<a
href="https://issues.apache.org/jira/browse/BEAM-10644";>BEAM-10644</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-9372";>BEAM-9372</a>).</li>
+<li>Pandas 1.x allowed. Older version of Pandas may still be used, but may
not be as well tested.</li>
+</ul>
+<h2 id="deprecations">Deprecations</h2>
+<ul>
+<li>Python transform ReadFromSnowflake has been moved from
<code>apache_beam.io.external.snowflake</code> to
<code>apache_beam.io.snowflake</code>. The previous path will be removed
in the future versions.</li>
+</ul>
+<h2 id="known-issues">Known Issues</h2>
+<ul>
+<li>Dataflow streaming timers once against not strictly time ordered when
set earlier mid-bundle, as the fix for <a
href="https://issues.apache.org/jira/browse/BEAM-8543";>BEAM-8543</a>
introduced more severe bugs and has been rolled back.</li>
+</ul>
+<h2 id="list-of-contributors">List of Contributors</h2>
+<p>According to git shortlog, the following people contributed to the
2.25.0 release. Thank you to all contributors!</p>
+<p>Ahmet Altay, Alan Myrvold, Aldair Coronel Ruiz, Alexey Romanenko, Andrew
Pilloud, Ankur Goenka,
+Ayoub ENNASSIRI, Bipin Upadhyaya, Boyuan Zhang, Brian Hulette, Brian
Michalski, Chad Dombrova,
+Chamikara Jayalath, Damon Douglas, Daniel Oliveira, David Cavazos, David
Janicek, Doug Roeper, Eric
+Roshan-Eisner, Etta Rapp, Eugene Kirpichov, Filipe Regadas, Heejong Lee, Ihor
Indyk, Irvi Firqotul
+Aini, Ismaël Mejía, Jan Lukavský, Jayendra, Jiadai Xia, Jithin Sukumar, Jozsef
Bartok, Kamil
+Gałuszka, Kamil Wasilewski, Kasia Kucharczyk, Kenneth Jung, Kenneth Knowles,
Kevin Puthusseri, Kevin
+Sijo Puthusseri, KevinGG, Kyle Weaver, Leiyi Zhang, Lourens Naudé, Luke Cwik,
Matthew Ouyang,
+Maximilian Michels, Michal Walenia, Milan Cermak, Monica Song, Nelson Osacky,
Neville Li, Ning Kang,
+Pablo Estrada, Piotr Szuberski, Qihang, Rehman, Reuven Lax, Robert Bradshaw,
Robert Burke, Rui Wang,
+Saavan Nanavati, Sam Bourne, Sam Rohde, Sam Whittle, Sergiy Kolesnikov, Sindy
Li, Siyuan Chen, Steve
+Niemitz, Terry Xian, Thomas Weise, Tobiasz Kędzierski, Truc Le, Tyson
Hamilton, Udi Meiri, Valentyn
+Tymofieiev, Yichi Zhang, Yifan Mai, Yueyang Qiu, annaqin418, danielxjd,
dennis, dp, fuyuwei,
+lostluck, nehsyc, odeshpande, odidev, pulasthi, purbanow, rworley-monster,
sclukas77, terryxian78,
+tvalentyn, yoshiki.obata</p></description></item><item><title>Blog: Apache
Beam 2.24.0</title><link>/blog/beam-2.24.0/</link><pubDate>Fri, 18 Sep 2020
00:00:01 -0800</pubDate><guid>/blog/beam-2.24.0/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -5355,27 +5428,4 @@ limitations under the License.
<li>Had multiple talks on Beam at venues including ApacheCon, Hadoop
Summit, Kafka Summit, JBCN Barcelona, and Strata.</li>
<li>Presented at multiple existing meetups and are starting to organize
some of our own.</li>
</ul>
-<p>While it’s nice to reflect back on all we’ve done, we’re working full
<em>stream</em> ahead towards a stable release and graduation from
incubator. And we’d love your help &ndash; join the <a
href="/get-started/support/">mailing lists</a>, check out the <a
href="/contribute/contribution-guide/">contribution guide</a>, and grab a
<a
href="https://issues.apache.org/jira/browse/BEAM-520?jql=project%20%3D%20BEAM%20AND%20resolution%20%3D%20Unresolved%20AND%20lab
[...]
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>We recently achieved a major milestone by adding support for windowing
to the <a href="https://flink.apache.org";>Apache Flink</a> Batch runner.
In this post we would like to explain what this means for users of Apache Beam
and highlight some of the implementation details.</p>
-<p>Before we start, though, let’s quickly talk about the execution of Beam
programs and how this is relevant to today’s post. A Beam pipeline can contain
bounded and unbounded sources. If the pipeline only contains bounded sources it
can be executed in a batch fashion, if it contains some unbounded sources it
must be executed in a streaming fashion. When executing a Beam pipeline on
Flink, you don’t have to choose the execution mode. Internally, the Flink
runner either translates the [...]
-<h2 id="what-does-this-mean-for-users">What does this mean for
users?</h2>
-<p>Support for windowing was the last missing puzzle piece for making the
Flink Batch runner compatible with the Beam model. With the latest change to
the Batch runner users can now run any pipeline that only contains bounded
sources and be certain that the results match those of the original
reference-implementation runners that were provided by Google as part of the
initial code drop coming from the Google Dataflow SDK.</p>
-<p>The most obvious part of the change is that windows can now be assigned
to elements and that the runner respects these windows for the
<code>GroupByKey</code> and <code>Combine</code> operations. A
not-so-obvious change concerns side-inputs. In the Beam model, side inputs
respect windows; when a value of the main input is being processed only the
side input that corresponds to the correct window is available to the
processing function, the <code>DoFn</code>.</p>
-<p>Getting side-input semantics right is an important milestone in it’s own
because it allows to use a big suite of unit tests for verifying the
correctness of a runner implementation. These tests exercise every obscure
detail of the Beam programming model and verify that the results produced by a
runner match what you would expect from a correct implementation. In the suite,
side inputs are used to compare the expected result to the actual result. With
these tests being executed regu [...]
-<h2 id="under-the-hood">Under the Hood</h2>
-<p>The basis for the changes is the introduction of
<code>WindowedValue</code> in the generated Flink transformations.
Before, a Beam <code>PCollection&lt;T&gt;</code> would be
transformed to a <code>DataSet&lt;T&gt;</code>. Now, we instead
create a
<code>DataSet&lt;WindowedValue&lt;T&gt;&gt;</code>. The
<code>WindowedValue&lt;T&gt;</code> stores meta data about the
value, such as the timestamp and the windows to wh [...]
-<p>With this basic change out of the way we just had to make sure that
windows were respected for side inputs and that <code>Combine</code> and
<code>GroupByKey</code> correctly handled windows. The tricky part there
is the handling of merging windows such as session windows. For these we
essentially emulate the behavior of a merging <code>WindowFn</code> in
our own code.</p>
-<p>After we got side inputs working we could enable the aforementioned
suite of tests to check how well the runner behaves with respect to the Beam
model. As can be expected there were quite some discrepancies but we managed to
resolve them all. In the process, we also slimmed down the runner
implementation. For example, we removed all custom translations for sources and
sinks and are now relying only on Beam code for these, thereby greatly reducing
the maintenance overhead.</p>
-<h2 id="summary">Summary</h2>
-<p>We reached a major milestone in adding windowing support to the Flink
Batch runner, thereby making it compatible with the Beam model. Because of the
large suite of tests that can now be executed on the runner we are also
confident about the correctness of the implementation and about it staying that
way in the future.</p></description></item></channel></rss>
\ No newline at end of file
+<p>While it’s nice to reflect back on all we’ve done, we’re working full
<em>stream</em> ahead towards a stable release and graduation from
incubator. And we’d love your help &ndash; join the <a
href="/get-started/support/">mailing lists</a>, check out the <a
href="/contribute/contribution-guide/">contribution guide</a>, and grab a
<a
href="https://issues.apache.org/jira/browse/BEAM-520?jql=project%20%3D%20BEAM%20AND%20resolution%20%3D%20Unresolved%20AND%20lab
[...]
\ No newline at end of file
diff --git a/website/generated-content/categories/index.xml
b/website/generated-content/categories/index.xml
index 81dd796..4ef8703 100644
--- a/website/generated-content/categories/index.xml
+++ b/website/generated-content/categories/index.xml
@@ -1 +1 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Categories</title><link>/categories/</link><description>Recent content in
Categories on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 18 Sep 2020 00:00:01
-0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self"
type="application/rss+xml"/></channel></rss>
\ No newline at end of file
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Categories</title><link>/categories/</link><description>Recent content in
Categories on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 23 Oct 2020 14:00:00
-0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self"
type="application/rss+xml"/></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/feed.xml
b/website/generated-content/feed.xml
index 5e5ca78..2a06602 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -1,4 +1,77 @@
-<rss xmlns:atom="http://www.w3.org/2005/Atom";
version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an
open source, unified model and set of language-specific SDKs for defining and
executing data processing workflows, and also data ingestion and integration
flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific
Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale
batch and streaming data processing and can run on a number [...]
+<rss xmlns:atom="http://www.w3.org/2005/Atom";
version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an
open source, unified model and set of language-specific SDKs for defining and
executing data processing workflows, and also data ingestion and integration
flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific
Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale
batch and streaming data processing and can run on a number [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>We are happy to present the new 2.25.0 release of Apache Beam. This
release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2250-2020-10-23">download
page</a> for this release.
+For more information on changes in 2.25.0, check out the
+<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&amp;version=12347147";>detailed
release notes</a>.</p>
+<h2 id="highlights">Highlights</h2>
+<ul>
+<li>Splittable DoFn is now the default for executing the Read transform for
Java based runners (Direct, Flink, Jet, Samza, Twister2). The expected output
of the Read transform is unchanged. Users can opt-out using
<code>--experiments=use_deprecated_read</code>. The Apache Beam community
is looking for feedback for this change as the community is planning to make
this change permanent with no opt-out. If you run into an issue requiring the
opt-out, please send an e-mail to <a [...]
+</ul>
+<h2 id="ios">I/Os</h2>
+<ul>
+<li>Added cross-language support to Java&rsquo;s KinesisIO, now
available in the Python module <code>apache_beam.io.kinesis</code> (<a
href="https://issues.apache.org/jira/browse/BEAM-10138";>BEAM-10138</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-10137";>BEAM-10137</a>).</li>
+<li>Update Snowflake JDBC dependency for SnowflakeIO (<a
href="https://issues.apache.org/jira/browse/BEAM-10864";>BEAM-10864</a>)</li>
+<li>Added cross-language support to Java&rsquo;s SnowflakeIO.Write, now
available in the Python module <code>apache_beam.io.snowflake</code>
(<a
href="https://issues.apache.org/jira/browse/BEAM-9898";>BEAM-9898</a>).</li>
+<li>Added delete function to Java&rsquo;s
<code>ElasticsearchIO#Write</code>. Now, Java&rsquo;s ElasticsearchIO
can be used to selectively delete documents using
<code>withIsDeleteFn</code> function (<a
href="https://issues.apache.org/jira/browse/BEAM-5757";>BEAM-5757</a>).</li>
+<li>Java SDK: Added new IO connector for InfluxDB - InfluxDbIO (<a
href="https://issues.apache.org/jira/browse/BEAM-2546";>BEAM-2546</a>).</li>
+</ul>
+<h2 id="new-features--improvements">New Features / Improvements</h2>
+<ul>
+<li>Support for repeatable fields in JSON decoder for
<code>ReadFromBigQuery</code> added. (Python) (<a
href="https://issues.apache.org/jira/browse/BEAM-10524";>BEAM-10524</a>)</li>
+<li>Added an opt-in, performance-driven runtime type checking system for
the Python SDK (<a
href="https://issues.apache.org/jira/browse/BEAM-10549";>BEAM-10549</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-performance-runtime-type-checking/index.html";>blog
post</a>.</li>
+<li>Added support for Python 3 type annotations on PTransforms using typed
PCollections (<a
href="https://issues.apache.org/jira/browse/BEAM-10258";>BEAM-10258</a>).
+More details will be in an upcoming <a
href="https://beam.apache.org/blog/python-improved-annotations/index.html";>blog
post</a>.</li>
+<li>Improved the Interactive Beam API where recording streaming jobs now
start a long running background recording job. Running ib.show() or
ib.collect() samples from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>In Interactive Beam, ib.show() and ib.collect() now have
&ldquo;n&rdquo; and &ldquo;duration&rdquo; as parameters. These
mean read only up to &ldquo;n&rdquo; elements and up to
&ldquo;duration&rdquo; seconds of data read from the recording (<a
href="https://issues.apache.org/jira/browse/BEAM-10603";>BEAM-10603</a>).</li>
+<li>Initial preview of <a
href="https://s.apache.org/simpler-python-pipelines-2020#slide=id.g905ac9257b_1_21";>Dataframes</a>
support.
+See also example at apache_beam/examples/wordcount_dataframe.py</li>
+<li>Fixed support for type hints on <code>@ptransform_fn</code>
decorators in the Python SDK.
+(<a href="https://issues.apache.org/jira/browse/BEAM-4091";>BEAM-4091</a>)
+This has not enabled by default to preserve backwards compatibility; use the
+<code>--type_check_additional=ptransform_fn</code> flag to enable. It
may be enabled by
+default in future versions of Beam.</li>
+</ul>
+<h2 id="breaking-changes">Breaking Changes</h2>
+<ul>
+<li>Python 2 and Python 3.5 support dropped (<a
href="https://issues.apache.org/jira/browse/BEAM-10644";>BEAM-10644</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-9372";>BEAM-9372</a>).</li>
+<li>Pandas 1.x allowed. Older version of Pandas may still be used, but may
not be as well tested.</li>
+</ul>
+<h2 id="deprecations">Deprecations</h2>
+<ul>
+<li>Python transform ReadFromSnowflake has been moved from
<code>apache_beam.io.external.snowflake</code> to
<code>apache_beam.io.snowflake</code>. The previous path will be removed
in the future versions.</li>
+</ul>
+<h2 id="known-issues">Known Issues</h2>
+<ul>
+<li>Dataflow streaming timers once against not strictly time ordered when
set earlier mid-bundle, as the fix for <a
href="https://issues.apache.org/jira/browse/BEAM-8543";>BEAM-8543</a>
introduced more severe bugs and has been rolled back.</li>
+</ul>
+<h2 id="list-of-contributors">List of Contributors</h2>
+<p>According to git shortlog, the following people contributed to the
2.25.0 release. Thank you to all contributors!</p>
+<p>Ahmet Altay, Alan Myrvold, Aldair Coronel Ruiz, Alexey Romanenko, Andrew
Pilloud, Ankur Goenka,
+Ayoub ENNASSIRI, Bipin Upadhyaya, Boyuan Zhang, Brian Hulette, Brian
Michalski, Chad Dombrova,
+Chamikara Jayalath, Damon Douglas, Daniel Oliveira, David Cavazos, David
Janicek, Doug Roeper, Eric
+Roshan-Eisner, Etta Rapp, Eugene Kirpichov, Filipe Regadas, Heejong Lee, Ihor
Indyk, Irvi Firqotul
+Aini, Ismaël Mejía, Jan Lukavský, Jayendra, Jiadai Xia, Jithin Sukumar, Jozsef
Bartok, Kamil
+Gałuszka, Kamil Wasilewski, Kasia Kucharczyk, Kenneth Jung, Kenneth Knowles,
Kevin Puthusseri, Kevin
+Sijo Puthusseri, KevinGG, Kyle Weaver, Leiyi Zhang, Lourens Naudé, Luke Cwik,
Matthew Ouyang,
+Maximilian Michels, Michal Walenia, Milan Cermak, Monica Song, Nelson Osacky,
Neville Li, Ning Kang,
+Pablo Estrada, Piotr Szuberski, Qihang, Rehman, Reuven Lax, Robert Bradshaw,
Robert Burke, Rui Wang,
+Saavan Nanavati, Sam Bourne, Sam Rohde, Sam Whittle, Sergiy Kolesnikov, Sindy
Li, Siyuan Chen, Steve
+Niemitz, Terry Xian, Thomas Weise, Tobiasz Kędzierski, Truc Le, Tyson
Hamilton, Udi Meiri, Valentyn
+Tymofieiev, Yichi Zhang, Yifan Mai, Yueyang Qiu, annaqin418, danielxjd,
dennis, dp, fuyuwei,
+lostluck, nehsyc, odeshpande, odidev, pulasthi, purbanow, rworley-monster,
sclukas77, terryxian78,
+tvalentyn,
yoshiki.obata</p></description><link>/blog/beam-2.25.0/</link><pubDate>Fri,
23 Oct 2020 14:00:00
-0800</pubDate><guid>/blog/beam-2.25.0/</guid><category>blog</category></item><item><title>Apache
Beam 2.24.0</title><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -825,34 +898,4 @@ Schema Options, it will be removed in version
<code>2.23.0</code>. (<a
</ul>
<h2 id="list-of-contributors">List of Contributors</h2>
<p>According to git shortlog, the following people contributed to the
2.21.0 release. Thank you to all contributors!</p>
-<p>Aaron Meihm, Adrian Eka, Ahmet Altay, AldairCoronel, Alex Van Boxel,
Alexey Romanenko, Andrew Crites, Andrew Pilloud, Ankur Goenka, Badrul (Taki)
Chowdhury, Bartok Jozsef, Boyuan Zhang, Brian Hulette, brucearctor,
bumblebee-coming, Chad Dombrova, Chamikara Jayalath, Chie Hayashida, Chris
Gorgolewski, Chuck Yang, Colm O hEigeartaigh, Curtis
&ldquo;Fjord&rdquo; Hawthorne, Daniel Mills, Daniel Oliveira, David
Yan, Elias Djurfeldt, Emiliano Capoccia, Etienne Chauchot, Fernando [...]
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>As some of you are already aware, the 2020 edition of the Beam Summit
will be completely <strong>digital and free</strong>. Beam Summit Digital
will take place from <strong>August 24th to 28th</strong>. The conference
will be spread across the course of one week with a couple of hours of program
each day.</p>
-<p><img class="center-block"
-src="/images/blog/beamsummit/beamsummit-digital-2020.png"
-alt="Beam Summit Digital 2020, August 24-28"></p>
-<p>While we would have loved to see all of you in person, we have to accept
that 2020 will not be the year for that. So, we are looking at this as an
opportunity to have a bigger and more inclusive event, where people who would
normally not be able to travel to the summit will now be able to join, learn
and share with the rest of the community.</p>
-<h2 id="providing-you-the-best-experience-possible">Providing you the best
experience possible</h2>
-<p>We are going to great lengths to ensure that we provide the Beam
community with the best possible experience in an online event. From
audio/video quality, to an adequate schedule for our community, to making it as
easy as possible to register to the event and join the sessions, to setting up
ways for the community to interact and network with each other. The team behind
the organization of the Beam Summit has been working on these things, and we
are also teaming up with an event pr [...]
-<p>So, what we want to say with this is: We will have a great event! And if
you have any ideas on how to make it better, please let us know.</p>
-<h2 id="ways-to-participate-and-help">Ways to participate and help</h2>
-<p>As all things Beam, this is a community effort. The door is open for
participation:</p>
-<ol>
-<li>Submit a proposal to talk. Please check out the <strong><a
href="https://sessionize.com/beam-digital-summit-2020/";>Call for
Papers</a></strong> and submit a talk. The deadline for submissions is
<em>June 15th</em>!</li>
-<li>Register to join as an attendee. Registration is now open at the
<strong><a href="https://crowdcast.io/e/beamsummit";>registration
page</a></strong>. Registration is free!</li>
-<li>Consider sponsoring the event. If your company is interested in
engaging with members of the community please check out our <a
href="https://drive.google.com/open?id=1EbijvZKpkWwWyMryLY9sJfyZzZk1k44v";>sponsoring
prospectus</a>.</li>
-<li>Help us get the word out. Please make sure to let your colleagues and
friends in the data engineering field (and beyond!) know about the Beam
Summit.</li>
-</ol>
-<h2 id="follow-up-and-more-information">Follow up and more
information</h2>
-<p>While we will use the Crowdcast platform to broadcast the event, we will
still have a full event website at <a
href="https://beamsummit.org";>beamsummit.org</a> with details about the
schedule, speakers, FAQ and everything else you need from an event. We are
currently working on updating the website and will publish all event details in
the next couple of weeks.</p>
-<p>Please also follow us on <a
href="https://twitter.com/beamsummit";>Twitter</a> or <a
href="https://www.linkedin.com/company/beam-summit/";>LinkedIn</a> to get
event
updates.</p></description><link>/blog/beam-summit-digital-2020/</link><pubDate>Fri,
08 May 2020 00:00:01
-0800</pubDate><guid>/blog/beam-summit-digital-2020/</guid><category>blog</category></item></channel></rss>
\ No newline at end of file
+<p>Aaron Meihm, Adrian Eka, Ahmet Altay, AldairCoronel, Alex Van Boxel,
Alexey Romanenko, Andrew Crites, Andrew Pilloud, Ankur Goenka, Badrul (Taki)
Chowdhury, Bartok Jozsef, Boyuan Zhang, Brian Hulette, brucearctor,
bumblebee-coming, Chad Dombrova, Chamikara Jayalath, Chie Hayashida, Chris
Gorgolewski, Chuck Yang, Colm O hEigeartaigh, Curtis
&ldquo;Fjord&rdquo; Hawthorne, Daniel Mills, Daniel Oliveira, David
Yan, Elias Djurfeldt, Emiliano Capoccia, Etienne Chauchot, Fernando [...]
\ No newline at end of file
diff --git a/website/generated-content/index.html
b/website/generated-content/index.html
index 70cd797..2375591 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/index.html
@@ -5,7 +5,7 @@
<a class="button button--primary" href=/get-started/try-apache-beam/>Try
Beam</a>
<a class="button button--primary" href=/get-started/downloads/>Download Beam
SDK 2.25.0</a></div><div class=hero__ctas><a class=button
href=/get-started/quickstart-java/>Java Quickstart</a>
<a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
-<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><div class=hero__cols__col><div
class=hero__blog><div class=hero__blog__title>The latest from the
blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card
href=/blog/beam-2.24.0/><div class=hero__blog__cards__card__title>Apache Beam
2.24.0</div><div class=hero__blog__cards__card__date>Sep 18, 2020</div></a><a
class=hero__blog__cards__card href=/blog/pattern-match-beam-sql/><div
class=hero__ [...]
+<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><div class=hero__cols__col><div
class=hero__blog><div class=hero__blog__title>The latest from the
blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card
href=/blog/beam-2.25.0/><div class=hero__blog__cards__card__title>Apache Beam
2.25.0</div><div class=hero__blog__cards__card__date>Oct 23, 2020</div></a><a
class=hero__blog__cards__card href=/blog/beam-2.24.0/><div
class=hero__blog__cards [...]
<a class="button button--primary" href=/get-started/downloads/>Download Beam
SDK 2.25.0</a></div><div class=ctas__ctas><a class=button
href=/get-started/quickstart-java/>Java Quickstart</a>
<a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div
class=footer__cols__col><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__col
footer__cols__col--md"><div class=foo [...]
diff --git a/website/generated-content/roadmap/go-sdk/index.html
b/website/generated-content/roadmap/go-sdk/index.html
index e061eb7..d1fb60a 100644
--- a/website/generated-content/roadmap/go-sdk/index.html
+++ b/website/generated-content/roadmap/go-sdk/index.html
@@ -10,7 +10,7 @@ playing with on Flink, and the Python Direct Runner,
answering the scalable batc
There’s much work getting the portability protos to a stable baseline.
This will allow runner
and SDK independance, so they don’t need to be updated in lockstep.
Finally, the Go SDK should
adopt Go Modules as it’s versioning solution, and officially
“catch up” with the current beam
-version.</p><p>The Go SDK has the following goals for the next few
months:</p><h2 id=usability>Usability</h2><ul><li>Beam Schema Support <a
href=https://issues.apache.org/jira/browse/BEAM-4124>BEAM-9615</a></li><li>Improvements
to starcgen <a
href=https://issues.apache.org/jira/browse/BEAM-9616>BEAM-9616</a></li></ul><h2
id=integrating-with-the-go-ecosystem>Integrating with the Go
ecosystem</h2><p>The authors of the Go SDK intended to keep the parts of the
language we love, and intend for
+version.</p><p>The Go SDK has the following goals for the next few
months:</p><h2 id=usability>Usability</h2><ul><li>Beam Schema Support <a
href=https://issues.apache.org/jira/browse/BEAM-9615>BEAM-9615</a></li><li>Improvements
to starcgen <a
href=https://issues.apache.org/jira/browse/BEAM-9616>BEAM-9616</a></li></ul><h2
id=integrating-with-the-go-ecosystem>Integrating with the Go
ecosystem</h2><p>The authors of the Go SDK intended to keep the parts of the
language we love, and intend for
user pipelines to be as close to ordinary Go as possible, minimizing framework
boiler plate code.</p><ul><li>Migrate to a vanity URL path <a
href=https://issues.apache.org/jira/browse/BEAM-4115>BEAM-4115</a></li><li>Package
versioning support <a
href=https://issues.apache.org/jira/browse/BEAM-5379>BEAM-5379</a></li></ul><h2
id=implement-portability-features>Implement Portability features</h2><p>The
following are dependant on the features being implemented in the Portability
Framework.</p [...]
which makes scalable IOs difficult to impossible to write.</p><p>Otherwise,
improving examples and documentation for devs and users alike is ongoing.
Contributions are welcome. Please contact the <a
href="mailto:[email protected]?subject=%5BGo%20SDK%5D%20How%20can%20I%20help%3F";>dev
list</a>
diff --git a/website/generated-content/roadmap/index.xml
b/website/generated-content/roadmap/index.xml
index dde89f5..9250c48 100644
--- a/website/generated-content/roadmap/index.xml
+++ b/website/generated-content/roadmap/index.xml
@@ -180,7 +180,7 @@ version.</p>
<p>The Go SDK has the following goals for the next few months:</p>
<h2 id="usability">Usability</h2>
<ul>
-<li>Beam Schema Support <a
href="https://issues.apache.org/jira/browse/BEAM-4124";>BEAM-9615</a></li>
+<li>Beam Schema Support <a
href="https://issues.apache.org/jira/browse/BEAM-9615";>BEAM-9615</a></li>
<li>Improvements to starcgen <a
href="https://issues.apache.org/jira/browse/BEAM-9616";>BEAM-9616</a></li>
</ul>
<h2 id="integrating-with-the-go-ecosystem">Integrating with the Go
ecosystem</h2>
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 0691fc9..e9d0394 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.24.0/</loc><lastmod>2020-09-18T12:38:38-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-09-18T12:38:38-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-09-18T12:38:38-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-09-18T12:38:38-07:00</lastmod></url><url><loc>/blog/p
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.25.0/</loc><lastmod>2020-10-26T10:46:37-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-10-26T10:46:37-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-10-26T10:46:37-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-10-26T10:46:37-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file
