This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 21c779c Publishing website 2021/01/20 18:02:55 at commit 8d6fd6a
21c779c is described below
commit 21c779c038fe567a96aa8afd865e5e68459d9e59
Author: jenkins <[email protected]>
AuthorDate: Wed Jan 20 18:02:56 2021 +0000
Publishing website 2021/01/20 18:02:55 at commit 8d6fd6a
---
.../generated-content/blog/beam-2.27.0/index.html | 2 +-
website/generated-content/blog/index.html | 9 +-
website/generated-content/blog/index.xml | 124 +++++++++++---------
.../blog/kafka-to-pubsub-example/index.html | 37 ++++++
.../generated-content/categories/blog/index.xml | 124 +++++++++++---------
website/generated-content/categories/index.xml | 2 +-
.../generated-content/categories/java/index.html | 7 ++
.../generated-content/categories/java/index.xml | 69 +++++++++++
website/generated-content/feed.xml | 129 ++++++++++++---------
website/generated-content/index.html | 2 +-
website/generated-content/sitemap.xml | 2 +-
11 files changed, 338 insertions(+), 169 deletions(-)
diff --git a/website/generated-content/blog/beam-2.27.0/index.html
b/website/generated-content/blog/beam-2.27.0/index.html
index 9bd3ec7..8176f2c 100644
--- a/website/generated-content/blog/beam-2.27.0/index.html
+++ b/website/generated-content/blog/beam-2.27.0/index.html
@@ -6,7 +6,7 @@
Pablo Estrada [<a
href=https://twitter.com/polecitoem>@polecitoem</a>]</p></header><div
class=post-content itemprop=articleBody><p>We are happy to present the new
2.27.0 release of Apache Beam. This release includes both improvements and new
functionality.
See the <a href=/get-started/downloads/#2270-2020-12-22>download page</a> for
this release.
For more information on changes in 2.27.0, check out the
-<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349380";>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Java 11
Containers are now published with all Beam releases.</li><li>There is a new
transform <code>ReadAllFromBigQuery</code> that can receive multiple requests
to read data from BigQuery at pipeline runtime. See <a
href=https://github.com/apache/beam/pull/13170>PR 13170</a>, and <a
href=https://issues.apache.org/jir [...]
+<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349380";>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Java 11
Containers are now published with all Beam releases.</li><li>There is a new
transform <code>ReadAllFromBigQuery</code> that can receive multiple requests
to read data from BigQuery at pipeline runtime. See <a
href=https://github.com/apache/beam/pull/13170>PR 13170</a>, and <a
href=https://issues.apache.org/jir [...]
Andrew Pilloud, andreyKaparulin, Ashwin Ramaswami, Boyuan Zhang, Brent Worden,
Brian Hulette,
Carlos Marin, Chamikara Jayalath, Costi Ciudatu, Damon Douglas, Daniel Collins,
Daniel Oliveira, David Huntsperger, David Lu, David Moravek, David Wrede,
diff --git a/website/generated-content/blog/index.html
b/website/generated-content/blog/index.html
index 9610068..b2939c9 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -1,7 +1,14 @@
<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport
content="width=device-width,initial-scale=1"><title>Blogs</title><meta
name=description content="Apache Beam is an open source, unified model and set
of language-specific SDKs for defining and executing data processing workflows,
and also data ingestion and integration flows, supporting Enterprise
Integration Patterns (EIPs) and Domain Specific Languag [...]
<span class=sr-only>Toggle navigation</span>
<span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
-<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+•
+Artur Khanin
+,
+Ilya Kozyrev
+,
+&
+Alex Kosolapov</i></p>In this blog post we present an example that creates a
pipeline to read data from a single topic or multiple topics from Apache Kafka
and write data into a topic in Google Pub/Sub.<p><a class="btn btn-default
btn-sm" href=/blog/kafka-to-pubsub-example/ role=button>Read more <span
class="glyphicon glyphicon-menu-right"
aria-hidden=true></span></a></p><hr><h3><a class=post-link
href=/blog/beam-2.27.0/>Apache Beam 2.27.0</a></h3><p><i>Jan 7, 2021
•
Pablo Estrada [<a
href=https://twitter.com/polecitoem>@polecitoem</a>]</i></p>We are happy to
present the new 2.<p><a class="btn btn-default btn-sm" href=/blog/beam-2.27.0/
role=button>Read more <span class="glyphicon glyphicon-menu-right"
aria-hidden=true></span></a></p><hr><h3><a class=post-link
href=/blog/dataframe-api-preview-available/>DataFrame API Preview now
Available!</a></h3><p><i>Dec 16, 2020
•
diff --git a/website/generated-content/blog/index.xml
b/website/generated-content/blog/index.xml
index 7e85dfb..1f81d0d 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -1,4 +1,72 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache
Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Thu,
07 Jan 2021 12:00:00 -0800</lastBuildDate><atom:link href="/blog/index.xml"
rel="self" type="application/rss+xml"/><item><title>Blog: Apache Beam
2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00
-0800</pubDate><gui [...]
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache
Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri,
15 Jan 2021 00:00:01 -0800</lastBuildDate><atom:link href="/blog/index.xml"
rel="self" type="application/rss+xml"/><item><title>Blog: Example to ingest
data from Apache Kafka to Google Cloud
Pub/Sub</title><link>/blog/kafka-to-pubsub-example/</l [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>In this blog post we present an example that creates a pipeline to read
data from a single topic or
+multiple topics from <a href="https://kafka.apache.org/";>Apache
Kafka</a> and write data into a topic
+in <a href="https://cloud.google.com/pubsub";>Google Pub/Sub</a>. The
example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution
that you can just <em>&rdquo;
+plug&rsquo;n&rsquo;play&rdquo;</em>.</p>
+<p>This end-to-end example is included
+in <a href="https://beam.apache.org/blog/beam-2.27.0/";>Apache Beam release
2.27</a>
+and can be downloaded <a
href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22";>here</a>.</p>
+<p>We hope you will find this example useful for setting up data pipelines
between Kafka and Pub/Sub.</p>
+<h1 id="example-specs">Example specs</h1>
+<p>Supported data formats:</p>
+<ul>
+<li>Serializable plain text formats, such as JSON</li>
+<li><a
href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage";>PubSubMessage</a></li>
+</ul>
+<p>Supported input source configurations:</p>
+<ul>
+<li>Single or multiple Apache Kafka bootstrap servers</li>
+<li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL
connection</li>
+<li>Secrets vault service <a
href="https://www.vaultproject.io/";>HashiCorp Vault</a></li>
+</ul>
+<p>Supported destination configuration:</p>
+<ul>
+<li>Single Google Pub/Sub topic</li>
+</ul>
+<p>In a simple scenario, the example will create an Apache Beam pipeline
that will read messages from a
+source Kafka server with a source topic, and stream the text messages into
specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication,
that can be performed
+over plaintext or SSL encrypted connection. The example supports using a
single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support
SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets
vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p>
+<h1 id="where-can-i-run-this-example">Where can I run this example?</h1>
+<p>There are two ways to execute the pipeline.</p>
+<ol>
+<li>Locally. This way has many options - run directly from your IntelliJ,
or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam
pipelines.</li>
+<li>In <a href="https://cloud.google.com/";>Google Cloud</a> using
Google
+Cloud <a href="https://cloud.google.com/dataflow";>Dataflow</a>:
+<ul>
+<li>With <code>gcloud</code> command-line tool you can create
+a <a
href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates";>Flex
Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This
requires corresponding
+modifications of the example to turn it into a template.</em></li>
+<li>This example exists as
+a <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub";>Flex
Template version</a>
+within <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates";>Google Cloud
Dataflow Template Pipelines</a>
+repository and can be run with no additional code modifications.</li>
+</ul>
+</li>
+</ol>
+<h1 id="next-steps">Next Steps</h1>
+<p>Give this <strong>Beam end-to-end example</strong> a try. If you
are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already
using Beam, we hope
+some code samples in it will be useful for your use cases.</p>
+<p>Please
+<a href="https://beam.apache.org/community/contact-us/";>let us know</a>
if you encounter any issues.</p></description></item><item><title>Blog:
Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan
2021 12:00:00 -0800</pubDate><guid>/blog/beam-2.27.0/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
<li>Added Cloud Bigtable Provider extension to Beam SQL (<a
href="https://issues.apache.org/jira/browse/BEAM-11173";>BEAM-11173</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-11373";>BEAM-11373</a>)</li>
<li>Added a schema provider for thrift data (<a
href="https://issues.apache.org/jira/browse/BEAM-11338";>BEAM-11338</a>)</li>
<li>Added combiner packing pipeline optimization to Dataflow runner. (<a
href="https://issues.apache.org/jira/browse/BEAM-10641";>BEAM-10641</a>)</li>
+<li>Added an example to ingest data from Apache Kafka to Google Pub/Sub.
(<a
href="https://issues.apache.org/jira/browse/BEAM-11065";>BEAM-11065</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
<ul>
@@ -5333,55 +5402,4 @@ see the level of support for this new model feature on
your favorite
backend(s).</p>
<p>And please do join the community at
<a href="/get-started/support">[email protected]</a>. We&rsquo;d
love to
-hear from you.</p></description></item><item><title>Blog: Media recap of
the Apache Beam
graduation</title><link>/blog/graduation-media-recap/</link><pubDate>Wed, 01
Feb 2017 00:00:01
-0800</pubDate><guid>/blog/graduation-media-recap/</guid><description>
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>One year ago today Apache Beam was accepted into incubation at the Apache
-Software Foundation. The community&rsquo;s work over the past year
culminated, just
-over three weeks ago, with an <a
href="/blog/2017/01/10/beam-graduates.html">announcement</a>
-that Apache Beam has successfully graduated as a new Top-Level Project at the
-foundation. Graduation sparked an additional interest in the project, from
-corporate endorsements, news articles, interviews, to the volume of traffic to
-our website and mailing lists.</p>
-<p>Corporate endorsements include Google, PayPal, Talend, data Artisans, and
-others. You can read more in the following blog posts:</p>
-<ul>
-<li>Google: &ldquo;<a
href="https://opensource.googleblog.com/2017/01/apache-beam-graduates.html";>Apache
Beam graduates to a top-level project</a>&rdquo; by Tyler
Akidau.</li>
-<li>Talend: &ldquo;<a
href="https://www.talend.com/blog/2017/01/13/future-apache-beam-now-top-level-apache-software-foundation-project/";>The
Future of Apache Beam, Now a Top-Level Apache Software Foundation
Project</a>&rdquo; by Jean-Baptiste Onofré.</li>
-<li>Talend: &ldquo;<a
href="https://www.talend.com/blog/2017/01/23/apache-beam-way-greater-data-agility/?utm_medium=socialpost&amp;utm_source=twitter&amp;utm_campaign=blog";>Apache
Beam Your Way to Greater Data Agility</a>&rdquo; by Shane Kent.</li>
-<li>Google: &ldquo;<a
href="https://cloud.google.com/blog/big-data/2017/01/apache-beam-graduates-from-incubation-try-it-today-on-google-cloud-dataflow";>Apache
Beam graduates from incubation: Try it today on Google Cloud
Dataflow</a>&rdquo; by Frances Perry.</li>
-</ul>
-<p>News coverage started with the Apache Software Foundation’s press
release in
-<a
href="https://globenewswire.com/news-release/2017/01/10/904692/0/en/The-Apache-Software-Foundation-Announces-Apache-Beam-as-a-Top-Level-Project.html";>Nasdaq
GlobeNewswire</a>,
-and followed by coverage in many independent outlets. Some of those in English
-include:</p>
-<ul>
-<li>ZDNet: &ldquo;<a
href="https://www.zdnet.com/article/apache-beam-and-spark-new-coopetition-for-squashing-the-lambda-architecture/";>Apache
Beam and Spark: New coopetition for squashing the Lambda
Architecture?</a>&rdquo; by Tony Baer.</li>
-<li>Datanami: &ldquo;<a
href="https://www.datanami.com/2017/01/10/google-lauds-outside-influence-apache-beam/";>Google
Lauds Outside Influence on Apache Beam</a>&rdquo; by Alex
Woodie.</li>
-<li>InfoWorld / JavaWorld: &ldquo;<a
href="https://www.infoworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html";>Apache
Beam unifies batch and streaming for big data</a>&rdquo; by Serdar
Yegulalp, and republished in <a
href="https://www.javaworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html";>JavaWorld</a>.</li>
-<li>JAXenter: &ldquo;<a
href="https://jaxenter.com/apache-beam-interview-131314.html";>In a way, Apache
Beam is the glue that connects many big data systems together</a>&rdquo;
by Kypriani Sinaris.</li>
-<li>OStatic: &ldquo;Apache Beam Unifies Batch and Streaming Data
Processing&rdquo; by Sam Dean. <!--
http://ostatic.com/blog/apache-beam-unifies-batch-and-streaming-data-processing
--></li>
-<li>Enterprise Apps Today: &ldquo;<a
href="http://www.enterpriseappstoday.com/business-intelligence/data-analytics/apache-beam-graduates-to-help-define-streaming-data-processing.html";>Apache
Beam Graduates to Help Define Streaming Data Processing</a>&rdquo; by
Sean Michael Kerner.</li>
-<li>The Register: &ldquo;<a
href="https://www.theregister.co.uk/2017/01/10/google_must_be_ibeamiing_as_apache_announces_its_new_top_level_projects/";>Google
must be Beaming as Apache announces its new top-level
projects</a>&rdquo; by Alexander J. Martin.</li>
-<li>SiliconANGLE: &ldquo;<a
href="https://siliconangle.com/blog/2017/01/11/apache-software-foundation-announces-2-top-level-projects/";>Apache
Software Foundation announces two more top-level open source
projects</a>&rdquo; by Mike Wheatley.</li>
-<li>SD Times: &ldquo;<a
href="https://sdtimes.com/apache-beam-goes-top-level/";>Apache Beam goes top
level</a>&rdquo; by Alex Handy.</li>
-</ul>
-<p>Graduation and media coverage helped push Beam website traffic to record
levels.
-The website traffic, measured in unique sessions per hour, peaked at more than
-15 times above the previous week’s numbers. In a steady state, the traffic is
-several times larger than before graduation.</p>
-<p>Hopefully these perspectives entice you to join us on this exciting
ride, either
-as a user or a contributor, as we work towards our first release with API
-stability. If you’d like to try out Apache Beam today, check out the latest
-<a href="/get-started/downloads/">0.4.0 release</a>. We welcome
-contribution and participation from anyone through our mailing lists, issue
-tracker, pull requests, and events.</p></description></item></channel></rss>
\ No newline at end of file
+hear from you.</p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/blog/kafka-to-pubsub-example/index.html
b/website/generated-content/blog/kafka-to-pubsub-example/index.html
new file mode 100644
index 0000000..0f6bfc6
--- /dev/null
+++ b/website/generated-content/blog/kafka-to-pubsub-example/index.html
@@ -0,0 +1,37 @@
+<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport
content="width=device-width,initial-scale=1"><title>Example to ingest data from
Apache Kafka to Google Cloud Pub/Sub</title><meta name=description
content="Apache Beam is an open source, unified model and set of
language-specific SDKs for defining and executing data processing workflows,
and also data ingestion and integration flows, supporting Enterpr [...]
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+•
+Artur Khanin
+,
+Ilya Kozyrev
+,
+&
+Alex Kosolapov</p></header><div class=post-content itemprop=articleBody><p>In
this blog post we present an example that creates a pipeline to read data from
a single topic or
+multiple topics from <a href=https://kafka.apache.org/>Apache Kafka</a> and
write data into a topic
+in <a href=https://cloud.google.com/pubsub>Google Pub/Sub</a>. The example
provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution
that you can just <em>”
+plug’n’play”</em>.</p><p>This end-to-end example is included
+in <a href=https://beam.apache.org/blog/beam-2.27.0/>Apache Beam release
2.27</a>
+and can be downloaded <a
href=https://beam.apache.org/get-started/downloads/#2270-2020-12-22>here</a>.</p><p>We
hope you will find this example useful for setting up data pipelines between
Kafka and Pub/Sub.</p><h1 id=example-specs>Example specs</h1><p>Supported data
formats:</p><ul><li>Serializable plain text formats, such as JSON</li><li><a
href=https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage>PubSubMessage</a></li></ul><p>Supported
input source configurations:</p>< [...]
+source Kafka server with a source topic, and stream the text messages into
specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication,
that can be performed
+over plaintext or SSL encrypted connection. The example supports using a
single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support
SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets
vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p><h1
id=where-can-i-run-this-example>Where can I run this example?</h1><p>There are
two ways to execute the pipeline.</p><ol><li>Locally. This way has many options
- run directly from your IntelliJ, or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam
pipelines.</li><li>In <a href=https://cloud.google.com/>Google Cloud</a> using
Google
+Cloud <a href=https://cloud.google.com/dataflow>Dataflow</a>:<ul><li>With
<code>gcloud</code> command-line tool you can create
+a <a
href=https://cloud.google.com/dataflow/docs/concepts/dataflow-templates>Flex
Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This
requires corresponding
+modifications of the example to turn it into a template.</em></li><li>This
example exists as
+a <a
href=https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub>Flex
Template version</a>
+within <a href=https://github.com/GoogleCloudPlatform/DataflowTemplates>Google
Cloud Dataflow Template Pipelines</a>
+repository and can be run with no additional code
modifications.</li></ul></li></ol><h1 id=next-steps>Next Steps</h1><p>Give this
<strong>Beam end-to-end example</strong> a try. If you are new to Beam, we hope
this example will give
+you more understanding on how pipelines work and look like. If you are already
using Beam, we hope
+some code samples in it will be useful for your use cases.</p><p>Please
+<a href=https://beam.apache.org/community/contact-us/>let us know</a> if you
encounter any issues.</p></div></article></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div
class=footer__cols__col><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__c
[...]
+<a href=http://www.apache.org>The Apache Software Foundation</a>
+| <a href=/privacy_policy>Privacy Policy</a>
+| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/categories/blog/index.xml
b/website/generated-content/categories/blog/index.xml
index 1ffb3ec..2336518 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -1,4 +1,72 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
blog</title><link>/categories/blog/</link><description>Recent content in blog
on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Thu, 07 Jan 2021 12:00:00
-0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self"
type="application/rss+xml"/><item><title>Blog: Apache Beam
2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00
[...]
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
blog</title><link>/categories/blog/</link><description>Recent content in blog
on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01
-0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self"
type="application/rss+xml"/><item><title>Blog: Example to ingest data from
Apache Kafka to Google Cloud Pub/Sub</title><link>/blog/kafka-t [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>In this blog post we present an example that creates a pipeline to read
data from a single topic or
+multiple topics from <a href="https://kafka.apache.org/";>Apache
Kafka</a> and write data into a topic
+in <a href="https://cloud.google.com/pubsub";>Google Pub/Sub</a>. The
example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution
that you can just <em>&rdquo;
+plug&rsquo;n&rsquo;play&rdquo;</em>.</p>
+<p>This end-to-end example is included
+in <a href="https://beam.apache.org/blog/beam-2.27.0/";>Apache Beam release
2.27</a>
+and can be downloaded <a
href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22";>here</a>.</p>
+<p>We hope you will find this example useful for setting up data pipelines
between Kafka and Pub/Sub.</p>
+<h1 id="example-specs">Example specs</h1>
+<p>Supported data formats:</p>
+<ul>
+<li>Serializable plain text formats, such as JSON</li>
+<li><a
href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage";>PubSubMessage</a></li>
+</ul>
+<p>Supported input source configurations:</p>
+<ul>
+<li>Single or multiple Apache Kafka bootstrap servers</li>
+<li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL
connection</li>
+<li>Secrets vault service <a
href="https://www.vaultproject.io/";>HashiCorp Vault</a></li>
+</ul>
+<p>Supported destination configuration:</p>
+<ul>
+<li>Single Google Pub/Sub topic</li>
+</ul>
+<p>In a simple scenario, the example will create an Apache Beam pipeline
that will read messages from a
+source Kafka server with a source topic, and stream the text messages into
specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication,
that can be performed
+over plaintext or SSL encrypted connection. The example supports using a
single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support
SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets
vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p>
+<h1 id="where-can-i-run-this-example">Where can I run this example?</h1>
+<p>There are two ways to execute the pipeline.</p>
+<ol>
+<li>Locally. This way has many options - run directly from your IntelliJ,
or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam
pipelines.</li>
+<li>In <a href="https://cloud.google.com/";>Google Cloud</a> using
Google
+Cloud <a href="https://cloud.google.com/dataflow";>Dataflow</a>:
+<ul>
+<li>With <code>gcloud</code> command-line tool you can create
+a <a
href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates";>Flex
Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This
requires corresponding
+modifications of the example to turn it into a template.</em></li>
+<li>This example exists as
+a <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub";>Flex
Template version</a>
+within <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates";>Google Cloud
Dataflow Template Pipelines</a>
+repository and can be run with no additional code modifications.</li>
+</ul>
+</li>
+</ol>
+<h1 id="next-steps">Next Steps</h1>
+<p>Give this <strong>Beam end-to-end example</strong> a try. If you
are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already
using Beam, we hope
+some code samples in it will be useful for your use cases.</p>
+<p>Please
+<a href="https://beam.apache.org/community/contact-us/";>let us know</a>
if you encounter any issues.</p></description></item><item><title>Blog:
Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan
2021 12:00:00 -0800</pubDate><guid>/blog/beam-2.27.0/</guid><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
<li>Added Cloud Bigtable Provider extension to Beam SQL (<a
href="https://issues.apache.org/jira/browse/BEAM-11173";>BEAM-11173</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-11373";>BEAM-11373</a>)</li>
<li>Added a schema provider for thrift data (<a
href="https://issues.apache.org/jira/browse/BEAM-11338";>BEAM-11338</a>)</li>
<li>Added combiner packing pipeline optimization to Dataflow runner. (<a
href="https://issues.apache.org/jira/browse/BEAM-10641";>BEAM-10641</a>)</li>
+<li>Added an example to ingest data from Apache Kafka to Google Pub/Sub.
(<a
href="https://issues.apache.org/jira/browse/BEAM-11065";>BEAM-11065</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
<ul>
@@ -5333,55 +5402,4 @@ see the level of support for this new model feature on
your favorite
backend(s).</p>
<p>And please do join the community at
<a href="/get-started/support">[email protected]</a>. We&rsquo;d
love to
-hear from you.</p></description></item><item><title>Blog: Media recap of
the Apache Beam
graduation</title><link>/blog/graduation-media-recap/</link><pubDate>Wed, 01
Feb 2017 00:00:01
-0800</pubDate><guid>/blog/graduation-media-recap/</guid><description>
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>One year ago today Apache Beam was accepted into incubation at the Apache
-Software Foundation. The community&rsquo;s work over the past year
culminated, just
-over three weeks ago, with an <a
href="/blog/2017/01/10/beam-graduates.html">announcement</a>
-that Apache Beam has successfully graduated as a new Top-Level Project at the
-foundation. Graduation sparked an additional interest in the project, from
-corporate endorsements, news articles, interviews, to the volume of traffic to
-our website and mailing lists.</p>
-<p>Corporate endorsements include Google, PayPal, Talend, data Artisans, and
-others. You can read more in the following blog posts:</p>
-<ul>
-<li>Google: &ldquo;<a
href="https://opensource.googleblog.com/2017/01/apache-beam-graduates.html";>Apache
Beam graduates to a top-level project</a>&rdquo; by Tyler
Akidau.</li>
-<li>Talend: &ldquo;<a
href="https://www.talend.com/blog/2017/01/13/future-apache-beam-now-top-level-apache-software-foundation-project/";>The
Future of Apache Beam, Now a Top-Level Apache Software Foundation
Project</a>&rdquo; by Jean-Baptiste Onofré.</li>
-<li>Talend: &ldquo;<a
href="https://www.talend.com/blog/2017/01/23/apache-beam-way-greater-data-agility/?utm_medium=socialpost&amp;utm_source=twitter&amp;utm_campaign=blog";>Apache
Beam Your Way to Greater Data Agility</a>&rdquo; by Shane Kent.</li>
-<li>Google: &ldquo;<a
href="https://cloud.google.com/blog/big-data/2017/01/apache-beam-graduates-from-incubation-try-it-today-on-google-cloud-dataflow";>Apache
Beam graduates from incubation: Try it today on Google Cloud
Dataflow</a>&rdquo; by Frances Perry.</li>
-</ul>
-<p>News coverage started with the Apache Software Foundation’s press
release in
-<a
href="https://globenewswire.com/news-release/2017/01/10/904692/0/en/The-Apache-Software-Foundation-Announces-Apache-Beam-as-a-Top-Level-Project.html";>Nasdaq
GlobeNewswire</a>,
-and followed by coverage in many independent outlets. Some of those in English
-include:</p>
-<ul>
-<li>ZDNet: &ldquo;<a
href="https://www.zdnet.com/article/apache-beam-and-spark-new-coopetition-for-squashing-the-lambda-architecture/";>Apache
Beam and Spark: New coopetition for squashing the Lambda
Architecture?</a>&rdquo; by Tony Baer.</li>
-<li>Datanami: &ldquo;<a
href="https://www.datanami.com/2017/01/10/google-lauds-outside-influence-apache-beam/";>Google
Lauds Outside Influence on Apache Beam</a>&rdquo; by Alex
Woodie.</li>
-<li>InfoWorld / JavaWorld: &ldquo;<a
href="https://www.infoworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html";>Apache
Beam unifies batch and streaming for big data</a>&rdquo; by Serdar
Yegulalp, and republished in <a
href="https://www.javaworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html";>JavaWorld</a>.</li>
-<li>JAXenter: &ldquo;<a
href="https://jaxenter.com/apache-beam-interview-131314.html";>In a way, Apache
Beam is the glue that connects many big data systems together</a>&rdquo;
by Kypriani Sinaris.</li>
-<li>OStatic: &ldquo;Apache Beam Unifies Batch and Streaming Data
Processing&rdquo; by Sam Dean. <!--
http://ostatic.com/blog/apache-beam-unifies-batch-and-streaming-data-processing
--></li>
-<li>Enterprise Apps Today: &ldquo;<a
href="http://www.enterpriseappstoday.com/business-intelligence/data-analytics/apache-beam-graduates-to-help-define-streaming-data-processing.html";>Apache
Beam Graduates to Help Define Streaming Data Processing</a>&rdquo; by
Sean Michael Kerner.</li>
-<li>The Register: &ldquo;<a
href="https://www.theregister.co.uk/2017/01/10/google_must_be_ibeamiing_as_apache_announces_its_new_top_level_projects/";>Google
must be Beaming as Apache announces its new top-level
projects</a>&rdquo; by Alexander J. Martin.</li>
-<li>SiliconANGLE: &ldquo;<a
href="https://siliconangle.com/blog/2017/01/11/apache-software-foundation-announces-2-top-level-projects/";>Apache
Software Foundation announces two more top-level open source
projects</a>&rdquo; by Mike Wheatley.</li>
-<li>SD Times: &ldquo;<a
href="https://sdtimes.com/apache-beam-goes-top-level/";>Apache Beam goes top
level</a>&rdquo; by Alex Handy.</li>
-</ul>
-<p>Graduation and media coverage helped push Beam website traffic to record
levels.
-The website traffic, measured in unique sessions per hour, peaked at more than
-15 times above the previous week’s numbers. In a steady state, the traffic is
-several times larger than before graduation.</p>
-<p>Hopefully these perspectives entice you to join us on this exciting
ride, either
-as a user or a contributor, as we work towards our first release with API
-stability. If you’d like to try out Apache Beam today, check out the latest
-<a href="/get-started/downloads/">0.4.0 release</a>. We welcome
-contribution and participation from anyone through our mailing lists, issue
-tracker, pull requests, and events.</p></description></item></channel></rss>
\ No newline at end of file
+hear from you.</p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/categories/index.xml
b/website/generated-content/categories/index.xml
index b7fa3c8..ba87864 100644
--- a/website/generated-content/categories/index.xml
+++ b/website/generated-content/categories/index.xml
@@ -1 +1 @@
-<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Categories</title><link>/categories/</link><description>Recent content in
Categories on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Thu, 07 Jan 2021 12:00:00
-0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self"
type="application/rss+xml"/></channel></rss>
\ No newline at end of file
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
Categories</title><link>/categories/</link><description>Recent content in
Categories on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01
-0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self"
type="application/rss+xml"/></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/categories/java/index.html
b/website/generated-content/categories/java/index.html
new file mode 100644
index 0000000..c232ee2
--- /dev/null
+++ b/website/generated-content/categories/java/index.html
@@ -0,0 +1,7 @@
+<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport
content="width=device-width,initial-scale=1"><title>java</title><meta
name=description content="Apache Beam is an open source, unified model and set
of language-specific SDKs for defining and executing data processing workflows,
and also data ingestion and integration flows, supporting Enterprise
Integration Patterns (EIPs) and Domain Specific Language [...]
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px
src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask
closed"></div><div id=navbar class="navbar-container closed"><ul class="nav
navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a
href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+<a href=http://www.apache.org>The Apache Software Foundation</a>
+| <a href=/privacy_policy>Privacy Policy</a>
+| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/categories/java/index.xml
b/website/generated-content/categories/java/index.xml
new file mode 100644
index 0000000..1c5d82b
--- /dev/null
+++ b/website/generated-content/categories/java/index.xml
@@ -0,0 +1,69 @@
+<rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Apache Beam –
java</title><link>/categories/java/</link><description>Recent content in java
on Apache Beam</description><generator>Hugo --
gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01
-0800</lastBuildDate><atom:link href="/categories/java/index.xml" rel="self"
type="application/rss+xml"/><item><title>Blog: Example to ingest data from
Apache Kafka to Google Cloud Pub/Sub</title><link>/blog/kafka-t [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>In this blog post we present an example that creates a pipeline to read
data from a single topic or
+multiple topics from <a href="https://kafka.apache.org/";>Apache
Kafka</a> and write data into a topic
+in <a href="https://cloud.google.com/pubsub";>Google Pub/Sub</a>. The
example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution
that you can just <em>&rdquo;
+plug&rsquo;n&rsquo;play&rdquo;</em>.</p>
+<p>This end-to-end example is included
+in <a href="https://beam.apache.org/blog/beam-2.27.0/";>Apache Beam release
2.27</a>
+and can be downloaded <a
href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22";>here</a>.</p>
+<p>We hope you will find this example useful for setting up data pipelines
between Kafka and Pub/Sub.</p>
+<h1 id="example-specs">Example specs</h1>
+<p>Supported data formats:</p>
+<ul>
+<li>Serializable plain text formats, such as JSON</li>
+<li><a
href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage";>PubSubMessage</a></li>
+</ul>
+<p>Supported input source configurations:</p>
+<ul>
+<li>Single or multiple Apache Kafka bootstrap servers</li>
+<li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL
connection</li>
+<li>Secrets vault service <a
href="https://www.vaultproject.io/";>HashiCorp Vault</a></li>
+</ul>
+<p>Supported destination configuration:</p>
+<ul>
+<li>Single Google Pub/Sub topic</li>
+</ul>
+<p>In a simple scenario, the example will create an Apache Beam pipeline
that will read messages from a
+source Kafka server with a source topic, and stream the text messages into
specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication,
that can be performed
+over plaintext or SSL encrypted connection. The example supports using a
single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support
SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets
vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p>
+<h1 id="where-can-i-run-this-example">Where can I run this example?</h1>
+<p>There are two ways to execute the pipeline.</p>
+<ol>
+<li>Locally. This way has many options - run directly from your IntelliJ,
or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam
pipelines.</li>
+<li>In <a href="https://cloud.google.com/";>Google Cloud</a> using
Google
+Cloud <a href="https://cloud.google.com/dataflow";>Dataflow</a>:
+<ul>
+<li>With <code>gcloud</code> command-line tool you can create
+a <a
href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates";>Flex
Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This
requires corresponding
+modifications of the example to turn it into a template.</em></li>
+<li>This example exists as
+a <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub";>Flex
Template version</a>
+within <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates";>Google Cloud
Dataflow Template Pipelines</a>
+repository and can be run with no additional code modifications.</li>
+</ul>
+</li>
+</ol>
+<h1 id="next-steps">Next Steps</h1>
+<p>Give this <strong>Beam end-to-end example</strong> a try. If you
are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already
using Beam, we hope
+some code samples in it will be useful for your use cases.</p>
+<p>Please
+<a href="https://beam.apache.org/community/contact-us/";>let us know</a>
if you encounter any issues.</p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/feed.xml
b/website/generated-content/feed.xml
index e89a4b0..837708f 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -1,4 +1,72 @@
-<rss xmlns:atom="http://www.w3.org/2005/Atom";
version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an
open source, unified model and set of language-specific SDKs for defining and
executing data processing workflows, and also data ingestion and integration
flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific
Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale
batch and streaming data processing and can run on a number [...]
+<rss xmlns:atom="http://www.w3.org/2005/Atom";
version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an
open source, unified model and set of language-specific SDKs for defining and
executing data processing workflows, and also data ingestion and integration
flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific
Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale
batch and streaming data processing and can run on a number [...]
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<p>In this blog post we present an example that creates a pipeline to read
data from a single topic or
+multiple topics from <a href="https://kafka.apache.org/";>Apache
Kafka</a> and write data into a topic
+in <a href="https://cloud.google.com/pubsub";>Google Pub/Sub</a>. The
example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution
that you can just <em>&rdquo;
+plug&rsquo;n&rsquo;play&rdquo;</em>.</p>
+<p>This end-to-end example is included
+in <a href="https://beam.apache.org/blog/beam-2.27.0/";>Apache Beam release
2.27</a>
+and can be downloaded <a
href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22";>here</a>.</p>
+<p>We hope you will find this example useful for setting up data pipelines
between Kafka and Pub/Sub.</p>
+<h1 id="example-specs">Example specs</h1>
+<p>Supported data formats:</p>
+<ul>
+<li>Serializable plain text formats, such as JSON</li>
+<li><a
href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage";>PubSubMessage</a></li>
+</ul>
+<p>Supported input source configurations:</p>
+<ul>
+<li>Single or multiple Apache Kafka bootstrap servers</li>
+<li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL
connection</li>
+<li>Secrets vault service <a
href="https://www.vaultproject.io/";>HashiCorp Vault</a></li>
+</ul>
+<p>Supported destination configuration:</p>
+<ul>
+<li>Single Google Pub/Sub topic</li>
+</ul>
+<p>In a simple scenario, the example will create an Apache Beam pipeline
that will read messages from a
+source Kafka server with a source topic, and stream the text messages into
specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication,
that can be performed
+over plaintext or SSL encrypted connection. The example supports using a
single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support
SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets
vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p>
+<h1 id="where-can-i-run-this-example">Where can I run this example?</h1>
+<p>There are two ways to execute the pipeline.</p>
+<ol>
+<li>Locally. This way has many options - run directly from your IntelliJ,
or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam
pipelines.</li>
+<li>In <a href="https://cloud.google.com/";>Google Cloud</a> using
Google
+Cloud <a href="https://cloud.google.com/dataflow";>Dataflow</a>:
+<ul>
+<li>With <code>gcloud</code> command-line tool you can create
+a <a
href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates";>Flex
Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This
requires corresponding
+modifications of the example to turn it into a template.</em></li>
+<li>This example exists as
+a <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub";>Flex
Template version</a>
+within <a
href="https://github.com/GoogleCloudPlatform/DataflowTemplates";>Google Cloud
Dataflow Template Pipelines</a>
+repository and can be run with no additional code modifications.</li>
+</ul>
+</li>
+</ol>
+<h1 id="next-steps">Next Steps</h1>
+<p>Give this <strong>Beam end-to-end example</strong> a try. If you
are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already
using Beam, we hope
+some code samples in it will be useful for your use cases.</p>
+<p>Please
+<a href="https://beam.apache.org/community/contact-us/";>let us know</a>
if you encounter any
issues.</p></description><link>/blog/kafka-to-pubsub-example/</link><pubDate>Fri,
15 Jan 2021 00:00:01
-0800</pubDate><guid>/blog/kafka-to-pubsub-example/</guid><category>blog</category><category>java</category></item><item><title>Apache
Beam 2.27.0</title><description>
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
<li>Added Cloud Bigtable Provider extension to Beam SQL (<a
href="https://issues.apache.org/jira/browse/BEAM-11173";>BEAM-11173</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-11373";>BEAM-11373</a>)</li>
<li>Added a schema provider for thrift data (<a
href="https://issues.apache.org/jira/browse/BEAM-11338";>BEAM-11338</a>)</li>
<li>Added combiner packing pipeline optimization to Dataflow runner. (<a
href="https://issues.apache.org/jira/browse/BEAM-10641";>BEAM-10641</a>)</li>
+<li>Added an example to ingest data from Apache Kafka to Google Pub/Sub.
(<a
href="https://issues.apache.org/jira/browse/BEAM-11065";>BEAM-11065</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
<ul>
@@ -901,60 +970,4 @@ while providing higher quality error messages.</p>
<p>Go play with the new <code>performance_runtime_type_check</code>
feature!</p>
<p>It&rsquo;s in an experimental state so please
<a href="https://beam.apache.org/community/contact-us/";>let us know</a>
-if you encounter any
issues.</p></description><link>/blog/python-performance-runtime-type-checking/</link><pubDate>Fri,
21 Aug 2020 00:00:01
-0800</pubDate><guid>/blog/python-performance-runtime-type-checking/</guid><category>blog</category><category>python</category><category>typing</category></item><item><title>Apache
Beam 2.23.0</title><description>
-<!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-<p>We are happy to present the new 2.23.0 release of Apache Beam. This
release includes both improvements and new functionality.
-See the <a href="/get-started/downloads/#2230-2020-07-29">download
page</a> for this release.</p>
-<p>For more information on changes in 2.23.0, check out the
-<a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&amp;version=12347145";>detailed
release notes</a>.</p>
-<h2 id="highlights">Highlights</h2>
-<ul>
-<li>Twister2 Runner (<a
href="https://issues.apache.org/jira/browse/BEAM-7304";>BEAM-7304</a>).</li>
-<li>Python 3.8 support (<a
href="https://issues.apache.org/jira/browse/BEAM-8494";>BEAM-8494</a>).</li>
-</ul>
-<h2 id="ios">I/Os</h2>
-<ul>
-<li>Support for reading from Snowflake added (Java) (<a
href="https://issues.apache.org/jira/browse/BEAM-9722";>BEAM-9722</a>).</li>
-<li>Support for writing to Splunk added (Java) (<a
href="https://issues.apache.org/jira/browse/BEAM-8596";>BEAM-8596</a>).</li>
-<li>Support for assume role added (Java) (<a
href="https://issues.apache.org/jira/browse/BEAM-10335";>BEAM-10335</a>).</li>
-<li>A new transform to read from BigQuery has been added:
<code>apache_beam.io.gcp.bigquery.ReadFromBigQuery</code>. This transform
-is experimental. It reads data from BigQuery by exporting data to Avro files,
and reading those files. It also supports
-reading data by exporting to JSON files. This has small differences in
behavior for Time and Date-related fields. See
-Pydoc for more information.</li>
-<li>Add dispositions for SnowflakeIO.write (<a
href="https://issues.apache.org/jira/browse/BEAM-10343";>BEAM-10343</a>)</li>
-</ul>
-<h2 id="new-features--improvements">New Features / Improvements</h2>
-<ul>
-<li>Update Snowflake JDBC dependency and add application=beam to connection
URL (<a
href="https://issues.apache.org/jira/browse/BEAM-10383";>BEAM-10383</a>).</li>
-</ul>
-<h2 id="breaking-changes">Breaking Changes</h2>
-<ul>
-<li><code>RowJson.RowJsonDeserializer</code>,
<code>JsonToRow</code>, and <code>PubsubJsonTableProvider</code>
now accept &ldquo;implicit
-nulls&rdquo; by default when deserializing JSON (Java) (<a
href="https://issues.apache.org/jira/browse/BEAM-10220";>BEAM-10220</a>).
-Previously nulls could only be represented with explicit null values, as in
-<code>{&quot;foo&quot;: &quot;bar&quot;,
&quot;baz&quot;: null}</code>, whereas an implicit null like
<code>{&quot;foo&quot;: &quot;bar&quot;}</code> would
raise an
-exception. Now both JSON strings will yield the same result by default. This
behavior can be
-overridden with
<code>RowJson.RowJsonDeserializer#withNullBehavior</code>.</li>
-<li>Fixed a bug in <code>GroupIntoBatches</code> experimental
transform in Python to actually group batches by key.
-This changes the output type for this transform (<a
href="https://issues.apache.org/jira/browse/BEAM-6696";>BEAM-6696</a>).</li>
-</ul>
-<h2 id="deprecations">Deprecations</h2>
-<ul>
-<li>Remove Gearpump runner. (<a
href="https://issues.apache.org/jira/browse/BEAM-9999";>BEAM-9999</a>)</li>
-<li>Remove Apex runner. (<a
href="https://issues.apache.org/jira/browse/BEAM-9999";>BEAM-9999</a>)</li>
-<li>RedisIO.readAll() is deprecated and will be removed in 2 versions,
users must use RedisIO.readKeyPatterns() as a replacement (<a
href="https://issues.apache.org/jira/browse/BEAM-9747";>BEAM-9747</a>).</li>
-</ul>
-<h2 id="known-issues">Known Issues</h2>
-<h2 id="list-of-contributors">List of Contributors</h2>
-<p>According to git shortlog, the following people contributed to the
2.23.0 release. Thank you to all contributors!</p>
-<p>Aaron, Abhishek Yadav, Ahmet Altay, aiyangar, Aizhamal Nurmamat kyzy,
Ajo Thomas, Akshay-Iyangar, Alan Pryor, Alex Amato, Alexey Romanenko, Allen
Pradeep Xavier, Andrew Crites, Andrew Pilloud, Ankur Goenka, Anna Qin, Ashwin
Ramaswami, bntnam, Borzoo Esmailloo, Boyuan Zhang, Brian Hulette, Brian
Michalski, brucearctor, Chamikara Jayalath, chi-chi weng, Chuck Yang, Chun
Yang, Colm O hEigeartaigh, Corvin Deboeser, Craig Chambers, Damian Gadomski,
Damon Douglas, Daniel Oliveira, Darius [...]
\ No newline at end of file
+if you encounter any
issues.</p></description><link>/blog/python-performance-runtime-type-checking/</link><pubDate>Fri,
21 Aug 2020 00:00:01
-0800</pubDate><guid>/blog/python-performance-runtime-type-checking/</guid><category>blog</category><category>python</category><category>typing</category></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/index.html
b/website/generated-content/index.html
index 83393d9..a13cbf5 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/index.html
@@ -5,7 +5,7 @@
<a class="button button--primary" href=/get-started/try-apache-beam/>Try
Beam</a>
<a class="button button--primary" href=/get-started/downloads/>Download Beam
SDK 2.27.0</a></div><div class=hero__ctas><a class=button
href=/get-started/quickstart-java/>Java Quickstart</a>
<a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
-<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><div class=hero__cols__col><div
class=hero__blog><div class=hero__blog__title>The latest from the
blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card
href=/blog/beam-2.27.0/><div class=hero__blog__cards__card__title>Apache Beam
2.27.0</div><div class=hero__blog__cards__card__date>Jan 7, 2021</div></a><a
class=hero__blog__cards__card href=/blog/dataframe-api-preview-available/><div
clas [...]
+<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><div class=hero__cols__col><div
class=hero__blog><div class=hero__blog__title>The latest from the
blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card
href=/blog/kafka-to-pubsub-example/><div
class=hero__blog__cards__card__title>Example to ingest data from Apache Kafka
to Google Cloud Pub/Sub</div><div class=hero__blog__cards__card__date>Jan 15,
2021</div></a><a class=hero__blog__cards_ [...]
<a class="button button--primary" href=/get-started/downloads/>Download Beam
SDK 2.27.0</a></div><div class=ctas__ctas><a class=button
href=/get-started/quickstart-java/>Java Quickstart</a>
<a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
<a class=button href=/get-started/quickstart-go/>Go
Quickstart</a></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div
class=footer__cols__col><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__col
footer__cols__col--md"><div class=foo [...]
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 4347bdb..cc6607f 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.27.0/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/blog/d
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/categories/blog/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/blog/kafka-to-pubsub-example/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url>
[...]
\ No newline at end of file
