This is an automated email from the ASF dual-hosted git repository.
echauchot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/flink-web.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 43cc699d6 Rebuild website
43cc699d6 is described below
commit 43cc699d62f48975ffd99822be7c03ee81fef658
Author: Etienne Chauchot <[email protected]>
AuthorDate: Tue May 9 10:22:06 2023 +0200
Rebuild website
---
content/en/sitemap.xml | 7 +++--
content/index.html | 10 +++----
content/index.xml | 11 ++++++-
content/posts/index.html | 59 ++++++++++++++++++------------------
content/posts/index.xml | 11 ++++++-
content/posts/page/10/index.html | 52 +++++++++++++++++---------------
content/posts/page/11/index.html | 55 +++++++++++++++++++---------------
content/posts/page/12/index.html | 57 +++++++++++++++++++----------------
content/posts/page/13/index.html | 60 ++++++++++++++++++++-----------------
content/posts/page/14/index.html | 57 +++++++++++++++++++++--------------
content/posts/page/15/index.html | 52 ++++++++++++++++++--------------
content/posts/page/16/index.html | 52 ++++++++++++++++++--------------
content/posts/page/17/index.html | 52 ++++++++++++++++++--------------
content/posts/page/18/index.html | 49 ++++++++++++++++++------------
content/posts/page/19/index.html | 46 +++++++++++++++++------------
content/posts/page/2/index.html | 64 ++++++++++++++++++++++------------------
content/posts/page/20/index.html | 47 ++++++++++++++++-------------
content/posts/page/21/index.html | 46 ++++++++++++++++++-----------
content/posts/page/22/index.html | 26 ++++++++++++++++
content/posts/page/3/index.html | 61 ++++++++++++++++++++++----------------
content/posts/page/4/index.html | 62 ++++++++++++++++++++------------------
content/posts/page/5/index.html | 62 ++++++++++++++++++++++----------------
content/posts/page/6/index.html | 58 ++++++++++++++++++++----------------
content/posts/page/7/index.html | 55 ++++++++++++++++++++--------------
content/posts/page/8/index.html | 55 ++++++++++++++++++----------------
content/posts/page/9/index.html | 54 ++++++++++++++++++++-------------
content/sitemap.xml | 2 +-
content/zh/index.html | 12 ++++----
28 files changed, 727 insertions(+), 507 deletions(-)
diff --git a/content/en/sitemap.xml b/content/en/sitemap.xml
index 04fad7ddc..26c7b5844 100644
--- a/content/en/sitemap.xml
+++ b/content/en/sitemap.xml
@@ -363,7 +363,7 @@
/>
</url><url>
<loc>https://flink.apache.org/posts/</loc>
- <lastmod>2023-05-03T08:00:00+00:00</lastmod>
+ <lastmod>2023-05-09T08:00:00+00:00</lastmod>
</url><url>
<loc>https://flink.apache.org/flink-packages/</loc>
<xhtml:link
@@ -510,7 +510,7 @@
/>
</url><url>
<loc>https://flink.apache.org/</loc>
- <lastmod>2023-05-03T08:00:00+00:00</lastmod>
+ <lastmod>2023-05-09T08:00:00+00:00</lastmod>
<xhtml:link
rel="alternate"
hreflang="zh"
@@ -521,6 +521,9 @@
hreflang="en"
href="https://flink.apache.org/"
/>
+ </url><url>
+
<loc>https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/</loc>
+ <lastmod>2023-05-09T08:00:00+00:00</lastmod>
</url><url>
<loc>https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/</loc>
<lastmod>2023-05-03T08:00:00+00:00</lastmod>
diff --git a/content/index.html b/content/index.html
index b527eb5ab..7526d8c55 100644
--- a/content/index.html
+++ b/content/index.html
@@ -6,7 +6,7 @@
<meta name="generator" content="Hugo 0.111.3">
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
-<meta name="description" content="Apache Flink® — Stateful Computations over
Data Streams # All streaming use cases Event-driven Applications Stream &
Batch Analytics Data Pipelines & ETL Learn more Guaranteed correctness
Exactly-once state consistency Event-time processing Sophisticated late data
handling Learn more Layered APIs SQL on Stream & Batch Data DataStream API
& DataSet API ProcessFunction (Time & State) Learn more Operational
Focus Flexible deployment High [...]
+<meta name="description" content="Apache Flink® — Stateful Computations over
Data Streams # All streaming use cases Event-driven Applications Stream &
Batch Analytics Data Pipelines & ETL Learn more Guaranteed correctness
Exactly-once state consistency Event-time processing Sophisticated late data
handling Learn more Layered APIs SQL on Stream & Batch Data DataStream API
& DataSet API ProcessFunction (Time & State) Learn more Operational
Focus Flexible deployment High [...]
<meta name="theme-color" content="#FFFFFF"><meta property="og:title"
content="Apache Flink® — Stateful Computations over Data Streams" />
<meta property="og:description" content="" />
<meta property="og:type" content="website" />
@@ -1039,6 +1039,10 @@ under the License.
+ <a
href="/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a><br />
+ Introduction # The Flink community has been deprecating the DataSet
API since version 1.12 as part of the work on FLIP-131: Consolidate the
user-facing Dataflow SDKs/APIs (and deprecate the DataSet API) . This blog
article illustrates the migration of a real-life batch DataSet pipeline to a
batch DataStream pipeline. All the code presented in this article is available
in the tpcds-benchmark-flink repo. The use case shown here is extracted from a
broader work comparing Flink perfo [...]
+ <br /><br />
+
<a
href="/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a><br />
Introduction # The Flink community has designed a new Source framework
based on FLIP-27 lately. Some connectors have migrated to this new framework.
This article is a how-to for creating a batch source using this new framework.
It was built while implementing the Flink batch source for Cassandra. If you
are interested in contributing or migrating connectors, this blog post is for
you!
Implementing the source components # The source architecture is depicted in
the diagrams below:
@@ -1049,10 +1053,6 @@ Implementing the source components # The source
architecture is depicted in the
With the addition of these algorithms, we believe Flink ML library is ready
for use in production jobs that require feature engineering capabilities, whose
input can then be consumed by both offline and online machine learning tasks.
<br /><br />
- <a
href="/2023/03/23/announcing-the-release-of-apache-flink-1.17/">Announcing the
Release of Apache Flink 1.17</a><br />
- The Apache Flink PMC is pleased to announce Apache Flink release
1.17.0. Apache Flink is the leading stream processing standard, and the concept
of unified stream and batch data processing is being successfully adopted in
more and more companies. Thanks to our excellent community and contributors,
Apache Flink continues to grow as a technology and remains one of the most
active projects in the Apache Software Foundation. Flink 1.17 had 172
contributors enthusiastically participat [...]
- <br /><br />
-
diff --git a/content/index.xml b/content/index.xml
index 8160ace9e..0c40a37c9 100644
--- a/content/index.xml
+++ b/content/index.xml
@@ -6,7 +6,7 @@
<description>Recent content in Apache Flink® — Stateful Computations over
Data Streams on Apache Flink</description>
<generator>Hugo -- gohugo.io</generator>
<language>en-us</language>
- <lastBuildDate>Wed, 03 May 2023 08:00:00 +0000</lastBuildDate><atom:link
href="https://flink.apache.org/index.xml" rel="self" type="application/rss+xml"
/>
+ <lastBuildDate>Tue, 09 May 2023 08:00:00 +0000</lastBuildDate><atom:link
href="https://flink.apache.org/index.xml" rel="self" type="application/rss+xml"
/>
<item>
<title>Architecture</title>
<link>https://flink.apache.org/what-is-flink/flink-architecture/</link>
@@ -371,6 +371,15 @@ Informing visitors about Apache Flink and its features.
Encouraging visitors to
Obtain the website sources # The website of Apache Flink is hosted in a
dedicated git repository which is mirrored to GitHub at
https://github.</description>
</item>
+ <item>
+ <title>Howto migrate a real-life batch pipeline from the DataSet API to
the DataStream API</title>
+
<link>https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/</link>
+ <pubDate>Tue, 09 May 2023 08:00:00 +0000</pubDate>
+
+
<guid>https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/</guid>
+ <description>Introduction # The Flink community has been deprecating the
DataSet API since version 1.12 as part of the work on FLIP-131: Consolidate the
user-facing Dataflow SDKs/APIs (and deprecate the DataSet API) . This blog
article illustrates the migration of a real-life batch DataSet pipeline to a
batch DataStream pipeline. All the code presented in this article is available
in the tpcds-benchmark-flink repo. The use case shown here is extracted from a
broader work comparing [...]
+ </item>
+
<item>
<title>Howto create a batch source with the new Source framework</title>
<link>https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/</link>
diff --git a/content/posts/index.html b/content/posts/index.html
index cabf017b4..d7981a2a6 100644
--- a/content/posts/index.html
+++ b/content/posts/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,29 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </h3>
+
+ May 9, 2023 -
+
+
+
+ Etienne Chauchot
+
+ <a href="https://twitter.com/echauchot">(@echauchot)</a>
+
+
+
+
+ <p>Introduction # The Flink community has been deprecating the DataSet API
since version 1.12 as part of the work on FLIP-131: Consolidate the user-facing
Dataflow SDKs/APIs (and deprecate the DataSet API) . This blog article
illustrates the migration of a real-life batch DataSet pipeline to a batch
DataStream pipeline. All the code presented in this article is available in the
tpcds-benchmark-flink repo. The use case shown here is extracted from a broader
work comparing Flink perfor [...]
+ <a
href="/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">...</a>
+
+ </p>
+ <a
href="/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
@@ -1980,34 +2007,6 @@ Release Notes # Bug # [FLINK-30329] -
flink-kubernetes-operator helm chart does
<a
href="/2023/01/10/apache-flink-kubernetes-operator-1.3.1-release-announcement/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">Apache
Flink Kubernetes Operator 1.3.0 Release Announcement</a>
- </h3>
-
- December 14, 2022 -
-
-
-
- Matyas Orhidi
-
- <a href="https://twitter.com/matyasorhidi">(@matyasorhidi)</a>
-
-
- Gyula Fora
-
- <a href="https://twitter.com/GyulaFora">(@GyulaFora)</a>
-
-
-
-
- <p>The Flink community is happy to announce that the latest Flink
Kubernetes Operator version went live today. Beyond the regular operator
improvements and fixes the 1.3.0 version also integrates better with some
popular infrastructure management tools like OLM and Argo CD. These
improvements are clear indicators that the original intentions of the Flink
community, namely to provide the de facto standard solution for managing Flink
applications on Kubernetes is making steady progress [...]
- <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">...</a>
-
- </p>
- <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2065,6 +2064,10 @@ Release Notes # Bug # [FLINK-30329] -
flink-kubernetes-operator helm chart does
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/index.xml b/content/posts/index.xml
index a83a0a4d7..84e063da8 100644
--- a/content/posts/index.xml
+++ b/content/posts/index.xml
@@ -6,7 +6,16 @@
<description>Recent content in Flink Blog on Apache Flink</description>
<generator>Hugo -- gohugo.io</generator>
<language>en-us</language>
- <lastBuildDate>Wed, 03 May 2023 08:00:00 +0000</lastBuildDate><atom:link
href="https://flink.apache.org/posts/index.xml" rel="self"
type="application/rss+xml" />
+ <lastBuildDate>Tue, 09 May 2023 08:00:00 +0000</lastBuildDate><atom:link
href="https://flink.apache.org/posts/index.xml" rel="self"
type="application/rss+xml" />
+ <item>
+ <title>Howto migrate a real-life batch pipeline from the DataSet API to
the DataStream API</title>
+
<link>https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/</link>
+ <pubDate>Tue, 09 May 2023 08:00:00 +0000</pubDate>
+
+
<guid>https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/</guid>
+ <description>Introduction # The Flink community has been deprecating the
DataSet API since version 1.12 as part of the work on FLIP-131: Consolidate the
user-facing Dataflow SDKs/APIs (and deprecate the DataSet API) . This blog
article illustrates the migration of a real-life batch DataSet pipeline to a
batch DataStream pipeline. All the code presented in this article is available
in the tpcds-benchmark-flink repo. The use case shown here is extracted from a
broader work comparing [...]
+ </item>
+
<item>
<title>Howto create a batch source with the new Source framework</title>
<link>https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/</link>
diff --git a/content/posts/page/10/index.html b/content/posts/page/10/index.html
index dec531a60..b8d79e0d6 100644
--- a/content/posts/page/10/index.html
+++ b/content/posts/page/10/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,27 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">Accelerating
your workload with GPU and other external resources</a>
+ </h3>
+
+ August 6, 2020 -
+
+
+
+ Yangze Guo
+
+
+
+
+ <p>Apache Flink 1.11 introduces a new External Resource Framework, which
allows you to request external resources from the underlying resource
management systems (e.g., Kubernetes) and accelerate your workload with those
resources. As Flink provides a first-party GPU plugin at the moment, we will
take GPU as an example and show how it affects Flink applications in the AI
field. Other external resources (e.g. RDMA and SSD) can also be supported in a
pluggable manner.
+ <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">...</a>
+
+ </p>
+ <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2020/08/04/pyflink-the-integration-of-pandas-into-pyflink/">PyFlink: The
integration of Pandas into PyFlink</a>
@@ -1975,29 +2000,6 @@ Streaming Data Visualization # With Zeppelin, you can
build a real time streamin
<a
href="/2020/06/23/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-2/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">Flink
on Zeppelin Notebooks for Interactive Data Analysis - Part 1</a>
- </h3>
-
- June 15, 2020 -
-
-
-
- Jeff Zhang
-
- <a href="https://twitter.com/zjffdu">(@zjffdu)</a>
-
-
-
-
- <p>The latest release of Apache Zeppelin comes with a redesigned
interpreter for Apache Flink (version Flink 1.10+ is only supported moving
forward) that allows developers to use Flink directly on Zeppelin notebooks for
interactive data analysis. I wrote 2 posts about how to use Flink in Zeppelin.
This is part-1 where I explain how the Flink interpreter in Zeppelin works, and
provide a tutorial for running Streaming ETL with Flink on Zeppelin.
- <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">...</a>
-
- </p>
- <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2055,6 +2057,10 @@ Streaming Data Visualization # With Zeppelin, you can
build a real time streamin
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/11/index.html b/content/posts/page/11/index.html
index d853567cb..fde5de8f2 100644
--- a/content/posts/page/11/index.html
+++ b/content/posts/page/11/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,29 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">Flink
on Zeppelin Notebooks for Interactive Data Analysis - Part 1</a>
+ </h3>
+
+ June 15, 2020 -
+
+
+
+ Jeff Zhang
+
+ <a href="https://twitter.com/zjffdu">(@zjffdu)</a>
+
+
+
+
+ <p>The latest release of Apache Zeppelin comes with a redesigned
interpreter for Apache Flink (version Flink 1.10+ is only supported moving
forward) that allows developers to use Flink directly on Zeppelin notebooks for
interactive data analysis. I wrote 2 posts about how to use Flink in Zeppelin.
This is part-1 where I explain how the Flink interpreter in Zeppelin works, and
provide a tutorial for running Streaming ETL with Flink on Zeppelin.
+ <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">...</a>
+
+ </p>
+ <a
href="/2020/06/15/flink-on-zeppelin-notebooks-for-interactive-data-analysis-part-1/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2020/06/10/flink-community-update-june20/">Flink Community
Update - June'20</a>
@@ -1969,30 +1996,6 @@ In Flink 1.10, the community further extended the
support for Python by adding P
<a
href="/2020/04/09/pyflink-introducing-python-support-for-udfs-in-flinks-table-api/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">Stateful
Functions 2.0 - An Event-driven Database on Apache Flink</a>
- </h3>
-
- April 7, 2020 -
-
-
-
- Stephan Ewen
-
- <a href="https://twitter.com/stephanewen">(@stephanewen)</a>
-
-
-
-
- <p>Today, we are announcing the release of Stateful Functions (StateFun)
2.0 — the first release of Stateful Functions as part of the Apache Flink
project. This release marks a big milestone: Stateful Functions 2.0 is not only
an API update, but the first version of an event-driven database that is built
on Apache Flink.
-Stateful Functions 2.0 makes it possible to combine StateFun’s powerful
approach to state and composition with the elasticity, rapid
scaling/scale-to-zero and rolling upgrade capabilities of FaaS implementations
like AWS Lambda and modern resource orchestration frameworks like Kubernetes.
- <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">...</a>
-
- </p>
- <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2050,6 +2053,10 @@ Stateful Functions 2.0 makes it possible to combine
StateFun’s powerful approa
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/12/index.html b/content/posts/page/12/index.html
index b2cd4b494..ece15767c 100644
--- a/content/posts/page/12/index.html
+++ b/content/posts/page/12/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,30 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">Stateful
Functions 2.0 - An Event-driven Database on Apache Flink</a>
+ </h3>
+
+ April 7, 2020 -
+
+
+
+ Stephan Ewen
+
+ <a href="https://twitter.com/stephanewen">(@stephanewen)</a>
+
+
+
+
+ <p>Today, we are announcing the release of Stateful Functions (StateFun)
2.0 — the first release of Stateful Functions as part of the Apache Flink
project. This release marks a big milestone: Stateful Functions 2.0 is not only
an API update, but the first version of an event-driven database that is built
on Apache Flink.
+Stateful Functions 2.0 makes it possible to combine StateFun’s powerful
approach to state and composition with the elasticity, rapid
scaling/scale-to-zero and rolling upgrade capabilities of FaaS implementations
like AWS Lambda and modern resource orchestration frameworks like Kubernetes.
+ <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">...</a>
+
+ </p>
+ <a
href="/2020/04/07/stateful-functions-2.0-an-event-driven-database-on-apache-flink/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2020/03/30/flink-community-update-april20/">Flink Community
Update - April'20</a>
@@ -1976,31 +2004,6 @@ In order to provide a state-of-the-art experience to
Flink developers, the Apach
<a
href="/2020/01/29/state-unlocked-interacting-with-state-in-apache-flink/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">Advanced
Flink Application Patterns Vol.1: Case Study of a Fraud Detection System</a>
- </h3>
-
- January 15, 2020 -
-
-
-
- Alexander Fedulov
-
- <a href="https://twitter.com/alex_fedulov">(@alex_fedulov)</a>
-
-
-
-
- <p>In this series of blog posts you will learn about three powerful Flink
patterns for building streaming applications:
-Dynamic updates of application logic Dynamic data partitioning (shuffle),
controlled at runtime Low latency alerting based on custom windowing logic
(without using the window API) These patterns expand the possibilities of what
is achievable with statically defined data flows and provide the building
blocks to fulfill complex business requirements.
-Dynamic updates of application logic allow Flink jobs to change at runtime,
without downtime from stopping and resubmitting the code.
- <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">...</a>
-
- </p>
- <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2058,6 +2061,10 @@ Dynamic updates of application logic allow Flink jobs to
change at runtime, with
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/13/index.html b/content/posts/page/13/index.html
index df68b954e..17711a51c 100644
--- a/content/posts/page/13/index.html
+++ b/content/posts/page/13/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,31 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">Advanced
Flink Application Patterns Vol.1: Case Study of a Fraud Detection System</a>
+ </h3>
+
+ January 15, 2020 -
+
+
+
+ Alexander Fedulov
+
+ <a href="https://twitter.com/alex_fedulov">(@alex_fedulov)</a>
+
+
+
+
+ <p>In this series of blog posts you will learn about three powerful Flink
patterns for building streaming applications:
+Dynamic updates of application logic Dynamic data partitioning (shuffle),
controlled at runtime Low latency alerting based on custom windowing logic
(without using the window API) These patterns expand the possibilities of what
is achievable with statically defined data flows and provide the building
blocks to fulfill complex business requirements.
+Dynamic updates of application logic allow Flink jobs to change at runtime,
without downtime from stopping and resubmitting the code.
+ <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">...</a>
+
+ </p>
+ <a
href="/2020/01/15/advanced-flink-application-patterns-vol.1-case-study-of-a-fraud-detection-system/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2019/12/11/apache-flink-1.8.3-released/">Apache Flink 1.8.3
Released</a>
@@ -1977,33 +2006,6 @@ The Apache Flink project’s goal is to develop a
stream processing system t
<a
href="/2019/07/23/flink-network-stack-vol.-2-monitoring-metrics-and-that-backpressure-thing/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2019/07/02/apache-flink-1.8.1-released/">Apache Flink 1.8.1
Released</a>
- </h3>
-
- July 2, 2019 -
-
-
-
- Jincheng Sun
-
- <a href="https://twitter.com/sunjincheng121">(@sunjincheng121)</a>
-
-
-
-
- <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.8 series.
-This release includes more than 40 fixes and minor improvements for Flink
1.8.1. The list below includes a detailed list of all improvements, sub-tasks
and bug fixes.
-We highly recommend all users to upgrade to Flink 1.8.1.
-Updated Maven dependencies:
-<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.8.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.8.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
- <a href="/2019/07/02/apache-flink-1.8.1-released/">...</a>
-
- </p>
- <a href="/2019/07/02/apache-flink-1.8.1-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2061,6 +2063,10 @@ Updated Maven dependencies:
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/14/index.html b/content/posts/page/14/index.html
index ce220b497..abf32c270 100644
--- a/content/posts/page/14/index.html
+++ b/content/posts/page/14/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,33 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2019/07/02/apache-flink-1.8.1-released/">Apache Flink 1.8.1
Released</a>
+ </h3>
+
+ July 2, 2019 -
+
+
+
+ Jincheng Sun
+
+ <a href="https://twitter.com/sunjincheng121">(@sunjincheng121)</a>
+
+
+
+
+ <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.8 series.
+This release includes more than 40 fixes and minor improvements for Flink
1.8.1. The list below includes a detailed list of all improvements, sub-tasks
and bug fixes.
+We highly recommend all users to upgrade to Flink 1.8.1.
+Updated Maven dependencies:
+<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.8.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.8.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
+ <a href="/2019/07/02/apache-flink-1.8.1-released/">...</a>
+
+ </p>
+ <a href="/2019/07/02/apache-flink-1.8.1-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2019/06/26/a-practical-guide-to-broadcast-state-in-apache-flink/">A
Practical Guide to Broadcast State in Apache Flink</a>
@@ -1963,28 +1994,6 @@ Flink 1.8.0 is API-compatible with previous 1.x.y
releases for APIs annotated wi
<a
href="/2019/03/06/what-to-expect-from-flink-forward-san-francisco-2019/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2019/02/25/apache-flink-1.6.4-released/">Apache Flink 1.6.4
Released</a>
- </h3>
-
- February 25, 2019 -
-
-
-
-
-
- <p>The Apache Flink community released the fourth bugfix version of the
Apache Flink 1.6 series.
-This release includes more than 25 fixes and minor improvements for Flink
1.6.3. The list below includes a detailed list of all fixes.
-We highly recommend all users to upgrade to Flink 1.6.4.
-Updated Maven dependencies:
-<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.6.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.6.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
- <a href="/2019/02/25/apache-flink-1.6.4-released/">...</a>
-
- </p>
- <a href="/2019/02/25/apache-flink-1.6.4-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2042,6 +2051,10 @@ Updated Maven dependencies:
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/15/index.html b/content/posts/page/15/index.html
index a64c9f08e..3c73bf44f 100644
--- a/content/posts/page/15/index.html
+++ b/content/posts/page/15/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,28 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2019/02/25/apache-flink-1.6.4-released/">Apache Flink 1.6.4
Released</a>
+ </h3>
+
+ February 25, 2019 -
+
+
+
+
+
+ <p>The Apache Flink community released the fourth bugfix version of the
Apache Flink 1.6 series.
+This release includes more than 25 fixes and minor improvements for Flink
1.6.3. The list below includes a detailed list of all fixes.
+We highly recommend all users to upgrade to Flink 1.6.4.
+Updated Maven dependencies:
+<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.6.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.6.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
+ <a href="/2019/02/25/apache-flink-1.6.4-released/">...</a>
+
+ </p>
+ <a href="/2019/02/25/apache-flink-1.6.4-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2019/02/21/monitoring-apache-flink-applications-101/">Monitoring Apache
Flink Applications 101</a>
@@ -1965,28 +1991,6 @@ Updated Maven dependencies:
<a href="/2018/10/29/apache-flink-1.6.2-released/">Continue reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2018/09/20/apache-flink-1.5.4-released/">Apache Flink 1.5.4
Released</a>
- </h3>
-
- September 20, 2018 -
-
-
-
-
-
- <p>The Apache Flink community released the fourth bugfix version of the
Apache Flink 1.5 series.
-This release includes more than 20 fixes and minor improvements for Flink
1.5.4. The list below includes a detailed list of all fixes.
-We highly recommend all users to upgrade to Flink 1.5.4.
-Updated Maven dependencies:
-<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.5.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.5.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
- <a href="/2018/09/20/apache-flink-1.5.4-released/">...</a>
-
- </p>
- <a href="/2018/09/20/apache-flink-1.5.4-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2044,6 +2048,10 @@ Updated Maven dependencies:
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/16/index.html b/content/posts/page/16/index.html
index 04e8283e5..70521030e 100644
--- a/content/posts/page/16/index.html
+++ b/content/posts/page/16/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,28 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2018/09/20/apache-flink-1.5.4-released/">Apache Flink 1.5.4
Released</a>
+ </h3>
+
+ September 20, 2018 -
+
+
+
+
+
+ <p>The Apache Flink community released the fourth bugfix version of the
Apache Flink 1.5 series.
+This release includes more than 20 fixes and minor improvements for Flink
1.5.4. The list below includes a detailed list of all fixes.
+We highly recommend all users to upgrade to Flink 1.5.4.
+Updated Maven dependencies:
+<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.5.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.5.4</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
+ <a href="/2018/09/20/apache-flink-1.5.4-released/">...</a>
+
+ </p>
+ <a href="/2018/09/20/apache-flink-1.5.4-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2018/09/20/apache-flink-1.6.1-released/">Apache Flink 1.6.1
Released</a>
@@ -1963,28 +1989,6 @@ Apache Flink 1.4.0, released in December 2017,
introduced a significant mileston
<a
href="/2018/02/28/an-overview-of-end-to-end-exactly-once-processing-in-apache-flink-with-apache-kafka-too/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2018/02/15/apache-flink-1.4.1-released/">Apache Flink 1.4.1
Released</a>
- </h3>
-
- February 15, 2018 -
-
-
-
-
-
- <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.4 series.
-This release includes more than 60 fixes and minor improvements for Flink
1.4.0. The list below includes a detailed list of all fixes.
-We highly recommend all users to upgrade to Flink 1.4.1.
-Updated Maven dependencies:
-<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.4.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.4.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
- <a href="/2018/02/15/apache-flink-1.4.1-released/">...</a>
-
- </p>
- <a href="/2018/02/15/apache-flink-1.4.1-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2042,6 +2046,10 @@ Updated Maven dependencies:
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/17/index.html b/content/posts/page/17/index.html
index bcf040114..eaa223408 100644
--- a/content/posts/page/17/index.html
+++ b/content/posts/page/17/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,28 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2018/02/15/apache-flink-1.4.1-released/">Apache Flink 1.4.1
Released</a>
+ </h3>
+
+ February 15, 2018 -
+
+
+
+
+
+ <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.4 series.
+This release includes more than 60 fixes and minor improvements for Flink
1.4.0. The list below includes a detailed list of all fixes.
+We highly recommend all users to upgrade to Flink 1.4.1.
+Updated Maven dependencies:
+<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.4.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.4.1</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <versio [...]
+ <a href="/2018/02/15/apache-flink-1.4.1-released/">...</a>
+
+ </p>
+ <a href="/2018/02/15/apache-flink-1.4.1-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2018/01/30/managing-large-state-in-apache-flink-an-intro-to-incremental-checkpointing/">Managing
Large State in Apache Flink: An Intro to Incremental Checkpointing</a>
@@ -1973,28 +1999,6 @@ A community-maintained way to run Apache Flink on Docker
and other container run
<a href="/2017/05/16/introducing-docker-images-for-apache-flink/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2017/04/26/apache-flink-1.2.1-released/">Apache Flink 1.2.1
Released</a>
- </h3>
-
- April 26, 2017 -
-
-
-
-
-
- <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.2 series.
-This release includes many critical fixes for Flink 1.2.0. The list below
includes a detailed list of all fixes.
-We highly recommend all users to upgrade to Flink 1.2.1.
-Please note that there are two unresolved major issues in Flink 1.2.1 and
1.2.0:
-FLINK-6353 Restoring using CheckpointedRestoring does not work from 1.2 to 1.2
FLINK-6188 Some setParallelism() methods can’t cope with default
parallelism <dependency> <groupId>org.
- <a href="/2017/04/26/apache-flink-1.2.1-released/">...</a>
-
- </p>
- <a href="/2017/04/26/apache-flink-1.2.1-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2052,6 +2056,10 @@ FLINK-6353 Restoring using CheckpointedRestoring does
not work from 1.2 to 1.2 F
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/18/index.html b/content/posts/page/18/index.html
index 1f0003677..8cd88429b 100644
--- a/content/posts/page/18/index.html
+++ b/content/posts/page/18/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,28 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2017/04/26/apache-flink-1.2.1-released/">Apache Flink 1.2.1
Released</a>
+ </h3>
+
+ April 26, 2017 -
+
+
+
+
+
+ <p>The Apache Flink community released the first bugfix version of the
Apache Flink 1.2 series.
+This release includes many critical fixes for Flink 1.2.0. The list below
includes a detailed list of all fixes.
+We highly recommend all users to upgrade to Flink 1.2.1.
+Please note that there are two unresolved major issues in Flink 1.2.1 and
1.2.0:
+FLINK-6353 Restoring using CheckpointedRestoring does not work from 1.2 to 1.2
FLINK-6188 Some setParallelism() methods can’t cope with default
parallelism <dependency> <groupId>org.
+ <a href="/2017/04/26/apache-flink-1.2.1-released/">...</a>
+
+ </p>
+ <a href="/2017/04/26/apache-flink-1.2.1-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2017/03/30/continuous-queries-on-dynamic-tables/">Continuous
Queries on Dynamic Tables</a>
@@ -1931,25 +1957,6 @@ Ted Dunning has been announced as a keynote speaker at
the event. Ted is the VP
<a
href="/2016/08/24/flink-forward-2016-announcing-schedule-keynotes-and-panel-discussion/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2016/08/04/announcing-apache-flink-1.1.0/">Announcing Apache
Flink 1.1.0</a>
- </h3>
-
- August 4, 2016 -
-
-
-
-
-
- <p>Important: The Maven artifacts published with version 1.1.0 on Maven
central have a Hadoop dependency issue. It is highly recommended to use 1.1.1
or 1.1.1-hadoop1 as the Flink version. The Apache Flink community is pleased to
announce the availability of Flink 1.1.0.
-This release is the first major release in the 1.X.X series of releases, which
maintains API compatibility with 1.0.0. This means that your applications
written against stable APIs of Flink 1.
- <a href="/2016/08/04/announcing-apache-flink-1.1.0/">...</a>
-
- </p>
- <a href="/2016/08/04/announcing-apache-flink-1.1.0/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2007,6 +2014,10 @@ This release is the first major release in the 1.X.X
series of releases, which m
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/19/index.html b/content/posts/page/19/index.html
index 1fa21f411..d3e6f57cd 100644
--- a/content/posts/page/19/index.html
+++ b/content/posts/page/19/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,25 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2016/08/04/announcing-apache-flink-1.1.0/">Announcing Apache
Flink 1.1.0</a>
+ </h3>
+
+ August 4, 2016 -
+
+
+
+
+
+ <p>Important: The Maven artifacts published with version 1.1.0 on Maven
central have a Hadoop dependency issue. It is highly recommended to use 1.1.1
or 1.1.1-hadoop1 as the Flink version. The Apache Flink community is pleased to
announce the availability of Flink 1.1.0.
+This release is the first major release in the 1.X.X series of releases, which
maintains API compatibility with 1.0.0. This means that your applications
written against stable APIs of Flink 1.
+ <a href="/2016/08/04/announcing-apache-flink-1.1.0/">...</a>
+
+ </p>
+ <a href="/2016/08/04/announcing-apache-flink-1.1.0/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2016/08/04/flink-1.1.1-released/">Flink 1.1.1 Released</a>
@@ -1926,25 +1949,6 @@ Issues fixed # FLINK-3242: Adjust StateBackendITCase for
0.10 signatures of stat
<a href="/2016/02/11/flink-0.10.2-released/">Continue reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">Flink
2015: A year in review, and a lookout to 2016</a>
- </h3>
-
- December 18, 2015 -
-
-
-
-
-
- <p>With 2015 ending, we thought that this would be good time to reflect on
the amazing work done by the Flink community over this past year, and how much
this community has grown.
-Overall, we have seen Flink grow in terms of functionality from an engine to
one of the most complete open-source stream processing frameworks available.
The community grew from a relatively small and geographically focused team, to
a truly global, and one of the largest big data communities in the the Apache
Software Foundation.
- <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">...</a>
-
- </p>
- <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2002,6 +2006,10 @@ Overall, we have seen Flink grow in terms of
functionality from an engine to one
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/2/index.html b/content/posts/page/2/index.html
index b437dd388..b7c6afe4f 100644
--- a/content/posts/page/2/index.html
+++ b/content/posts/page/2/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,34 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">Apache
Flink Kubernetes Operator 1.3.0 Release Announcement</a>
+ </h3>
+
+ December 14, 2022 -
+
+
+
+ Matyas Orhidi
+
+ <a href="https://twitter.com/matyasorhidi">(@matyasorhidi)</a>
+
+
+ Gyula Fora
+
+ <a href="https://twitter.com/GyulaFora">(@GyulaFora)</a>
+
+
+
+
+ <p>The Flink community is happy to announce that the latest Flink
Kubernetes Operator version went live today. Beyond the regular operator
improvements and fixes the 1.3.0 version also integrates better with some
popular infrastructure management tools like OLM and Argo CD. These
improvements are clear indicators that the original intentions of the Flink
community, namely to provide the de facto standard solution for managing Flink
applications on Kubernetes is making steady progress [...]
+ <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">...</a>
+
+ </p>
+ <a
href="/2022/12/14/apache-flink-kubernetes-operator-1.3.0-release-announcement/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2022/11/25/optimising-the-throughput-of-async-sinks-using-a-custom-ratelimitingstrategy/">Optimising
the throughput of async sinks using a custom RateLimitingStrategy</a>
@@ -1962,34 +1994,6 @@ We highly recommend all users upgrade to Flink 1.15.2.
<a href="/2022/08/24/apache-flink-1.15.2-release-announcement/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">Apache
Flink Kubernetes Operator 1.1.0 Release Announcement</a>
- </h3>
-
- July 25, 2022 -
-
-
-
- Gyula Fora
-
- <a href="https://twitter.com/GyulaFora">(@GyulaFora)</a>
-
-
- Matyas Orhidi
-
-
-
-
- <p>The community has continued to work hard on improving the Flink
Kubernetes Operator capabilities since our first production ready release we
launched about two months ago.
-With the release of Flink Kubernetes Operator 1.1.0 we are proud to announce a
number of exciting new features improving the overall experience of managing
Flink resources and the operator itself in production environments.
-Release Highlights # A non-exhaustive list of some of the more exciting
features added in the release:
- <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">...</a>
-
- </p>
- <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2047,6 +2051,10 @@ Release Highlights # A non-exhaustive list of some of
the more exciting features
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/20/index.html b/content/posts/page/20/index.html
index 2cbfb79c6..bea75bc4b 100644
--- a/content/posts/page/20/index.html
+++ b/content/posts/page/20/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,25 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">Flink
2015: A year in review, and a lookout to 2016</a>
+ </h3>
+
+ December 18, 2015 -
+
+
+
+
+
+ <p>With 2015 ending, we thought that this would be good time to reflect on
the amazing work done by the Flink community over this past year, and how much
this community has grown.
+Overall, we have seen Flink grow in terms of functionality from an engine to
one of the most complete open-source stream processing frameworks available.
The community grew from a relatively small and geographically focused team, to
a truly global, and one of the largest big data communities in the the Apache
Software Foundation.
+ <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">...</a>
+
+ </p>
+ <a
href="/2015/12/18/flink-2015-a-year-in-review-and-a-lookout-to-2016/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2015/12/11/storm-compatibility-in-apache-flink-how-to-run-existing-storm-topologies-on-flink/">Storm
Compatibility in Apache Flink: How to run existing Storm topologies on
Flink</a>
@@ -1923,26 +1946,6 @@ Download the release and check out the documentation.
Feedback through the Flink
<a href="/2015/06/24/announcing-apache-flink-0.9.0/">Continue reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2015/05/14/april-2015-in-the-flink-community/">April 2015 in
the Flink community</a>
- </h3>
-
- May 14, 2015 -
-
-
-
-
-
- <p>April was an packed month for Apache Flink.
-Flink runner for Google Cloud Dataflow # A Flink runner for Google Cloud
Dataflow was announced. See the blog posts by data Artisans and the Google
Cloud Platform Blog. Google Cloud Dataflow programs can be written using and
open-source SDK and run in multiple backends, either as a managed service
inside Google’s infrastructure, or leveraging open source runners,
including Apache Flink.
-Flink 0.
- <a href="/2015/05/14/april-2015-in-the-flink-community/">...</a>
-
- </p>
- <a href="/2015/05/14/april-2015-in-the-flink-community/">Continue reading
»</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2000,6 +2003,10 @@ Flink 0.
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/21/index.html b/content/posts/page/21/index.html
index 433c19a4f..68d9349d5 100644
--- a/content/posts/page/21/index.html
+++ b/content/posts/page/21/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,26 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2015/05/14/april-2015-in-the-flink-community/">April 2015 in
the Flink community</a>
+ </h3>
+
+ May 14, 2015 -
+
+
+
+
+
+ <p>April was an packed month for Apache Flink.
+Flink runner for Google Cloud Dataflow # A Flink runner for Google Cloud
Dataflow was announced. See the blog posts by data Artisans and the Google
Cloud Platform Blog. Google Cloud Dataflow programs can be written using and
open-source SDK and run in multiple backends, either as a managed service
inside Google’s infrastructure, or leveraging open source runners,
including Apache Flink.
+Flink 0.
+ <a href="/2015/05/14/april-2015-in-the-flink-community/">...</a>
+
+ </p>
+ <a href="/2015/05/14/april-2015-in-the-flink-community/">Continue reading
»</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2015/05/11/juggling-with-bits-and-bytes/">Juggling with Bits
and Bytes</a>
@@ -1927,24 +1951,6 @@ Flink graduation # The biggest news is that the Apache
board approved Flink as a
<a href="/2015/01/06/december-2014-in-the-flink-community/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2014/11/18/hadoop-compatibility-in-flink/">Hadoop
Compatibility in Flink</a>
- </h3>
-
- November 18, 2014 -
-
-
-
-
-
- <p>Apache Hadoop is an industry standard for scalable analytical data
processing. Many data analysis applications have been implemented as Hadoop
MapReduce jobs and run in clusters around the world. Apache Flink can be an
alternative to MapReduce and improves it in many dimensions. Among other
features, Flink provides much better performance and offers APIs in Java and
Scala, which are very easy to use. Similar to Hadoop, Flink’s APIs provide
interfaces for Mapper and Reducer functio [...]
- <a href="/2014/11/18/hadoop-compatibility-in-flink/">...</a>
-
- </p>
- <a href="/2014/11/18/hadoop-compatibility-in-flink/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2002,6 +2008,10 @@ Flink graduation # The biggest news is that the Apache
board approved Flink as a
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/22/index.html b/content/posts/page/22/index.html
index 078fda517..1169aa476 100644
--- a/content/posts/page/22/index.html
+++ b/content/posts/page/22/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,24 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2014/11/18/hadoop-compatibility-in-flink/">Hadoop
Compatibility in Flink</a>
+ </h3>
+
+ November 18, 2014 -
+
+
+
+
+
+ <p>Apache Hadoop is an industry standard for scalable analytical data
processing. Many data analysis applications have been implemented as Hadoop
MapReduce jobs and run in clusters around the world. Apache Flink can be an
alternative to MapReduce and improves it in many dimensions. Among other
features, Flink provides much better performance and offers APIs in Java and
Scala, which are very easy to use. Similar to Hadoop, Flink’s APIs provide
interfaces for Mapper and Reducer functio [...]
+ <a href="/2014/11/18/hadoop-compatibility-in-flink/">...</a>
+
+ </p>
+ <a href="/2014/11/18/hadoop-compatibility-in-flink/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2014/11/04/apache-flink-0.7.0-available/">Apache Flink 0.7.0
available</a>
@@ -1885,6 +1907,10 @@ What is Flink? # Apache Flink is a general-purpose data
processing engine for cl
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/3/index.html b/content/posts/page/3/index.html
index e069a7f04..730a94744 100644
--- a/content/posts/page/3/index.html
+++ b/content/posts/page/3/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,34 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">Apache
Flink Kubernetes Operator 1.1.0 Release Announcement</a>
+ </h3>
+
+ July 25, 2022 -
+
+
+
+ Gyula Fora
+
+ <a href="https://twitter.com/GyulaFora">(@GyulaFora)</a>
+
+
+ Matyas Orhidi
+
+
+
+
+ <p>The community has continued to work hard on improving the Flink
Kubernetes Operator capabilities since our first production ready release we
launched about two months ago.
+With the release of Flink Kubernetes Operator 1.1.0 we are proud to announce a
number of exciting new features improving the overall experience of managing
Flink resources and the operator itself in production environments.
+Release Highlights # A non-exhaustive list of some of the more exciting
features added in the release:
+ <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">...</a>
+
+ </p>
+ <a
href="/2022/07/25/apache-flink-kubernetes-operator-1.1.0-release-announcement/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2022/07/12/apache-flink-ml-2.1.0-release-announcement/">Apache
Flink ML 2.1.0 Release Announcement</a>
@@ -1981,31 +2013,6 @@ New v1beta1 API version & compatibility guarantees
Session Job Management su
<a
href="/2022/05/23/getting-into-low-latency-gears-with-apache-flink-part-two/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">Getting
into Low-Latency Gears with Apache Flink - Part One</a>
- </h3>
-
- May 18, 2022 -
-
-
-
- Jun Qin
-
-
- Nico Kruber
-
-
-
-
- <p>Apache Flink is a stream processing framework well known for its low
latency processing capabilities. It is generic and suitable for a wide range of
use cases. As a Flink application developer or a cluster administrator, you
need to find the right gear that is best for your application. In other words,
you don’t want to be driving a luxury sports car while only using the
first gear.
-In this multi-part series, we will present a collection of low-latency
techniques in Flink.
- <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">...</a>
-
- </p>
- <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2063,6 +2070,10 @@ In this multi-part series, we will present a collection
of low-latency technique
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/4/index.html b/content/posts/page/4/index.html
index 266f4b7a2..13db27fab 100644
--- a/content/posts/page/4/index.html
+++ b/content/posts/page/4/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,31 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">Getting
into Low-Latency Gears with Apache Flink - Part One</a>
+ </h3>
+
+ May 18, 2022 -
+
+
+
+ Jun Qin
+
+
+ Nico Kruber
+
+
+
+
+ <p>Apache Flink is a stream processing framework well known for its low
latency processing capabilities. It is generic and suitable for a wide range of
use cases. As a Flink application developer or a cluster administrator, you
need to find the right gear that is best for your application. In other words,
you don’t want to be driving a luxury sports car while only using the
first gear.
+In this multi-part series, we will present a collection of low-latency
techniques in Flink.
+ <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">...</a>
+
+ </p>
+ <a
href="/2022/05/18/getting-into-low-latency-gears-with-apache-flink-part-one/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2022/05/11/apache-flink-table-store-0.1.0-release-announcement/">Apache
Flink Table Store 0.1.0 Release Announcement</a>
@@ -1983,35 +2012,6 @@ We highly recommend all users to upgrade to Flink 1.
<a href="/2022/02/18/apache-flink-1.13.6-release-announcement/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">Stateful
Functions 3.2.0 Release Announcement</a>
- </h3>
-
- January 31, 2022 -
-
-
-
- Till Rohrmann
-
- <a href="https://twitter.com/stsffap">(@stsffap)</a>
-
-
- Igal Shilman
-
- <a href="https://twitter.com/IgalShilman">(@IgalShilman)</a>
-
-
-
-
- <p>Stateful Functions is a cross-platform stack for building Stateful
Serverless applications, making it radically simpler to develop scalable,
consistent, and elastic distributed applications. This new release brings
various improvements to the StateFun runtime, a leaner way to specify StateFun
module components, and a brand new JavaScript SDK!
-The binary distribution and source artifacts are now available on the updated
Downloads page of the Flink website, and the most recent Java SDK, Python SDK,,
GoLang SDK and JavaScript SDK distributions are available on Maven, PyPI,
Github, and npm respectively.
- <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">...</a>
-
- </p>
- <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2069,6 +2069,10 @@ The binary distribution and source artifacts are now
available on the updated Do
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/5/index.html b/content/posts/page/5/index.html
index f7e544eba..a9dcc1119 100644
--- a/content/posts/page/5/index.html
+++ b/content/posts/page/5/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,35 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">Stateful
Functions 3.2.0 Release Announcement</a>
+ </h3>
+
+ January 31, 2022 -
+
+
+
+ Till Rohrmann
+
+ <a href="https://twitter.com/stsffap">(@stsffap)</a>
+
+
+ Igal Shilman
+
+ <a href="https://twitter.com/IgalShilman">(@IgalShilman)</a>
+
+
+
+
+ <p>Stateful Functions is a cross-platform stack for building Stateful
Serverless applications, making it radically simpler to develop scalable,
consistent, and elastic distributed applications. This new release brings
various improvements to the StateFun runtime, a leaner way to specify StateFun
module components, and a brand new JavaScript SDK!
+The binary distribution and source artifacts are now available on the updated
Downloads page of the Flink website, and the most recent Java SDK, Python SDK,,
GoLang SDK and JavaScript SDK distributions are available on Maven, PyPI,
Github, and npm respectively.
+ <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">...</a>
+
+ </p>
+ <a
href="/2022/01/31/stateful-functions-3.2.0-release-announcement/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2022/01/20/pravega-flink-connector-101/">Pravega Flink
Connector 101</a>
@@ -1989,31 +2022,6 @@ A retrospective on the release cycle # From the team, we
collected emotions that
<a
href="/2021/11/03/flink-backward-the-apache-flink-retrospective/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">Sort-Based
Blocking Shuffle Implementation in Flink - Part One</a>
- </h3>
-
- October 26, 2021 -
-
-
-
- Yingjie Cao (Kevin)
-
-
- Daisy Tsang
-
-
-
-
- <p>Part one of this blog post will explain the motivation behind
introducing sort-based blocking shuffle, present benchmark results, and provide
guidelines on how to use this new feature.
-How data gets passed around between operators # Data shuffling is an important
stage in batch processing applications and describes how data is sent from one
operator to the next. In this phase, output data of the upstream operator will
spill over to persistent storages like disk, then the downstream operator will
read the corresponding data and process it.
- <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">...</a>
-
- </p>
- <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2071,6 +2079,10 @@ How data gets passed around between operators # Data
shuffling is an important s
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/6/index.html b/content/posts/page/6/index.html
index 9fb11b233..e26a66a5a 100644
--- a/content/posts/page/6/index.html
+++ b/content/posts/page/6/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,31 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">Sort-Based
Blocking Shuffle Implementation in Flink - Part One</a>
+ </h3>
+
+ October 26, 2021 -
+
+
+
+ Yingjie Cao (Kevin)
+
+
+ Daisy Tsang
+
+
+
+
+ <p>Part one of this blog post will explain the motivation behind
introducing sort-based blocking shuffle, present benchmark results, and provide
guidelines on how to use this new feature.
+How data gets passed around between operators # Data shuffling is an important
stage in batch processing applications and describes how data is sent from one
operator to the next. In this phase, output data of the upstream operator will
spill over to persistent storages like disk, then the downstream operator will
read the corresponding data and process it.
+ <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">...</a>
+
+ </p>
+ <a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-one/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2021/10/26/sort-based-blocking-shuffle-implementation-in-flink-part-two/">Sort-Based
Blocking Shuffle Implementation in Flink - Part Two</a>
@@ -1989,31 +2018,6 @@ Updated Maven dependencies:
<a href="/2021/08/06/apache-flink-1.12.5-released/">Continue reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a href="/2021/08/06/apache-flink-1.13.2-released/">Apache Flink 1.13.2
Released</a>
- </h3>
-
- August 6, 2021 -
-
-
-
- Yun Tang
-
-
-
-
- <p>The Apache Flink community released the second bugfix version of the
Apache Flink 1.13 series.
-This release includes 127 fixes and minor improvements for Flink 1.13.2. The
list below includes bugfixes and improvements. For a complete list of all
changes see: JIRA.
-We highly recommend all users to upgrade to Flink 1.13.2.
-Updated Maven dependencies:
-<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.13.2</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.13.2</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <vers [...]
- <a href="/2021/08/06/apache-flink-1.13.2-released/">...</a>
-
- </p>
- <a href="/2021/08/06/apache-flink-1.13.2-released/">Continue reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2071,6 +2075,10 @@ Updated Maven dependencies:
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/7/index.html b/content/posts/page/7/index.html
index bb37343e4..419702b8f 100644
--- a/content/posts/page/7/index.html
+++ b/content/posts/page/7/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,31 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a href="/2021/08/06/apache-flink-1.13.2-released/">Apache Flink 1.13.2
Released</a>
+ </h3>
+
+ August 6, 2021 -
+
+
+
+ Yun Tang
+
+
+
+
+ <p>The Apache Flink community released the second bugfix version of the
Apache Flink 1.13 series.
+This release includes 127 fixes and minor improvements for Flink 1.13.2. The
list below includes bugfixes and improvements. For a complete list of all
changes see: JIRA.
+We highly recommend all users to upgrade to Flink 1.13.2.
+Updated Maven dependencies:
+<dependency> <groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>1.13.2</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_2.11</artifactId>
<version>1.13.2</version> </dependency> <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId> <vers [...]
+ <a href="/2021/08/06/apache-flink-1.13.2-released/">...</a>
+
+ </p>
+ <a href="/2021/08/06/apache-flink-1.13.2-released/">Continue reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2021/07/07/how-to-identify-the-source-of-backpressure/">How to
identify the source of backpressure?</a>
@@ -1985,28 +2014,6 @@ Updated Maven dependencies:
<a href="/2021/03/03/apache-flink-1.12.2-released/">Continue reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">How
to natively deploy Flink on Kubernetes with High-Availability (HA)</a>
- </h3>
-
- February 10, 2021 -
-
-
-
- Yang Wang
-
-
-
-
- <p>Flink has supported resource management systems like YARN and Mesos
since the early days; however, these were not designed for the fast-moving
cloud-native architectures that are increasingly gaining popularity these days,
or the growing need to support complex, mixed workloads (e.g. batch, streaming,
deep learning, web services). For these reasons, more and more users are using
Kubernetes to automate the deployment, scaling and management of their Flink
applications.
-From release to release, the Flink community has made significant progress in
integrating natively with Kubernetes, from active resource management to
“Zookeeperless” High Availability (HA).
- <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">...</a>
-
- </p>
- <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2064,6 +2071,10 @@ From release to release, the Flink community has made
significant progress in in
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/8/index.html b/content/posts/page/8/index.html
index 9621fce4f..57570100c 100644
--- a/content/posts/page/8/index.html
+++ b/content/posts/page/8/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,28 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">How
to natively deploy Flink on Kubernetes with High-Availability (HA)</a>
+ </h3>
+
+ February 10, 2021 -
+
+
+
+ Yang Wang
+
+
+
+
+ <p>Flink has supported resource management systems like YARN and Mesos
since the early days; however, these were not designed for the fast-moving
cloud-native architectures that are increasingly gaining popularity these days,
or the growing need to support complex, mixed workloads (e.g. batch, streaming,
deep learning, web services). For these reasons, more and more users are using
Kubernetes to automate the deployment, scaling and management of their Flink
applications.
+From release to release, the Flink community has made significant progress in
integrating natively with Kubernetes, from active resource management to
“Zookeeperless” High Availability (HA).
+ <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">...</a>
+
+ </p>
+ <a
href="/2021/02/10/how-to-natively-deploy-flink-on-kubernetes-with-high-availability-ha/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a href="/2021/01/29/apache-flink-1.10.3-released/">Apache Flink 1.10.3
Released</a>
@@ -1974,31 +2000,6 @@ The community has added support for efficient batch
execution in the DataStream
<a
href="/2020/12/02/improvements-in-task-scheduling-for-batch-workloads-in-apache-flink-1.12/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">Stateful
Functions 2.2.1 Release Announcement</a>
- </h3>
-
- November 11, 2020 -
-
-
-
- Tzu-Li (Gordon) Tai
-
- <a href="https://twitter.com/tzulitai">(@tzulitai)</a>
-
-
-
-
- <p>The Apache Flink community released the first bugfix release of the
Stateful Functions (StateFun) 2.2 series, version 2.2.1.
-This release fixes a critical bug that causes restoring the Stateful Functions
cluster from snapshots (checkpoints or savepoints) to fail under certain
conditions. Starting from this release, StateFun now creates snapshots with a
more robust format that allows it to be restored safely going forward.
-We strongly recommend all users to upgrade to 2.
- <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">...</a>
-
- </p>
- <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2056,6 +2057,10 @@ We strongly recommend all users to upgrade to 2.
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/posts/page/9/index.html b/content/posts/page/9/index.html
index a27f974a8..96353dbcb 100644
--- a/content/posts/page/9/index.html
+++ b/content/posts/page/9/index.html
@@ -880,6 +880,10 @@ https://github.com/alex-shpak/hugo-book
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
@@ -1752,6 +1756,31 @@ https://github.com/alex-shpak/hugo-book
+ <article class="markdown book-post">
+ <h3>
+ <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">Stateful
Functions 2.2.1 Release Announcement</a>
+ </h3>
+
+ November 11, 2020 -
+
+
+
+ Tzu-Li (Gordon) Tai
+
+ <a href="https://twitter.com/tzulitai">(@tzulitai)</a>
+
+
+
+
+ <p>The Apache Flink community released the first bugfix release of the
Stateful Functions (StateFun) 2.2 series, version 2.2.1.
+This release fixes a critical bug that causes restoring the Stateful Functions
cluster from snapshots (checkpoints or savepoints) to fail under certain
conditions. Starting from this release, StateFun now creates snapshots with a
more robust format that allows it to be restored safely going forward.
+We strongly recommend all users to upgrade to 2.
+ <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">...</a>
+
+ </p>
+ <a
href="/2020/11/11/stateful-functions-2.2.1-release-announcement/">Continue
reading »</a>
+ </article>
+
<article class="markdown book-post">
<h3>
<a
href="/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1-checkpoints-alignment-and-backpressure/">From
Aligned to Unaligned Checkpoints - Part 1: Checkpoints, Alignment, and
Backpressure</a>
@@ -1977,27 +2006,6 @@ IoT networks are composed of many individual, but
interconnected components, whi
<a
href="/2020/08/18/monitoring-and-controlling-networks-of-iot-devices-with-flink-stateful-functions/">Continue
reading »</a>
</article>
- <article class="markdown book-post">
- <h3>
- <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">Accelerating
your workload with GPU and other external resources</a>
- </h3>
-
- August 6, 2020 -
-
-
-
- Yangze Guo
-
-
-
-
- <p>Apache Flink 1.11 introduces a new External Resource Framework, which
allows you to request external resources from the underlying resource
management systems (e.g., Kubernetes) and accelerate your workload with those
resources. As Flink provides a first-party GPU plugin at the moment, we will
take GPU as an example and show how it affects Flink applications in the AI
field. Other external resources (e.g. RDMA and SSD) can also be supported in a
pluggable manner.
- <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">...</a>
-
- </p>
- <a
href="/2020/08/06/accelerating-your-workload-with-gpu-and-other-external-resources/">Continue
reading »</a>
- </article>
-
<ul class="pagination pagination-default">
@@ -2055,6 +2063,10 @@ IoT networks are composed of many individual, but
interconnected components, whi
<nav>
<ul>
+ <li>
+ <a
href="https://flink.apache.org/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a>
+ </li>
+
<li>
<a
href="https://flink.apache.org/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a>
</li>
diff --git a/content/sitemap.xml b/content/sitemap.xml
index edf5c3947..ca8ec7f71 100644
--- a/content/sitemap.xml
+++ b/content/sitemap.xml
@@ -4,7 +4,7 @@
<sitemap>
<loc>https://flink.apache.org/en/sitemap.xml</loc>
- <lastmod>2023-05-03T08:00:00+00:00</lastmod>
+ <lastmod>2023-05-09T08:00:00+00:00</lastmod>
</sitemap>
diff --git a/content/zh/index.html b/content/zh/index.html
index e2893b198..a670252d0 100644
--- a/content/zh/index.html
+++ b/content/zh/index.html
@@ -6,8 +6,8 @@
<meta name="generator" content="Hugo 0.111.3">
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
-<meta name="description" content="Apache Flink® - 数据流上的有状态计算 # 所有流式场景 事件驱动应用
流批分析 数据管道 & ETL 了解更多 正确性保证 Exactly-once 状态一致性 事件时间处理 成熟的迟到数据处理 了解更多 分层 API SQL
on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time &
State) 了解更多 聚焦运维 灵活部署 高可用 保存点 了解更多 大规模计算 水平扩展架构 支持超大状态 增量检查点机制 了解更多 性能卓越 低延迟
高吞吐 内存计算 了解更多 最新博客列表 # Howto create a batch source with the new Source framework
-Introduction # The Flink community has designed a new Source framework based
on FLIP-27 lately.">
+<meta name="description" content="Apache Flink® - 数据流上的有状态计算 # 所有流式场景 事件驱动应用
流批分析 数据管道 & ETL 了解更多 正确性保证 Exactly-once 状态一致性 事件时间处理 成熟的迟到数据处理 了解更多 分层 API SQL
on Stream & Batch Data DataStream API & DataSet API ProcessFunction (Time &
State) 了解更多 聚焦运维 灵活部署 高可用 保存点 了解更多 大规模计算 水平扩展架构 支持超大状态 增量检查点机制 了解更多 性能卓越 低延迟
高吞吐 内存计算 了解更多 最新博客列表 # Howto migrate a real-life batch pipeline from the
DataSet API to the DataStream API
+Introduction # The Flink community has been deprecating the DataSet API since
version 1.">
<meta name="theme-color" content="#FFFFFF"><meta property="og:title"
content="Apache Flink Documentation" />
<meta property="og:description" content="" />
<meta property="og:type" content="website" />
@@ -1040,6 +1040,10 @@ under the License.
+ <a
href="/2023/05/09/howto-migrate-a-real-life-batch-pipeline-from-the-dataset-api-to-the-datastream-api/">Howto
migrate a real-life batch pipeline from the DataSet API to the DataStream
API</a><br />
+ Introduction # The Flink community has been deprecating the DataSet
API since version 1.12 as part of the work on FLIP-131: Consolidate the
user-facing Dataflow SDKs/APIs (and deprecate the DataSet API) . This blog
article illustrates the migration of a real-life batch DataSet pipeline to a
batch DataStream pipeline. All the code presented in this article is available
in the tpcds-benchmark-flink repo. The use case shown here is extracted from a
broader work comparing Flink perfo [...]
+ <br /><br />
+
<a
href="/2023/05/03/howto-create-a-batch-source-with-the-new-source-framework/">Howto
create a batch source with the new Source framework</a><br />
Introduction # The Flink community has designed a new Source framework
based on FLIP-27 lately. Some connectors have migrated to this new framework.
This article is a how-to for creating a batch source using this new framework.
It was built while implementing the Flink batch source for Cassandra. If you
are interested in contributing or migrating connectors, this blog post is for
you!
Implementing the source components # The source architecture is depicted in
the diagrams below:
@@ -1050,10 +1054,6 @@ Implementing the source components # The source
architecture is depicted in the
With the addition of these algorithms, we believe Flink ML library is ready
for use in production jobs that require feature engineering capabilities, whose
input can then be consumed by both offline and online machine learning tasks.
<br /><br />
- <a
href="/2023/03/23/announcing-the-release-of-apache-flink-1.17/">Announcing the
Release of Apache Flink 1.17</a><br />
- The Apache Flink PMC is pleased to announce Apache Flink release
1.17.0. Apache Flink is the leading stream processing standard, and the concept
of unified stream and batch data processing is being successfully adopted in
more and more companies. Thanks to our excellent community and contributors,
Apache Flink continues to grow as a technology and remains one of the most
active projects in the Apache Software Foundation. Flink 1.17 had 172
contributors enthusiastically participat [...]
- <br /><br />
-