This is an automated email from the ASF dual-hosted git repository. lindong pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git
commit cae52b28b5ada032660e1284b9f564813c424ecb Author: zhangzp <[email protected]> AuthorDate: Tue Jul 12 11:06:18 2022 +0800 Rebuild website --- content/blog/feed.xml | 315 ++++++++---------- content/blog/index.html | 39 +-- content/blog/page10/index.html | 38 +-- content/blog/page11/index.html | 38 +-- content/blog/page12/index.html | 38 +-- content/blog/page13/index.html | 40 +-- content/blog/page14/index.html | 38 +-- content/blog/page15/index.html | 37 +-- content/blog/page16/index.html | 39 +-- content/blog/page17/index.html | 38 +-- content/blog/page18/index.html | 37 +-- content/blog/page19/index.html | 39 +-- content/blog/page2/index.html | 39 +-- content/blog/page20/index.html | 25 -- content/blog/page3/index.html | 36 +-- content/blog/page4/index.html | 36 +-- content/blog/page5/index.html | 38 +-- content/blog/page6/index.html | 38 +-- content/blog/page7/index.html | 36 +-- content/blog/page8/index.html | 36 +-- content/blog/page9/index.html | 36 +-- content/downloads.html | 2 +- content/index.html | 6 +- content/news/2022/07/07/release-ml-2.1.0.html | 448 -------------------------- content/zh/downloads.html | 2 +- content/zh/index.html | 6 +- 26 files changed, 412 insertions(+), 1108 deletions(-) diff --git a/content/blog/feed.xml b/content/blog/feed.xml index 079fbbdbc..728e4e401 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -419,181 +419,6 @@ please feel free to start a discussion or report an issue in the dev or user mai <guid isPermaLink="true">/2022/07/11/final-checkpoint-part1.html</guid> </item> -<item> -<title>Apache Flink ML 2.1.0 Release Announcement</title> -<description><p>The Apache Flink community is excited to announce the release of Flink ML 2.1.0! -This release focuses on improving Flink ML’s infrastructure, such as Python SDK, -memory management, and benchmark framework, to facilitate the development of -performant, memory-safe, and easy-to-use algorithm libraries. We validated the -enhanced infrastructure by implementing, benchmarking, and optimizing 10 new -algorithms in Flink ML, and confirmed that Flink ML can meet or exceed the -performance of selected algorithms from alternative popular ML libraries. -In addition, this release added example Python and Java programs for each -algorithm in the library to help users learn and use Flink ML.</p> - -<p>With the improvements and performance benchmarks made in this release, we -believe Flink ML’s infrastructure is ready for use by the interested developers -in the community to build performant pythonic machine learning libraries.</p> - -<p>We encourage you to <a href="https://flink.apache.org/downloads.html">download the release</a> -and share your feedback with the community through the Flink -<a href="https://flink.apache.org/community.html#mailing-lists">mailing lists</a> or -<a href="https://issues.apache.org/jira/browse/flink">JIRA</a>! We hope you like the new -release and we’d be eager to learn about your experience with it.</p> - -<div class="page-toc"> -<ul id="markdown-toc"> - <li><a href="#notable-features" id="markdown-toc-notable-features">Notable Features</a> <ul> - <li><a href="#api-and-infrastructure" id="markdown-toc-api-and-infrastructure">API and Infrastructure</a> <ul> - <li><a href="#supporting-fine-grained-per-operator-memory-management" id="markdown-toc-supporting-fine-grained-per-operator-memory-management">Supporting fine-grained per-operator memory management</a></li> - <li><a href="#improved-infrastructure-for-developing-online-learning-algorithms" id="markdown-toc-improved-infrastructure-for-developing-online-learning-algorithms">Improved infrastructure for developing online learning algorithms</a></li> - <li><a href="#algorithm-benchmark-framework" id="markdown-toc-algorithm-benchmark-framework">Algorithm benchmark framework</a></li> - </ul> - </li> - <li><a href="#python-sdk" id="markdown-toc-python-sdk">Python SDK</a></li> - <li><a href="#algorithm-library" id="markdown-toc-algorithm-library">Algorithm Library</a></li> - </ul> - </li> - <li><a href="#upgrade-notes" id="markdown-toc-upgrade-notes">Upgrade Notes</a></li> - <li><a href="#release-notes-and-resources" id="markdown-toc-release-notes-and-resources">Release Notes and Resources</a></li> - <li><a href="#list-of-contributors" id="markdown-toc-list-of-contributors">List of Contributors</a></li> -</ul> - -</div> - -<h1 id="notable-features">Notable Features</h1> - -<h2 id="api-and-infrastructure">API and Infrastructure</h2> - -<h3 id="supporting-fine-grained-per-operator-memory-management">Supporting fine-grained per-operator memory management</h3> - -<p>Before this release, algorithm operators with internal states (e.g. the training -data to be replayed for each round of iteration) store state data using the -state-backend API (e.g. ListState). Such an operator either needs to store all -data in memory, which risks OOM, or it needs to always store data on disk. -In the latter case, it needs to read and de-serialize all data from disks -repeatedly in each round of iteration even if the data can fit in RAM, leading -to sub-optimal performance when the training data size is small. This makes it -hard for developers to write performant and memory-safe operators.</p> - -<p>This release enhances the Flink ML infrastructure with the mechanism to specify -the amount of managed memory that an operator can consume. This allows algorithm -operators to write and read data from managed memory when the data size is below -the quota, and automatically spill those data that exceeds the memory quota to -disks to avoid OOM. Algorithm developers can use this mechanism to achieve -optimal algorithm performance as input data size varies. Please feel free to -check out the implementation of the KMeans operator for example.</p> - -<h3 id="improved-infrastructure-for-developing-online-learning-algorithms">Improved infrastructure for developing online learning algorithms</h3> - -<p>A key objective of Flink ML is to facilitate the development of online learning -applications. In the last release, we enhanced the Flink ML API with -setModelData() and getModelData(), which allows users of online learning -algorithms to transmit and persist model data as unbounded data streams. -This release continues the effort by improving and validating the infrastructure -needed to develop online learning algorithms.</p> - -<p>Specifically, this release added two online learning algorithm prototypes (i.e. -OnlineKMeans and OnlineLogisticRegression) with tests covering the entire -lifecycle of using these algorithms. These two algorithms introduce concepts -such as global batch size and model version, together with metrics and APIs to -set and get those values. While the online algorithm prototypes have not been -optimized for prediction accuracy yet, this line of work is an important step -toward setting up best practices for building online learning algorithms in -Flink ML. We hope more contributors from the community can join this effort.</p> - -<h3 id="algorithm-benchmark-framework">Algorithm benchmark framework</h3> - -<p>An easy-to-use benchmark framework is critical to developing and maintaining -performant algorithm libraries in Flink ML. This release added a benchmark -framework that provides APIs to write pluggable and reusable data generators, -takes benchmark configuration in JSON format, and outputs benchmark results in -JSON format to enable custom analysis. An off-the-shelf script is provided to -visualize benchmark results using Matplotlib. Feel free to check out this -<a href="https://github.com/apache/flink-ml/blob/release-2.1/flink-ml-benchmark/README.md">README</a> -for instructions on how to use this benchmark framework.</p> - -<p>The benchmark framework currently supports evaluating algorithm throughput. -In the future release, we plan to support evaluating algorithm latency and -accuracy.</p> - -<h2 id="python-sdk">Python SDK</h2> - -<p>This release enhances the Python SDK so that operators in the Flink ML Python -library can invoke the corresponding operators in the Java library. The Python -operator is a thin-wrapper around the Java operator and delivers the same -performance as the Java operator during execution. This capability significantly -improves developer velocity by allowing algorithm developers to maintain both -the Python and the Java libraries of algorithms without having to implement -those algorithms twice.</p> - -<h2 id="algorithm-library">Algorithm Library</h2> -<p>This release continues to extend the algorithm library in Flink ML, with the -focus on validating the functionalities and the performance of Flink ML -infrastructure using representative algorithms in different categories.</p> - -<p>Below are the lists of algorithms newly supported in this release, grouped by -their categories:</p> - -<ul> - <li>Feature engineering (MinMaxScaler, StringIndexer, VectorAssembler, -StandardScaler, Bucketizer)</li> - <li>Online learning (OnlineKmeans, OnlineLogisiticRegression)</li> - <li>Regression (LinearRegression)</li> - <li>Classification (LinearSVC)</li> - <li>Evaluation (BinaryClassificationEvaluator)</li> -</ul> - -<p>Example Python and Java programs for these algorithms are provided on the Apache -Flink ML <a href="https://nightlies.apache.org/flink/flink-ml-docs-release-2.1/">website</a> to -help users learn and try out Flink ML. And we also provided example benchmark -<a href="https://github.com/apache/flink-ml/tree/release-2.1/flink-ml-benchmark/src/main/resources">configuration files</a> -in the repo for users to validate Flink ML performance. Feel free to check out -this <a href="https://github.com/apache/flink-ml/blob/release-2.1/flink-ml-benchmark/README.md">README</a> -for instructions on how to run those benchmarks.</p> - -<h1 id="upgrade-notes">Upgrade Notes</h1> - -<p>Please review this note for a list of adjustments to make and issues to check -if you plan to upgrade to Flink ML 2.1.0.</p> - -<p>This note discusses any critical information about incompatibilities and -breaking changes, performance changes, and any other changes that might impact -your production deployment of Flink ML.</p> - -<ul> - <li> - <p><strong>Flink dependency is changed from 1.14 to 1.15</strong>.</p> - - <p>This change introduces all the breaking changes listed in the Flink 1.15 -<a href="https://nightlies.apache.org/flink/flink-docs-release-1.15/release-notes/flink-1.15/">release notes</a>.</p> - </li> -</ul> - -<h1 id="release-notes-and-resources">Release Notes and Resources</h1> - -<p>Please take a look at the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&amp;version=12351141">release notes</a> -for a detailed list of changes and new features.</p> - -<p>The source artifacts is now available on the updated -<a href="https://flink.apache.org/downloads.html">Downloads page</a> of the Flink website, -and the most recent distribution of Flink ML Python package is available on -<a href="https://pypi.org/project/apache-flink-ml">PyPI</a>.</p> - -<h1 id="list-of-contributors">List of Contributors</h1> - -<p>The Apache Flink community would like to thank each one of the contributors -that have made this release possible:</p> - -<p>Yunfeng Zhou, Zhipeng Zhang, huangxingbo, weibo, Dong Lin, Yun Gao, Jingsong Li -and mumuhhh.</p> - -</description> -<pubDate>Thu, 07 Jul 2022 10:00:00 +0200</pubDate> -<link>https://flink.apache.org/news/2022/07/07/release-ml-2.1.0.html</link> -<guid isPermaLink="true">/news/2022/07/07/release-ml-2.1.0.html</guid> -</item> - <item> <title>Apache Flink 1.15.1 Release Announcement</title> <description><p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink 1.15 series.</p> @@ -20366,5 +20191,145 @@ To understand why this is the case, let us start with articulating a realistic s <guid isPermaLink="true">/news/2020/01/15/demo-fraud-detection.html</guid> </item> +<item> +<title>Apache Flink 1.8.3 Released</title> +<description><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.8 series.</p> + +<p>This release includes 45 fixes and minor improvements for Flink 1.8.2. The list below includes a detailed list of all fixes and improvements.</p> + +<p>We highly recommend all users to upgrade to Flink 1.8.3.</p> + +<p>Updated Maven dependencies:</p> + +<div class="highlight"><pre><code class="language-xml"><span class="nt">&lt;dependency&gt;</span> + <span class="nt">&lt;groupId&gt;</span>org.apache.flink<span class="nt">&lt;/groupId&gt;</span> + <span class="nt">&lt;artifactId&gt;</span>flink-java<span class="nt">&lt;/artifactId&gt;</span> + <span class="nt">&lt;version&gt;</span>1.8.3<span class="nt">&lt;/version&gt;</span> +<span class="nt">&lt;/dependency&gt;</span> +<span class="nt">&lt;dependency&gt;</span> + <span class="nt">&lt;groupId&gt;</span>org.apache.flink<span class="nt">&lt;/groupId&gt;</span> + <span class="nt">&lt;artifactId&gt;</span>flink-streaming-java_2.11<span class="nt">&lt;/artifactId&gt;</span> + <span class="nt">&lt;version&gt;</span>1.8.3<span class="nt">&lt;/version&gt;</span> +<span class="nt">&lt;/dependency&gt;</span> +<span class="nt">&lt;dependency&gt;</span> + <span class="nt">&lt;groupId&gt;</span>org.apache.flink<span class="nt">&lt;/groupId&gt;</span> + <span class="nt">&lt;artifactId&gt;</span>flink-clients_2.11<span class="nt">&lt;/artifactId&gt;</span> + <span class="nt">&lt;version&gt;</span>1.8.3<span class="nt">&lt;/version&gt;</span> +<span class="nt">&lt;/dependency&gt;</span></code></pre></div> + +<p>You can find the binaries on the updated <a href="/downloads.html">Downloads page</a>.</p> + +<p>List of resolved issues:</p> + +<h2> Sub-task +</h2> +<ul> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13723">FLINK-13723</a>] - Use liquid-c for faster doc generation +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13724">FLINK-13724</a>] - Remove unnecessary whitespace from the docs&#39; sidenav +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13725">FLINK-13725</a>] - Use sassc for faster doc generation +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13726">FLINK-13726</a>] - Build docs with jekyll 4.0.0.pre.beta1 +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13791">FLINK-13791</a>] - Speed up sidenav by using group_by +</li> +</ul> + +<h2> Bug +</h2> +<ul> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-12342">FLINK-12342</a>] - Yarn Resource Manager Acquires Too Many Containers +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13184">FLINK-13184</a>] - Starting a TaskExecutor blocks the YarnResourceManager&#39;s main thread +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13728">FLINK-13728</a>] - Fix wrong closing tag order in sidenav +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13746">FLINK-13746</a>] - Elasticsearch (v2.3.5) sink end-to-end test fails on Travis +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13749">FLINK-13749</a>] - Make Flink client respect classloading policy +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13892">FLINK-13892</a>] - HistoryServerTest failed on Travis +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13936">FLINK-13936</a>] - NOTICE-binary is outdated +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13966">FLINK-13966</a>] - Jar sorting in collect_license_files.sh is locale dependent +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13995">FLINK-13995</a>] - Fix shading of the licence information of netty +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13999">FLINK-13999</a>] - Correct the documentation of MATCH_RECOGNIZE +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14009">FLINK-14009</a>] - Cron jobs broken due to verifying incorrect NOTICE-binary file +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14010">FLINK-14010</a>] - Dispatcher &amp; JobManagers don&#39;t give up leadership when AM is shut down +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14043">FLINK-14043</a>] - SavepointMigrationTestBase is super slow +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14107">FLINK-14107</a>] - Kinesis consumer record emitter deadlock under event time alignment +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14175">FLINK-14175</a>] - Upgrade KPL version in flink-connector-kinesis to fix application OOM +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14235">FLINK-14235</a>] - Kafka010ProducerITCase&gt;KafkaProducerTestBase.testOneToOneAtLeastOnceCustomOperator fails on travis +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14315">FLINK-14315</a>] - NPE with JobMaster.disconnectTaskManager +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14337">FLINK-14337</a>] - HistoryServerTest.testHistoryServerIntegration failed on Travis +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14347">FLINK-14347</a>] - YARNSessionFIFOITCase.checkForProhibitedLogContents found a log with prohibited string +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14370">FLINK-14370</a>] - KafkaProducerAtLeastOnceITCase&gt;KafkaProducerTestBase.testOneToOneAtLeastOnceRegularSink fails on Travis +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14398">FLINK-14398</a>] - Further split input unboxing code into separate methods +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14413">FLINK-14413</a>] - shade-plugin ApacheNoticeResourceTransformer uses platform-dependent encoding +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14434">FLINK-14434</a>] - Dispatcher#createJobManagerRunner should not start JobManagerRunner +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14562">FLINK-14562</a>] - RMQSource leaves idle consumer after closing +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14589">FLINK-14589</a>] - Redundant slot requests with the same AllocationID leads to inconsistent slot table +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-15036">FLINK-15036</a>] - Container startup error will be handled out side of the YarnResourceManager&#39;s main thread +</li> +</ul> + +<h2> Improvement +</h2> +<ul> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-12848">FLINK-12848</a>] - Method equals() in RowTypeInfo should consider fieldsNames +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13729">FLINK-13729</a>] - Update website generation dependencies +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13965">FLINK-13965</a>] - Keep hasDeprecatedKeys and deprecatedKeys methods in ConfigOption and mark it with @Deprecated annotation +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13967">FLINK-13967</a>] - Generate full binary licensing via collect_license_files.sh +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13968">FLINK-13968</a>] - Add travis check for the correctness of the binary licensing +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-13991">FLINK-13991</a>] - Add git exclusion for 1.9+ features to 1.8 +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14008">FLINK-14008</a>] - Auto-generate binary licensing +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14104">FLINK-14104</a>] - Bump Jackson to 2.10.1 +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14123">FLINK-14123</a>] - Lower the default value of taskmanager.memory.fraction +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14215">FLINK-14215</a>] - Add Docs for TM and JM Environment Variable Setting +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14334">FLINK-14334</a>] - ElasticSearch docs refer to non-existent ExceptionUtils.containsThrowable +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14639">FLINK-14639</a>] - Fix the document of Metrics that has an error for `User Scope` +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14646">FLINK-14646</a>] - Check non-null for key in KeyGroupStreamPartitioner +</li> +<li>[<a href="https://issues.apache.org/jira/browse/FLINK-14995">FLINK-14995</a>] - Kinesis NOTICE is incorrect +</li> +</ul> +</description> +<pubDate>Wed, 11 Dec 2019 13:00:00 +0100</pubDate> +<link>https://flink.apache.org/news/2019/12/11/release-1.8.3.html</link> +<guid isPermaLink="true">/news/2019/12/11/release-1.8.3.html</guid> +</item> + </channel> </rss> diff --git a/content/blog/index.html b/content/blog/index.html index c6b88d0dd..5cf6dc9fe 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -262,19 +262,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></h2> - - <p>07 Jul 2022 - Zhipeng Zhang & Dong Lin </p> - - <p>The Apache Flink community is excited to announce the release of Flink ML 2.1.0! This release focuses on improving Flink ML's infrastructure, such as Python SDK, memory management, and benchmark framework, to facilitate the development of performant, memory-safe, and easy-to-use algorithm libraries. We validated the enhanced infrastructure via benchmarks and confirmed that Flink ML can meet or exceed the performance of selected algorithms from alternative popular ML libraries. I [...] - - <p><a href="/news/2022/07/07/release-ml-2.1.0.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></h2> @@ -369,6 +356,22 @@ We are now proud to announce the first production ready release of the operator <hr> + <article> + <h2 class="blog-title"><a href="/news/2022/05/11/release-table-store-0.1.0.html">Apache Flink Table Store 0.1.0 Release Announcement</a></h2> + + <p>11 May 2022 + Jingsong Lee & Jiangjie (Becket) Qin </p> + + <p><p>The Apache Flink community is pleased to announce the preview release of the +<a href="https://github.com/apache/flink-table-store";>Apache Flink Table Store</a> (0.1.0).</p> + +</p> + + <p><a href="/news/2022/05/11/release-table-store-0.1.0.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -421,16 +424,6 @@ We are now proud to announce the first production ready release of the operator - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page10/index.html b/content/blog/page10/index.html index 0b7fad9b6..1fe66f6f1 100644 --- a/content/blog/page10/index.html +++ b/content/blog/page10/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></h2> - - <p>01 Apr 2020 - Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> - - <p>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</p> - - <p><a href="/news/2020/04/01/community-update.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/features/2020/03/27/flink-for-data-warehouse.html">Flink as Unified Engine for Modern Data Warehousing: Production-Ready Hive Integration</a></h2> @@ -372,6 +359,21 @@ <hr> + <article> + <h2 class="blog-title"><a href="/news/2019/12/11/release-1.8.3.html">Apache Flink 1.8.3 Released</a></h2> + + <p>11 Dec 2019 + Hequn Cheng </p> + + <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.8 series.</p> + +</p> + + <p><a href="/news/2019/12/11/release-1.8.3.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -424,16 +426,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page11/index.html b/content/blog/page11/index.html index ff5a1fe91..8cde1aa21 100644 --- a/content/blog/page11/index.html +++ b/content/blog/page11/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2019/12/11/release-1.8.3.html">Apache Flink 1.8.3 Released</a></h2> - - <p>11 Dec 2019 - Hequn Cheng </p> - - <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.8 series.</p> - -</p> - - <p><a href="/news/2019/12/11/release-1.8.3.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2019/12/09/flink-kubernetes-kudo.html">Running Apache Flink on Kubernetes with KUDO</a></h2> @@ -377,6 +362,19 @@ <hr> + <article> + <h2 class="blog-title"><a href="/2019/06/26/broadcast-state.html">A Practical Guide to Broadcast State in Apache Flink</a></h2> + + <p>26 Jun 2019 + Fabian Hueske (<a href="https://twitter.com/fhueske";>@fhueske</a>)</p> + + <p>Apache Flink has multiple types of operator state, one of which is called Broadcast State. In this post, we explain what Broadcast State is, and show an example of how it can be applied to an application that evaluates dynamic patterns on an event stream.</p> + + <p><a href="/2019/06/26/broadcast-state.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -429,16 +427,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page12/index.html b/content/blog/page12/index.html index e46a5b5a6..86ebcc36f 100644 --- a/content/blog/page12/index.html +++ b/content/blog/page12/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2019/06/26/broadcast-state.html">A Practical Guide to Broadcast State in Apache Flink</a></h2> - - <p>26 Jun 2019 - Fabian Hueske (<a href="https://twitter.com/fhueske";>@fhueske</a>)</p> - - <p>Apache Flink has multiple types of operator state, one of which is called Broadcast State. In this post, we explain what Broadcast State is, and show an example of how it can be applied to an application that evaluates dynamic patterns on an event stream.</p> - - <p><a href="/2019/06/26/broadcast-state.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/2019/06/05/flink-network-stack.html">A Deep-Dive into Flink's Network Stack</a></h2> @@ -374,6 +361,21 @@ for more details.</p> <hr> + <article> + <h2 class="blog-title"><a href="/news/2019/02/25/release-1.6.4.html">Apache Flink 1.6.4 Released</a></h2> + + <p>25 Feb 2019 + </p> + + <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.6 series.</p> + +</p> + + <p><a href="/news/2019/02/25/release-1.6.4.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -426,16 +428,6 @@ for more details.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page13/index.html b/content/blog/page13/index.html index b2a19978f..04776eff4 100644 --- a/content/blog/page13/index.html +++ b/content/blog/page13/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2019/02/25/release-1.6.4.html">Apache Flink 1.6.4 Released</a></h2> - - <p>25 Feb 2019 - </p> - - <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.6 series.</p> - -</p> - - <p><a href="/news/2019/02/25/release-1.6.4.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2019/02/15/release-1.7.2.html">Apache Flink 1.7.2 Released</a></h2> @@ -386,6 +371,21 @@ Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa <hr> + <article> + <h2 class="blog-title"><a href="/news/2018/09/20/release-1.5.4.html">Apache Flink 1.5.4 Released</a></h2> + + <p>20 Sep 2018 + </p> + + <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.5 series.</p> + +</p> + + <p><a href="/news/2018/09/20/release-1.5.4.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -438,16 +438,6 @@ Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page14/index.html b/content/blog/page14/index.html index c2ae97020..0a78a343a 100644 --- a/content/blog/page14/index.html +++ b/content/blog/page14/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2018/09/20/release-1.5.4.html">Apache Flink 1.5.4 Released</a></h2> - - <p>20 Sep 2018 - </p> - - <p><p>The Apache Flink community released the fourth bugfix version of the Apache Flink 1.5 series.</p> - -</p> - - <p><a href="/news/2018/09/20/release-1.5.4.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2018/08/21/release-1.5.3.html">Apache Flink 1.5.3 Released</a></h2> @@ -384,6 +369,19 @@ <hr> + <article> + <h2 class="blog-title"><a href="/features/2018/01/30/incremental-checkpointing.html">Managing Large State in Apache Flink: An Intro to Incremental Checkpointing</a></h2> + + <p>30 Jan 2018 + Stefan Ricther (<a href="https://twitter.com/StefanRRicther";>@StefanRRicther</a>) & Chris Ward (<a href="https://twitter.com/chrischinch";>@chrischinch</a>)</p> + + <p>Flink 1.3.0 introduced incremental checkpointing, making it possible for applications with large state to generate checkpoints more efficiently.</p> + + <p><a href="/features/2018/01/30/incremental-checkpointing.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -436,16 +434,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page15/index.html b/content/blog/page15/index.html index 6c8caa92c..cbbe6d1e9 100644 --- a/content/blog/page15/index.html +++ b/content/blog/page15/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/features/2018/01/30/incremental-checkpointing.html">Managing Large State in Apache Flink: An Intro to Incremental Checkpointing</a></h2> - - <p>30 Jan 2018 - Stefan Ricther (<a href="https://twitter.com/StefanRRicther";>@StefanRRicther</a>) & Chris Ward (<a href="https://twitter.com/chrischinch";>@chrischinch</a>)</p> - - <p>Flink 1.3.0 introduced incremental checkpointing, making it possible for applications with large state to generate checkpoints more efficiently.</p> - - <p><a href="/features/2018/01/30/incremental-checkpointing.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2017/12/21/2017-year-in-review.html">Apache Flink in 2017: Year in Review</a></h2> @@ -385,6 +372,20 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community <hr> + <article> + <h2 class="blog-title"><a href="/news/2017/04/04/dynamic-tables.html">Continuous Queries on Dynamic Tables</a></h2> + + <p>04 Apr 2017 by Fabian Hueske, Shaoxuan Wang, and Xiaowei Jiang + </p> + + <p><p>Flink's relational APIs, the Table API and SQL, are unified APIs for stream and batch processing, meaning that a query produces the same result when being evaluated on streaming or static data.</p> +<p>In this blog post we discuss the future of these APIs and introduce the concept of Dynamic Tables. Dynamic tables will significantly expand the scope of the Table API and SQL on streams and enable many more advanced use cases. We discuss how streams and dynamic tables relate to each other and explain the semantics of continuously evaluating queries on dynamic tables.</p></p> + + <p><a href="/news/2017/04/04/dynamic-tables.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -437,16 +438,6 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page16/index.html b/content/blog/page16/index.html index f81ee8ea4..b28e3acb3 100644 --- a/content/blog/page16/index.html +++ b/content/blog/page16/index.html @@ -236,20 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2017/04/04/dynamic-tables.html">Continuous Queries on Dynamic Tables</a></h2> - - <p>04 Apr 2017 by Fabian Hueske, Shaoxuan Wang, and Xiaowei Jiang - </p> - - <p><p>Flink's relational APIs, the Table API and SQL, are unified APIs for stream and batch processing, meaning that a query produces the same result when being evaluated on streaming or static data.</p> -<p>In this blog post we discuss the future of these APIs and introduce the concept of Dynamic Tables. Dynamic tables will significantly expand the scope of the Table API and SQL on streams and enable many more advanced use cases. We discuss how streams and dynamic tables relate to each other and explain the semantics of continuously evaluating queries on dynamic tables.</p></p> - - <p><a href="/news/2017/04/04/dynamic-tables.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2017/03/29/table-sql-api-update.html">From Streams to Tables and Back Again: An Update on Flink's Table & SQL API</a></h2> @@ -379,6 +365,21 @@ <hr> + <article> + <h2 class="blog-title"><a href="/news/2016/08/08/release-1.1.0.html">Announcing Apache Flink 1.1.0</a></h2> + + <p>08 Aug 2016 + </p> + + <p><div class="alert alert-success"><strong>Important</strong>: The Maven artifacts published with version 1.1.0 on Maven central have a Hadoop dependency issue. It is highly recommended to use <strong>1.1.1</strong> or <strong>1.1.1-hadoop1</strong> as the Flink version.</div> + +</p> + + <p><a href="/news/2016/08/08/release-1.1.0.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -431,16 +432,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page17/index.html b/content/blog/page17/index.html index cb193be00..f899f993c 100644 --- a/content/blog/page17/index.html +++ b/content/blog/page17/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2016/08/08/release-1.1.0.html">Announcing Apache Flink 1.1.0</a></h2> - - <p>08 Aug 2016 - </p> - - <p><div class="alert alert-success"><strong>Important</strong>: The Maven artifacts published with version 1.1.0 on Maven central have a Hadoop dependency issue. It is highly recommended to use <strong>1.1.1</strong> or <strong>1.1.1-hadoop1</strong> as the Flink version.</div> - -</p> - - <p><a href="/news/2016/08/08/release-1.1.0.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2016/05/24/stream-sql.html">Stream Processing for Everyone with SQL and Apache Flink</a></h2> @@ -381,6 +366,19 @@ <hr> + <article> + <h2 class="blog-title"><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></h2> + + <p>11 Dec 2015 by Matthias J. Sax (<a href="https://twitter.com/";>@MatthiasJSax</a>) + </p> + + <p>In this blog post, we describe Flink's compatibility package for <a href="https://storm.apache.org";>Apache Storm</a> that allows to embed Spouts (sources) and Bolts (operators) in a regular Flink streaming job. Furthermore, the compatibility package provides a Storm compatible API in order to execute whole Storm topologies with (almost) no code adaption.</p> + + <p><a href="/news/2015/12/11/storm-compatibility.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -433,16 +431,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page18/index.html b/content/blog/page18/index.html index 0652cd41a..6e8dfdea0 100644 --- a/content/blog/page18/index.html +++ b/content/blog/page18/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2015/12/11/storm-compatibility.html">Storm Compatibility in Apache Flink: How to run existing Storm topologies on Flink</a></h2> - - <p>11 Dec 2015 by Matthias J. Sax (<a href="https://twitter.com/";>@MatthiasJSax</a>) - </p> - - <p>In this blog post, we describe Flink's compatibility package for <a href="https://storm.apache.org";>Apache Storm</a> that allows to embed Spouts (sources) and Bolts (operators) in a regular Flink streaming job. Furthermore, the compatibility package provides a Storm compatible API in order to execute whole Storm topologies with (almost) no code adaption.</p> - - <p><a href="/news/2015/12/11/storm-compatibility.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2015/12/04/Introducing-windows.html">Introducing Stream Windows in Apache Flink</a></h2> @@ -387,6 +374,20 @@ vertex-centric or gather-sum-apply to Flink dataflows.</p> <hr> + <article> + <h2 class="blog-title"><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></h2> + + <p>11 May 2015 by Fabian Hüske (<a href="https://twitter.com/";>@fhueske</a>) + </p> + + <p><p>Nowadays, a lot of open-source systems for analyzing large data sets are implemented in Java or other JVM-based programming languages. The most well-known example is Apache Hadoop, but also newer frameworks such as Apache Spark, Apache Drill, and also Apache Flink run on JVMs. A common challenge that JVM-based data analysis engines face is to store large amounts of data in memory - both for caching and for efficient processing such as sorting and joining of data. Managing the [...] +<p>In this blog post we discuss how Apache Flink manages memory, talk about its custom data de/serialization stack, and show how it operates on binary data.</p></p> + + <p><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -439,16 +440,6 @@ vertex-centric or gather-sum-apply to Flink dataflows.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page19/index.html b/content/blog/page19/index.html index b262e784b..b0f84bd30 100644 --- a/content/blog/page19/index.html +++ b/content/blog/page19/index.html @@ -236,20 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Juggling with Bits and Bytes</a></h2> - - <p>11 May 2015 by Fabian Hüske (<a href="https://twitter.com/";>@fhueske</a>) - </p> - - <p><p>Nowadays, a lot of open-source systems for analyzing large data sets are implemented in Java or other JVM-based programming languages. The most well-known example is Apache Hadoop, but also newer frameworks such as Apache Spark, Apache Drill, and also Apache Flink run on JVMs. A common challenge that JVM-based data analysis engines face is to store large amounts of data in memory - both for caching and for efficient processing such as sorting and joining of data. Managing the [...] -<p>In this blog post we discuss how Apache Flink manages memory, talk about its custom data de/serialization stack, and show how it operates on binary data.</p></p> - - <p><a href="/news/2015/05/11/Juggling-with-Bits-and-Bytes.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2015/04/13/release-0.9.0-milestone1.html">Announcing Flink 0.9.0-milestone1 preview release</a></h2> @@ -395,6 +381,21 @@ and offers a new API including definition of flexible windows.</p> <hr> + <article> + <h2 class="blog-title"><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></h2> + + <p>04 Nov 2014 + </p> + + <p><p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them!</p> + +</p> + + <p><a href="/news/2014/11/04/release-0.7.0.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -447,16 +448,6 @@ and offers a new API including definition of flexible windows.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page2/index.html b/content/blog/page2/index.html index 9f4a3b952..22d3dc865 100644 --- a/content/blog/page2/index.html +++ b/content/blog/page2/index.html @@ -236,22 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2022/05/11/release-table-store-0.1.0.html">Apache Flink Table Store 0.1.0 Release Announcement</a></h2> - - <p>11 May 2022 - Jingsong Lee & Jiangjie (Becket) Qin </p> - - <p><p>The Apache Flink community is pleased to announce the preview release of the -<a href="https://github.com/apache/flink-table-store";>Apache Flink Table Store</a> (0.1.0).</p> - -</p> - - <p><a href="/news/2022/05/11/release-table-store-0.1.0.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/2022/05/06/async-sink-base.html">The Generic Asynchronous Base Sink</a></h2> @@ -380,6 +364,19 @@ This new release brings various improvements to the StateFun runtime, a leaner w <hr> + <article> + <h2 class="blog-title"><a href="/2022/01/20/pravega-connector-101.html">Pravega Flink Connector 101</a></h2> + + <p>20 Jan 2022 + Yumin Zhou (Brian) (<a href="https://twitter.com/crazy__zhou";>@crazy__zhou</a>)</p> + + <p>A brief introduction to the Pravega Flink Connector</p> + + <p><a href="/2022/01/20/pravega-connector-101.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -432,16 +429,6 @@ This new release brings various improvements to the StateFun runtime, a leaner w - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page20/index.html b/content/blog/page20/index.html index ed49b86de..c03fed09c 100644 --- a/content/blog/page20/index.html +++ b/content/blog/page20/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2014/11/04/release-0.7.0.html">Apache Flink 0.7.0 available</a></h2> - - <p>04 Nov 2014 - </p> - - <p><p>We are pleased to announce the availability of Flink 0.7.0. This release includes new user-facing features as well as performance and bug fixes, brings the Scala and Java APIs in sync, and introduces Flink Streaming. A total of 34 people have contributed to this release, a big thanks to all of them!</p> - -</p> - - <p><a href="/news/2014/11/04/release-0.7.0.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2014/10/03/upcoming_events.html">Upcoming Events</a></h2> @@ -351,16 +336,6 @@ academic and open source project that Flink originates from.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page3/index.html b/content/blog/page3/index.html index a147677ee..aecdb160b 100644 --- a/content/blog/page3/index.html +++ b/content/blog/page3/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2022/01/20/pravega-connector-101.html">Pravega Flink Connector 101</a></h2> - - <p>20 Jan 2022 - Yumin Zhou (Brian) (<a href="https://twitter.com/crazy__zhou";>@crazy__zhou</a>)</p> - - <p>A brief introduction to the Pravega Flink Connector</p> - - <p><a href="/2022/01/20/pravega-connector-101.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2022/01/17/release-1.14.3.html">Apache Flink 1.14.3 Release Announcement</a></h2> @@ -370,6 +357,19 @@ <hr> + <article> + <h2 class="blog-title"><a href="/2021/10/26/sort-shuffle-part1.html">Sort-Based Blocking Shuffle Implementation in Flink - Part One</a></h2> + + <p>26 Oct 2021 + Yingjie Cao (Kevin) & Daisy Tsang </p> + + <p>Flink has implemented the sort-based blocking shuffle (FLIP-148) for batch data processing. In this blog post, we will take a close look at the design & implementation details and see what we can gain from it.</p> + + <p><a href="/2021/10/26/sort-shuffle-part1.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -422,16 +422,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page4/index.html b/content/blog/page4/index.html index c1856ea09..2aa2e7aed 100644 --- a/content/blog/page4/index.html +++ b/content/blog/page4/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2021/10/26/sort-shuffle-part1.html">Sort-Based Blocking Shuffle Implementation in Flink - Part One</a></h2> - - <p>26 Oct 2021 - Yingjie Cao (Kevin) & Daisy Tsang </p> - - <p>Flink has implemented the sort-based blocking shuffle (FLIP-148) for batch data processing. In this blog post, we will take a close look at the design & implementation details and see what we can gain from it.</p> - - <p><a href="/2021/10/26/sort-shuffle-part1.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2021/10/19/release-1.13.3.html">Apache Flink 1.13.3 Released</a></h2> @@ -390,6 +377,19 @@ This new release brings various improvements to the StateFun runtime, a leaner w <hr> + <article> + <h2 class="blog-title"><a href="/2021/07/07/backpressure.html">How to identify the source of backpressure?</a></h2> + + <p>07 Jul 2021 + Piotr Nowojski (<a href="https://twitter.com/PiotrNowojski";>@PiotrNowojski</a>)</p> + + <p>Apache Flink 1.13 introduced a couple of important changes in the area of backpressure monitoring and performance analysis of Flink Jobs. This blog post aims to introduce those changes and explain how to use them.</p> + + <p><a href="/2021/07/07/backpressure.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -442,16 +442,6 @@ This new release brings various improvements to the StateFun runtime, a leaner w - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page5/index.html b/content/blog/page5/index.html index 10b406ea2..233bf67ff 100644 --- a/content/blog/page5/index.html +++ b/content/blog/page5/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2021/07/07/backpressure.html">How to identify the source of backpressure?</a></h2> - - <p>07 Jul 2021 - Piotr Nowojski (<a href="https://twitter.com/PiotrNowojski";>@PiotrNowojski</a>)</p> - - <p>Apache Flink 1.13 introduced a couple of important changes in the area of backpressure monitoring and performance analysis of Flink Jobs. This blog post aims to introduce those changes and explain how to use them.</p> - - <p><a href="/2021/07/07/backpressure.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2021/05/28/release-1.13.1.html">Apache Flink 1.13.1 Released</a></h2> @@ -378,6 +365,21 @@ to develop scalable, consistent, and elastic distributed applications.</p> <hr> + <article> + <h2 class="blog-title"><a href="/news/2021/01/29/release-1.10.3.html">Apache Flink 1.10.3 Released</a></h2> + + <p>29 Jan 2021 + Xintong Song </p> + + <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.10 series.</p> + +</p> + + <p><a href="/news/2021/01/29/release-1.10.3.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -430,16 +432,6 @@ to develop scalable, consistent, and elastic distributed applications.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page6/index.html b/content/blog/page6/index.html index c8e9b3707..f916b36b9 100644 --- a/content/blog/page6/index.html +++ b/content/blog/page6/index.html @@ -236,21 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2021/01/29/release-1.10.3.html">Apache Flink 1.10.3 Released</a></h2> - - <p>29 Jan 2021 - Xintong Song </p> - - <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.10 series.</p> - -</p> - - <p><a href="/news/2021/01/29/release-1.10.3.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2021/01/19/release-1.12.1.html">Apache Flink 1.12.1 Released</a></h2> @@ -376,6 +361,19 @@ <hr> + <article> + <h2 class="blog-title"><a href="/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1.html">From Aligned to Unaligned Checkpoints - Part 1: Checkpoints, Alignment, and Backpressure</a></h2> + + <p>15 Oct 2020 + Arvid Heise & Stephan Ewen </p> + + <p>Apache Flink’s checkpoint-based fault tolerance mechanism is one of its defining features. Because of that design, Flink unifies batch and stream processing, can easily scale to both very small and extremely large scenarios and provides support for many operational features. In this post we recap the original checkpointing process in Flink, its core properties and issues under backpressure.</p> + + <p><a href="/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -428,16 +426,6 @@ - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page7/index.html b/content/blog/page7/index.html index 934fcc4e1..6dee27caf 100644 --- a/content/blog/page7/index.html +++ b/content/blog/page7/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1.html">From Aligned to Unaligned Checkpoints - Part 1: Checkpoints, Alignment, and Backpressure</a></h2> - - <p>15 Oct 2020 - Arvid Heise & Stephan Ewen </p> - - <p>Apache Flink’s checkpoint-based fault tolerance mechanism is one of its defining features. Because of that design, Flink unifies batch and stream processing, can easily scale to both very small and extremely large scenarios and provides support for many operational features. In this post we recap the original checkpointing process in Flink, its core properties and issues under backpressure.</p> - - <p><a href="/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2020/10/13/stateful-serverless-internals.html">Stateful Functions Internals: Behind the scenes of Stateful Serverless</a></h2> @@ -378,6 +365,19 @@ as well as increased observability for operational purposes.</p> <hr> + <article> + <h2 class="blog-title"><a href="/2020/08/04/pyflink-pandas-udf-support-flink.html">PyFlink: The integration of Pandas into PyFlink</a></h2> + + <p>04 Aug 2020 + Jincheng Sun (<a href="https://twitter.com/sunjincheng121";>@sunjincheng121</a>) & Markos Sfikas (<a href="https://twitter.com/MarkSfik";>@MarkSfik</a>)</p> + + <p>The Apache Flink community put some great effort into integrating Pandas with PyFlink in the latest Flink version 1.11. Some of the added features include support for Pandas UDF and the conversion between Pandas DataFrame and Table. In this article, we will introduce how these functionalities work and how to use them with a step-by-step example.</p> + + <p><a href="/2020/08/04/pyflink-pandas-udf-support-flink.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -430,16 +430,6 @@ as well as increased observability for operational purposes.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page8/index.html b/content/blog/page8/index.html index 8911ada41..f7491c4f6 100644 --- a/content/blog/page8/index.html +++ b/content/blog/page8/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/2020/08/04/pyflink-pandas-udf-support-flink.html">PyFlink: The integration of Pandas into PyFlink</a></h2> - - <p>04 Aug 2020 - Jincheng Sun (<a href="https://twitter.com/sunjincheng121";>@sunjincheng121</a>) & Markos Sfikas (<a href="https://twitter.com/MarkSfik";>@MarkSfik</a>)</p> - - <p>The Apache Flink community put some great effort into integrating Pandas with PyFlink in the latest Flink version 1.11. Some of the added features include support for Pandas UDF and the conversion between Pandas DataFrame and Table. In this article, we will introduce how these functionalities work and how to use them with a step-by-step example.</p> - - <p><a href="/2020/08/04/pyflink-pandas-udf-support-flink.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2020/07/30/demo-fraud-detection-3.html">Advanced Flink Application Patterns Vol.3: Custom Window Processing</a></h2> @@ -384,6 +371,19 @@ and provide a tutorial for running Streaming ETL with Flink on Zeppelin.</p> <hr> + <article> + <h2 class="blog-title"><a href="/news/2020/06/11/community-update.html">Flink Community Update - June'20</a></h2> + + <p>11 Jun 2020 + Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> + + <p>And suddenly it’s June. The previous month has been calm on the surface, but quite hectic underneath — the final testing phase for Flink 1.11 is moving at full speed, Stateful Functions 2.1 is out in the wild and Flink has made it into Google Season of Docs 2020.</p> + + <p><a href="/news/2020/06/11/community-update.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -436,16 +436,6 @@ and provide a tutorial for running Streaming ETL with Flink on Zeppelin.</p> - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/blog/page9/index.html b/content/blog/page9/index.html index c7d0abe66..802dc3bb3 100644 --- a/content/blog/page9/index.html +++ b/content/blog/page9/index.html @@ -236,19 +236,6 @@ <div class="col-sm-8"> <!-- Blog posts --> - <article> - <h2 class="blog-title"><a href="/news/2020/06/11/community-update.html">Flink Community Update - June'20</a></h2> - - <p>11 Jun 2020 - Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> - - <p>And suddenly it’s June. The previous month has been calm on the surface, but quite hectic underneath — the final testing phase for Flink 1.11 is moving at full speed, Stateful Functions 2.1 is out in the wild and Flink has made it into Google Season of Docs 2020.</p> - - <p><a href="/news/2020/06/11/community-update.html">Continue reading »</a></p> - </article> - - <hr> - <article> <h2 class="blog-title"><a href="/news/2020/06/09/release-statefun-2.1.0.html">Stateful Functions 2.1.0 Release Announcement</a></h2> @@ -375,6 +362,19 @@ This release marks a big milestone: Stateful Functions 2.0 is not only an API up <hr> + <article> + <h2 class="blog-title"><a href="/news/2020/04/01/community-update.html">Flink Community Update - April'20</a></h2> + + <p>01 Apr 2020 + Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> + + <p>While things slow down around us, the Apache Flink community is privileged to remain as active as ever. This blogpost combs through the past few months to give you an update on the state of things in Flink — from core releases to Stateful Functions; from some good old community stats to a new development blog.</p> + + <p><a href="/news/2020/04/01/community-update.html">Continue reading »</a></p> + </article> + + <hr> + <!-- Pagination links --> @@ -427,16 +427,6 @@ This release marks a big milestone: Stateful Functions 2.0 is not only an API up - <li><a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></li> - - - - - - - - - <li><a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></li> diff --git a/content/downloads.html b/content/downloads.html index 75b248309..873684af4 100644 --- a/content/downloads.html +++ b/content/downloads.html @@ -1581,7 +1581,7 @@ Flink Stateful Functions 2.0.0 - 2020-04-02 <ul> <li> -Flink ML 2.1.0 - 2022-07-07 +Flink ML 2.1.0 - 2022-07-12 (<a href="https://archive.apache.org/dist/flink/flink-ml-2.1.0/flink-ml-2.1.0-src.tgz";>Source</a>) </li> diff --git a/content/index.html b/content/index.html index 3c22bf8c2..9659e791d 100644 --- a/content/index.html +++ b/content/index.html @@ -407,14 +407,14 @@ <dt> <a href="/2022/07/11/final-checkpoint-part1.html">FLIP-147: Support Checkpoints After Tasks Finished - Part One</a></dt> <dd>This post briefly describes the motivation and changes made by the final checkpoint mechanism, including the changes to the checkpoint procedure and how tasks finish.</dd> - <dt> <a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></dt> - <dd>The Apache Flink community is excited to announce the release of Flink ML 2.1.0! This release focuses on improving Flink ML's infrastructure, such as Python SDK, memory management, and benchmark framework, to facilitate the development of performant, memory-safe, and easy-to-use algorithm libraries. We validated the enhanced infrastructure via benchmarks and confirmed that Flink ML can meet or exceed the performance of selected algorithms from alternative popular ML libraries [...] - <dt> <a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce a bug fix release for Flink 1.15.</dd> <dt> <a href="/news/2022/06/22/release-1.14.5.html">Apache Flink 1.14.5 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce another bug fix release for Flink 1.14.</dd> + + <dt> <a href="/2022/06/17/adaptive-batch-scheduler.html">Adaptive Batch Scheduler: Automatically Decide Parallelism of Flink Batch Jobs</a></dt> + <dd>To automatically decide parallelism of Flink batch jobs, we introduced adaptive batch scheduler in Flink 1.15. In this post, we'll take a close look at the design & implementation details.</dd> </dl> diff --git a/content/news/2022/07/07/release-ml-2.1.0.html b/content/news/2022/07/07/release-ml-2.1.0.html deleted file mode 100644 index 18cf6897f..000000000 --- a/content/news/2022/07/07/release-ml-2.1.0.html +++ /dev/null @@ -1,448 +0,0 @@ -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <meta http-equiv="X-UA-Compatible" content="IE=edge"> - <meta name="viewport" content="width=device-width, initial-scale=1"> - <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags --> - <title>Apache Flink: Apache Flink ML 2.1.0 Release Announcement</title> - <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> - <link rel="icon" href="/favicon.ico" type="image/x-icon"> - - <!-- Bootstrap --> - <link rel="stylesheet" href="/css/bootstrap.min.css"> - <link rel="stylesheet" href="/css/flink.css"> - <link rel="stylesheet" href="/css/syntax.css"> - - <!-- Blog RSS feed --> - <link href="/blog/feed.xml" rel="alternate" type="application/rss+xml" title="Apache Flink Blog: RSS feed" /> - - <!-- jQuery (necessary for Bootstrap's JavaScript plugins) --> - <!-- We need to load Jquery in the header for custom google analytics event tracking--> - <script src="/js/jquery.min.js"></script> - - <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries --> - <!-- WARNING: Respond.js doesn't work if you view the page via file:// --> - <!--[if lt IE 9]> - <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js";></script> - <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js";></script> - <![endif]--> - <!-- Matomo --> - <script> - var _paq = window._paq = window._paq || []; - /* tracker methods like "setCustomDimension" should be called before "trackPageView" */ - /* We explicitly disable cookie tracking to avoid privacy issues */ - _paq.push(['disableCookies']); - /* Measure a visit to flink.apache.org and nightlies.apache.org/flink as the same visit */ - _paq.push(["setDomains", ["*.flink.apache.org","*.nightlies.apache.org/flink"]]); - _paq.push(['trackPageView']); - _paq.push(['enableLinkTracking']); - (function() { - var u="//matomo.privacy.apache.org/"; - _paq.push(['setTrackerUrl', u+'matomo.php']); - _paq.push(['setSiteId', '1']); - var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0]; - g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s); - })(); - </script> - <!-- End Matomo Code --> - </head> - <body> - - - <!-- Main content. --> - <div class="container"> - <div class="row"> - - - <div id="sidebar" class="col-sm-3"> - - -<!-- Top navbar. --> - <nav class="navbar navbar-default"> - <!-- The logo. --> - <div class="navbar-header"> - <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <div class="navbar-logo"> - <a href="/"> - <img alt="Apache Flink" src="/img/flink-header-logo.svg" width="147px" height="73px"> - </a> - </div> - </div><!-- /.navbar-header --> - - <!-- The navigation links. --> - <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1"> - <ul class="nav navbar-nav navbar-main"> - - <!-- First menu section explains visitors what Flink is --> - - <!-- What is Stream Processing? --> - <!-- - <li><a href="/streamprocessing1.html">What is Stream Processing?</a></li> - --> - - <!-- What is Flink? --> - <li><a href="/flink-architecture.html">What is Apache Flink?</a></li> - - - - <!-- Stateful Functions? --> - - <li><a href="https://nightlies.apache.org/flink/flink-statefun-docs-stable/";>What is Stateful Functions?</a></li> - - <!-- Flink ML? --> - - <li><a href="https://nightlies.apache.org/flink/flink-ml-docs-stable/";>What is Flink ML?</a></li> - - <!-- Flink Kubernetes Operator? --> - - <li><a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-stable/";>What is the Flink Kubernetes Operator?</a></li> - - <!-- Use cases --> - <li><a href="/usecases.html">Use Cases</a></li> - - <!-- Powered by --> - <li><a href="/poweredby.html">Powered By</a></li> - - - - <!-- Second menu section aims to support Flink users --> - - <!-- Downloads --> - <li><a href="/downloads.html">Downloads</a></li> - - <!-- Getting Started --> - <li class="dropdown"> - <a class="dropdown-toggle" data-toggle="dropdown" href="#">Getting Started<span class="caret"></span></a> - <ul class="dropdown-menu"> - <li><a href="https://nightlies.apache.org/flink/flink-docs-release-1.15//docs/try-flink/local_installation/"; target="_blank">With Flink <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-statefun-docs-release-3.2/getting-started/project-setup.html"; target="_blank">With Flink Stateful Functions <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-ml-docs-release-2.1/try-flink-ml/quick-start.html"; target="_blank">With Flink ML <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-release-1.0/try-flink-kubernetes-operator/quick-start.html"; target="_blank">With Flink Kubernetes Operator <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-table-store-docs-release-0.1/try-table-store/quick-start.html"; target="_blank">With Flink Table Store <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="/training.html">Training Course</a></li> - </ul> - </li> - - <!-- Documentation --> - <li class="dropdown"> - <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> - <ul class="dropdown-menu"> - <li><a href="https://nightlies.apache.org/flink/flink-docs-release-1.15"; target="_blank">Flink 1.15 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-docs-master"; target="_blank">Flink Master (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-statefun-docs-release-3.2"; target="_blank">Flink Stateful Functions 3.2 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-statefun-docs-master"; target="_blank">Flink Stateful Functions Master (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-ml-docs-release-2.1"; target="_blank">Flink ML 2.1 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-ml-docs-master"; target="_blank">Flink ML Master (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-release-1.0"; target="_blank">Flink Kubernetes Operator 1.0 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main"; target="_blank">Flink Kubernetes Operator Main (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-table-store-docs-release-0.1"; target="_blank">Flink Table Store 0.1 (Latest stable release) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - <li><a href="https://nightlies.apache.org/flink/flink-table-store-docs-master"; target="_blank">Flink Table Store Master (Latest Snapshot) <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - </ul> - </li> - - <!-- getting help --> - <li><a href="/gettinghelp.html">Getting Help</a></li> - - <!-- Blog --> - <li class="active"><a href="/blog/"><b>Flink Blog</b></a></li> - - - <!-- Flink-packages --> - <li> - <a href="https://flink-packages.org"; target="_blank">flink-packages.org <small><span class="glyphicon glyphicon-new-window"></span></small></a> - </li> - - - <!-- Third menu section aim to support community and contributors --> - - <!-- Community --> - <li><a href="/community.html">Community & Project Info</a></li> - - <!-- Roadmap --> - <li><a href="/roadmap.html">Roadmap</a></li> - - <!-- Contribute --> - <li><a href="/contributing/how-to-contribute.html">How to Contribute</a></li> - - - <!-- GitHub --> - <li> - <a href="https://github.com/apache/flink"; target="_blank">Flink on GitHub <small><span class="glyphicon glyphicon-new-window"></span></small></a> - </li> - - - - <!-- Language Switcher --> - <li> - - - <!-- link to the Chinese home page when current is blog page --> - <a href="/zh">中文版</a> - - - </li> - - </ul> - - <style> - .smalllinks:link { - display: inline-block !important; background: none; padding-top: 0px; padding-bottom: 0px; padding-right: 0px; min-width: 75px; - } - </style> - - <ul class="nav navbar-nav navbar-bottom"> - <hr /> - - <!-- Twitter --> - <li><a href="https://twitter.com/apacheflink"; target="_blank">@ApacheFlink <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - - <!-- Visualizer --> - <li class=" hidden-md hidden-sm"><a href="/visualizer/" target="_blank">Plan Visualizer <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - - <li > - <a href="/security.html">Flink Security</a> - </li> - - <hr /> - - <li><a href="https://apache.org"; target="_blank">Apache Software Foundation <small><span class="glyphicon glyphicon-new-window"></span></small></a></li> - - <li> - - <a class="smalllinks" href="https://www.apache.org/licenses/"; target="_blank">License</a> <small><span class="glyphicon glyphicon-new-window"></span></small> - - <a class="smalllinks" href="https://www.apache.org/security/"; target="_blank">Security</a> <small><span class="glyphicon glyphicon-new-window"></span></small> - - <a class="smalllinks" href="https://www.apache.org/foundation/sponsorship.html"; target="_blank">Donate</a> <small><span class="glyphicon glyphicon-new-window"></span></small> - - <a class="smalllinks" href="https://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a> <small><span class="glyphicon glyphicon-new-window"></span></small> - </li> - - </ul> - </div><!-- /.navbar-collapse --> - </nav> - - </div> - <div class="col-sm-9"> - <div class="row-fluid"> - <div class="col-sm-12"> - <div class="row"> - <h1>Apache Flink ML 2.1.0 Release Announcement</h1> - <p><i></i></p> - - <article> - <p>07 Jul 2022 Zhipeng Zhang & Dong Lin </p> - -<p>The Apache Flink community is excited to announce the release of Flink ML 2.1.0! -This release focuses on improving Flink ML’s infrastructure, such as Python SDK, -memory management, and benchmark framework, to facilitate the development of -performant, memory-safe, and easy-to-use algorithm libraries. We validated the -enhanced infrastructure by implementing, benchmarking, and optimizing 10 new -algorithms in Flink ML, and confirmed that Flink ML can meet or exceed the -performance of selected algorithms from alternative popular ML libraries. -In addition, this release added example Python and Java programs for each -algorithm in the library to help users learn and use Flink ML.</p> - -<p>With the improvements and performance benchmarks made in this release, we -believe Flink ML’s infrastructure is ready for use by the interested developers -in the community to build performant pythonic machine learning libraries.</p> - -<p>We encourage you to <a href="https://flink.apache.org/downloads.html";>download the release</a> -and share your feedback with the community through the Flink -<a href="https://flink.apache.org/community.html#mailing-lists";>mailing lists</a> or -<a href="https://issues.apache.org/jira/browse/flink";>JIRA</a>! We hope you like the new -release and we’d be eager to learn about your experience with it.</p> - -<div class="page-toc"> -<ul id="markdown-toc"> - <li><a href="#notable-features" id="markdown-toc-notable-features">Notable Features</a> <ul> - <li><a href="#api-and-infrastructure" id="markdown-toc-api-and-infrastructure">API and Infrastructure</a> <ul> - <li><a href="#supporting-fine-grained-per-operator-memory-management" id="markdown-toc-supporting-fine-grained-per-operator-memory-management">Supporting fine-grained per-operator memory management</a></li> - <li><a href="#improved-infrastructure-for-developing-online-learning-algorithms" id="markdown-toc-improved-infrastructure-for-developing-online-learning-algorithms">Improved infrastructure for developing online learning algorithms</a></li> - <li><a href="#algorithm-benchmark-framework" id="markdown-toc-algorithm-benchmark-framework">Algorithm benchmark framework</a></li> - </ul> - </li> - <li><a href="#python-sdk" id="markdown-toc-python-sdk">Python SDK</a></li> - <li><a href="#algorithm-library" id="markdown-toc-algorithm-library">Algorithm Library</a></li> - </ul> - </li> - <li><a href="#upgrade-notes" id="markdown-toc-upgrade-notes">Upgrade Notes</a></li> - <li><a href="#release-notes-and-resources" id="markdown-toc-release-notes-and-resources">Release Notes and Resources</a></li> - <li><a href="#list-of-contributors" id="markdown-toc-list-of-contributors">List of Contributors</a></li> -</ul> - -</div> - -<h1 id="notable-features">Notable Features</h1> - -<h2 id="api-and-infrastructure">API and Infrastructure</h2> - -<h3 id="supporting-fine-grained-per-operator-memory-management">Supporting fine-grained per-operator memory management</h3> - -<p>Before this release, algorithm operators with internal states (e.g. the training -data to be replayed for each round of iteration) store state data using the -state-backend API (e.g. ListState). Such an operator either needs to store all -data in memory, which risks OOM, or it needs to always store data on disk. -In the latter case, it needs to read and de-serialize all data from disks -repeatedly in each round of iteration even if the data can fit in RAM, leading -to sub-optimal performance when the training data size is small. This makes it -hard for developers to write performant and memory-safe operators.</p> - -<p>This release enhances the Flink ML infrastructure with the mechanism to specify -the amount of managed memory that an operator can consume. This allows algorithm -operators to write and read data from managed memory when the data size is below -the quota, and automatically spill those data that exceeds the memory quota to -disks to avoid OOM. Algorithm developers can use this mechanism to achieve -optimal algorithm performance as input data size varies. Please feel free to -check out the implementation of the KMeans operator for example.</p> - -<h3 id="improved-infrastructure-for-developing-online-learning-algorithms">Improved infrastructure for developing online learning algorithms</h3> - -<p>A key objective of Flink ML is to facilitate the development of online learning -applications. In the last release, we enhanced the Flink ML API with -setModelData() and getModelData(), which allows users of online learning -algorithms to transmit and persist model data as unbounded data streams. -This release continues the effort by improving and validating the infrastructure -needed to develop online learning algorithms.</p> - -<p>Specifically, this release added two online learning algorithm prototypes (i.e. -OnlineKMeans and OnlineLogisticRegression) with tests covering the entire -lifecycle of using these algorithms. These two algorithms introduce concepts -such as global batch size and model version, together with metrics and APIs to -set and get those values. While the online algorithm prototypes have not been -optimized for prediction accuracy yet, this line of work is an important step -toward setting up best practices for building online learning algorithms in -Flink ML. We hope more contributors from the community can join this effort.</p> - -<h3 id="algorithm-benchmark-framework">Algorithm benchmark framework</h3> - -<p>An easy-to-use benchmark framework is critical to developing and maintaining -performant algorithm libraries in Flink ML. This release added a benchmark -framework that provides APIs to write pluggable and reusable data generators, -takes benchmark configuration in JSON format, and outputs benchmark results in -JSON format to enable custom analysis. An off-the-shelf script is provided to -visualize benchmark results using Matplotlib. Feel free to check out this -<a href="https://github.com/apache/flink-ml/blob/release-2.1/flink-ml-benchmark/README.md";>README</a> -for instructions on how to use this benchmark framework.</p> - -<p>The benchmark framework currently supports evaluating algorithm throughput. -In the future release, we plan to support evaluating algorithm latency and -accuracy.</p> - -<h2 id="python-sdk">Python SDK</h2> - -<p>This release enhances the Python SDK so that operators in the Flink ML Python -library can invoke the corresponding operators in the Java library. The Python -operator is a thin-wrapper around the Java operator and delivers the same -performance as the Java operator during execution. This capability significantly -improves developer velocity by allowing algorithm developers to maintain both -the Python and the Java libraries of algorithms without having to implement -those algorithms twice.</p> - -<h2 id="algorithm-library">Algorithm Library</h2> -<p>This release continues to extend the algorithm library in Flink ML, with the -focus on validating the functionalities and the performance of Flink ML -infrastructure using representative algorithms in different categories.</p> - -<p>Below are the lists of algorithms newly supported in this release, grouped by -their categories:</p> - -<ul> - <li>Feature engineering (MinMaxScaler, StringIndexer, VectorAssembler, -StandardScaler, Bucketizer)</li> - <li>Online learning (OnlineKmeans, OnlineLogisiticRegression)</li> - <li>Regression (LinearRegression)</li> - <li>Classification (LinearSVC)</li> - <li>Evaluation (BinaryClassificationEvaluator)</li> -</ul> - -<p>Example Python and Java programs for these algorithms are provided on the Apache -Flink ML <a href="https://nightlies.apache.org/flink/flink-ml-docs-release-2.1/";>website</a> to -help users learn and try out Flink ML. And we also provided example benchmark -<a href="https://github.com/apache/flink-ml/tree/release-2.1/flink-ml-benchmark/src/main/resources";>configuration files</a> -in the repo for users to validate Flink ML performance. Feel free to check out -this <a href="https://github.com/apache/flink-ml/blob/release-2.1/flink-ml-benchmark/README.md";>README</a> -for instructions on how to run those benchmarks.</p> - -<h1 id="upgrade-notes">Upgrade Notes</h1> - -<p>Please review this note for a list of adjustments to make and issues to check -if you plan to upgrade to Flink ML 2.1.0.</p> - -<p>This note discusses any critical information about incompatibilities and -breaking changes, performance changes, and any other changes that might impact -your production deployment of Flink ML.</p> - -<ul> - <li> - <p><strong>Flink dependency is changed from 1.14 to 1.15</strong>.</p> - - <p>This change introduces all the breaking changes listed in the Flink 1.15 -<a href="https://nightlies.apache.org/flink/flink-docs-release-1.15/release-notes/flink-1.15/";>release notes</a>.</p> - </li> -</ul> - -<h1 id="release-notes-and-resources">Release Notes and Resources</h1> - -<p>Please take a look at the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12351141";>release notes</a> -for a detailed list of changes and new features.</p> - -<p>The source artifacts is now available on the updated -<a href="https://flink.apache.org/downloads.html";>Downloads page</a> of the Flink website, -and the most recent distribution of Flink ML Python package is available on -<a href="https://pypi.org/project/apache-flink-ml";>PyPI</a>.</p> - -<h1 id="list-of-contributors">List of Contributors</h1> - -<p>The Apache Flink community would like to thank each one of the contributors -that have made this release possible:</p> - -<p>Yunfeng Zhou, Zhipeng Zhang, huangxingbo, weibo, Dong Lin, Yun Gao, Jingsong Li -and mumuhhh.</p> - - - </article> - </div> - - <div class="row"> - <div id="disqus_thread"></div> - <script type="text/javascript"> - /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */ - var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname - - /* * * DON'T EDIT BELOW THIS LINE * * */ - (function() { - var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true; - dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js'; - (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq); - })(); - </script> - </div> - </div> -</div> - </div> - </div> - - <hr /> - - <div class="row"> - <div class="footer text-center col-sm-12"> - <p>Copyright © 2014-2022 <a href="http://apache.org";>The Apache Software Foundation</a>. All Rights Reserved.</p> - <p>Apache Flink, Flink®, Apache®, the squirrel logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation.</p> - <p><a href="https://privacy.apache.org/policies/privacy-policy-public.html";>Privacy Policy</a> · <a href="/blog/feed.xml">RSS feed</a></p> - </div> - </div> - </div><!-- /.container --> - - <!-- Include all compiled plugins (below), or include individual files as needed --> - <script src="/js/jquery.matchHeight-min.js"></script> - <script src="/js/bootstrap.min.js"></script> - <script src="/js/codetabs.js"></script> - <script src="/js/stickysidebar.js"></script> - </body> -</html> diff --git a/content/zh/downloads.html b/content/zh/downloads.html index 641d3981f..a521da7ad 100644 --- a/content/zh/downloads.html +++ b/content/zh/downloads.html @@ -1454,7 +1454,7 @@ Flink 0.6-incubating - 2014-08-26 <ul> <li> -Flink ML 2.1.0 - 2022-07-07 +Flink ML 2.1.0 - 2022-07-12 (<a href="https://archive.apache.org/dist/flink/flink-ml-2.1.0/flink-ml-2.1.0-src.tgz";>Source</a>) </li> diff --git a/content/zh/index.html b/content/zh/index.html index b19b3096c..a5bb8e0b3 100644 --- a/content/zh/index.html +++ b/content/zh/index.html @@ -404,14 +404,14 @@ <dt> <a href="/2022/07/11/final-checkpoint-part1.html">FLIP-147: Support Checkpoints After Tasks Finished - Part One</a></dt> <dd>This post briefly describes the motivation and changes made by the final checkpoint mechanism, including the changes to the checkpoint procedure and how tasks finish.</dd> - <dt> <a href="/news/2022/07/07/release-ml-2.1.0.html">Apache Flink ML 2.1.0 Release Announcement</a></dt> - <dd>The Apache Flink community is excited to announce the release of Flink ML 2.1.0! This release focuses on improving Flink ML's infrastructure, such as Python SDK, memory management, and benchmark framework, to facilitate the development of performant, memory-safe, and easy-to-use algorithm libraries. We validated the enhanced infrastructure via benchmarks and confirmed that Flink ML can meet or exceed the performance of selected algorithms from alternative popular ML libraries [...] - <dt> <a href="/news/2022/07/06/release-1.15.1.html">Apache Flink 1.15.1 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce a bug fix release for Flink 1.15.</dd> <dt> <a href="/news/2022/06/22/release-1.14.5.html">Apache Flink 1.14.5 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce another bug fix release for Flink 1.14.</dd> + + <dt> <a href="/2022/06/17/adaptive-batch-scheduler.html">Adaptive Batch Scheduler: Automatically Decide Parallelism of Flink Batch Jobs</a></dt> + <dd>To automatically decide parallelism of Flink batch jobs, we introduced adaptive batch scheduler in Flink 1.15. In this post, we'll take a close look at the design & implementation details.</dd> </dl>
