This is an automated email from the ASF dual-hosted git repository. mbalassi pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git
commit 9290f9c3b78745e0d4d348ab774b6af282532042 Author: Marton Balassi <[email protected]> AuthorDate: Fri Jan 20 12:54:20 2023 +0100 Rebuild website --- content/blog/feed.xml | 201 +++++++------ content/blog/index.html | 43 ++- content/blog/page10/index.html | 43 ++- content/blog/page11/index.html | 36 ++- content/blog/page12/index.html | 36 ++- content/blog/page13/index.html | 42 +-- content/blog/page14/index.html | 46 +-- content/blog/page15/index.html | 42 ++- content/blog/page16/index.html | 40 ++- content/blog/page17/index.html | 40 ++- content/blog/page18/index.html | 40 ++- content/blog/page19/index.html | 40 ++- content/blog/page2/index.html | 41 ++- content/blog/page20/index.html | 40 ++- content/blog/page21/index.html | 25 ++ content/blog/page3/index.html | 39 ++- content/blog/page4/index.html | 38 ++- content/blog/page5/index.html | 47 +-- content/blog/page6/index.html | 49 +-- content/blog/page7/index.html | 42 ++- content/blog/page8/index.html | 40 ++- content/blog/page9/index.html | 45 +-- .../delegation_token_framework.svg | 23 ++ content/index.html | 11 +- .../2023/01/20/delegation-token-framework.html} | 334 +++++++-------------- content/zh/index.html | 11 +- 26 files changed, 786 insertions(+), 648 deletions(-) diff --git a/content/blog/feed.xml b/content/blog/feed.xml index 6cf80f447..d69118da8 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -6,6 +6,110 @@ <link>https://flink.apache.org/blog</link> <atom:link href="https://flink.apache.org/blog/feed.xml"; rel="self" type="application/rss+xml" /> +<item> +<title>Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</title> +<description><p>The Apache Flink Community is pleased to announce that the upcoming minor version of Flink (1.17) includes +the Delegation Token Framework proposed in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support">FLIP-272</a>. +This enables Flink to authenticate to external services at a central location (JobManager) and distribute authentication +tokens to the TaskManagers.</p> + +<h2 id="introduction">Introduction</h2> + +<p>Authentication in distributed systems is not an easy task. Previously all worker nodes (TaskManagers) reading from or +writing to an external system needed to authenticate on their own. In such a case several things can go wrong, including but not limited to:</p> + +<ul> + <li>Too many authentication requests (potentially resulting in rejected requests)</li> + <li>Large number of retries on authentication failures</li> + <li>Re-occurring propagation/update of temporary credentials in a timely manner</li> + <li>Dependency issues when external system libraries are having the same dependency with different versions</li> + <li>Each authentication/temporary credentials are different making standardization challenging</li> + <li>…</li> +</ul> + +<p>The aim of Delegation Token Framework is to solve the above challenges. The framework is authentication protocol agnostic and pluggable. +The primary design concept is that authentication happens only at a single location (JobManager), the obtained temporary +credentials propagated automatically to all the task managers where they can be used. The token re-obtain process is also handled +in the JobManager.</p> + +<p align="center"> +<img src="/img/blog/2023-01-20-delegation-token-framework/delegation_token_framework.svg" width="70%" height="70%" /> +</p> + +<p>New authentication providers can be added with small amount of code which is going to be loaded by Flink automatically. +At the moment the following external systems are supported:</p> + +<ul> + <li>Hadoop filesystems</li> + <li>HBase</li> + <li>S3</li> +</ul> + +<p>Planned, but not yet implemented/contributed:</p> + +<ul> + <li>Kafka</li> + <li>Hive</li> +</ul> + +<p>The design and implementation approach has already been proven in <a href="https://spark.apache.org/docs/latest/security.html#kerberos">Apache Spark</a>. +Gabor is a Spark committer, he championed this feature in the Spark community. The most notable improvement we achieved compared to the +current state in Spark is that the framework in Flink is already authentication protocol agnostic (and not bound to Kerberos).</p> + +<h2 id="documentation">Documentation</h2> + +<p>For more details please refer to the following documentation:</p> + +<ul> + <li><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/security/security-delegation-token/">Delegation Tokens In General</a></li> + <li><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/security/security-kerberos/#using-delegation-tokens">How to use Kerberos delegation tokens</a></li> +</ul> + +<h2 id="development-details">Development details</h2> + +<p>Major tickets where the framework has been added:</p> + +<ul> + <li><a href="https://issues.apache.org/jira/browse/FLINK-21232">FLINK-21232</a> Kerberos delegation token framework</li> + <li><a href="https://issues.apache.org/jira/browse/FLINK-29918">FLINK-29918</a> Generalized delegation token support</li> + <li><a href="https://issues.apache.org/jira/browse/FLINK-30704">FLINK-30704</a> Add S3 delegation token support</li> +</ul> + +<h2 id="example-implementation">Example implementation</h2> + +<p>Adding a new authentication protocol is relatively straight-forward:</p> + +<ul> + <li>Check out the <a href="https://github.com/gaborgsomogyi/flink-test-java-delegation-token-provider">example implementation</a></li> + <li>Change <code>FlinkTestJavaDelegationTokenProvider.obtainDelegationTokens</code> to obtain a custom token from any external service</li> + <li>Change <code>FlinkTestJavaDelegationTokenReceiver.onNewTokensObtained</code> to receive the previously obtained tokens on all task managers</li> + <li>Use the tokens for external service authentication</li> + <li>Compile the project and put it into the classpath (adding it inside a plugin also supported)</li> + <li>Enjoy that Flink does all the heavy lifting behind the scenes :-)</li> +</ul> + +<h2 id="example-implementation-testing">Example implementation testing</h2> + +<p>The existing providers are tested with the <a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/">Flink Kubernetes Operator</a> +but one can use any other supported deployment model, because the framework is not bound to any of them. +We choose the Kubernetes Operator so that we could provide a completely containerized and easily reproducible test environment.</p> + +<p>An example tutorial can be found <a href="https://gist.github.com/gaborgsomogyi/ac4f71ead8494da2f5c35265bcb1e885">here</a> on +external system authentication.</p> + +<h2 id="summary">Summary</h2> + +<p>The Delegation Token Framework is feature complete on the master branch and is becoming generally available on the release of +Flink 1.17. The framework obtains authentication tokens at a central location and propagates them to all workers on a re-occurring basis.</p> + +<p>Any connector to an external system which supports authentication can be a potential user of this framework. +To support authentication in your connector we encourage you to implement your own <code>DelegationTokenProvider/DelegationTokenReceiver</code> pair.</p> +</description> +<pubDate>Fri, 20 Jan 2023 09:00:00 +0100</pubDate> +<link>https://flink.apache.org/news/2023/01/20/delegation-token-framework.html</link> +<guid isPermaLink="true">/news/2023/01/20/delegation-token-framework.html</guid> +</item> + <item> <title>Apache Flink Table Store 0.3.0 Release Announcement</title> <description><p>The Apache Flink community is pleased to announce the release of the @@ -19525,102 +19629,5 @@ FLINK-16683 Flink no longer supports starting clusters with .bat scripts. Users <guid isPermaLink="true">/news/2020/04/24/release-1.9.3.html</guid> </item> -<item> -<title>Memory Management Improvements with Apache Flink 1.10</title> -<description><p>Apache Flink 1.10 comes with significant changes to the memory model of the Task Managers and configuration options for your Flink applications. These recently-introduced changes make Flink more adaptable to all kinds of deployment environments (e.g. Kubernetes, Yarn, Mesos), providing strict control over its memory consumption. In this post, we describe Flink’s memory model, as it stands in Flink 1.10, how to set up and manage memory consumption of your Flink appli [...] - -<h2 id="introduction-to-flinks-memory-model">Introduction to Flink’s memory model</h2> - -<p>Having a clear understanding of Apache Flink’s memory model allows you to manage resources for the various workloads more efficiently. The following diagram illustrates the main memory components in Flink:</p> - -<center> -<img src="/img/blog/2020-04-21-memory-management-improvements-flink-1.10/total-process-memory.svg" width="400px" alt="Flink: Total Process Memory" /> -<br /> -<i><small>Flink: Total Process Memory</small></i> -</center> -<p><br /></p> - -<p>The Task Manager process is a JVM process. On a high level, its memory consists of the <em>JVM Heap</em> and <em>Off-Heap</em> memory. These types of memory are consumed by Flink directly or by JVM for its specific purposes (i.e. metaspace etc.). There are two major memory consumers within Flink: the user code of job operator tasks and the framework itself consuming memory for internal data structures, network buffers, etc.</p> - -<p><strong>Please note that</strong> the user code has direct access to all memory types: <em>JVM Heap, Direct</em> and <em>Native memory</em>. Therefore, Flink cannot really control its allocation and usage. There are however two types of Off-Heap memory which are consumed by tasks and controlled explicitly by Flink:</p> - -<ul> - <li><em>Managed Memory</em> (Off-Heap)</li> - <li><em>Network Buffers</em></li> -</ul> - -<p>The latter is part of the <em>JVM Direct Memory</em>, allocated for user record data exchange between operator tasks.</p> - -<h2 id="how-to-set-up-flink-memory">How to set up Flink memory</h2> - -<p>With the latest release of Flink 1.10 and in order to provide better user experience, the framework comes with both high-level and fine-grained tuning of memory components. There are essentially three alternatives to setting up memory in Task Managers.</p> - -<p>The first two — and simplest — alternatives are configuring one of the two following options for total memory available for the JVM process of the Task Manager:</p> - -<ul> - <li><em>Total Process Memory</em>: total memory consumed by the Flink Java application (including user code) and by the JVM to run the whole process.</li> - <li><em>Total Flink Memory</em>: only memory consumed by the Flink Java application, including user code but excluding memory allocated by JVM to run it</li> -</ul> - -<p>It is advisable to configure the <em>Total Flink Memory</em> for standalone deployments where explicitly declaring how much memory is given to Flink is a common practice, while the outer <em>JVM overhead</em> is of little interest. For the cases of deploying Flink in containerized environments (such as <a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/deployment/kubernetes.html">Kubernetes</a>, <a href=" [...] - -<p>If you want more fine-grained control over the size of <em>JVM Heap</em> and <em>Managed Memory</em> (Off-Heap), there is also a second alternative to configure both <em><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_setup.html#task-operator-heap-memory">Task Heap</a></em> and <em><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_setup.html [...] - -<p>In line with the community’s efforts to <a href="https://flink.apache.org/news/2019/02/13/unified-batch-streaming-blink.html">unify batch and stream processing</a>, this model works universally for both scenarios. It allows sharing the <em>JVM Heap</em> memory between the user code of operator tasks in any workload and the heap state backend in stream processing scenarios. In a similar way, the <em>Managed Memory</em> can be used for [...] - -<p>The remaining memory components are automatically adjusted either based on their default values or additionally configured parameters. Flink also checks the overall consistency. You can find more information about the different memory components in the corresponding <a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_detail.html">documentation</a>. Additionally, you can try different configuration options with the <a href=& [...] - -<p>If you are migrating from a Flink version older than 1.10, we suggest following the steps in the <a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_migration.html">migration guide</a> of the Flink documentation.</p> - -<h2 id="other-components">Other components</h2> - -<p>While configuring Flink’s memory, the size of different memory components can either be fixed with the value of the respective option or tuned using multiple options. Below we provide some more insight about the memory setup.</p> - -<h3 id="fractions-of-the-total-flink-memory">Fractions of the Total Flink Memory</h3> - -<p>This method allows a proportional breakdown of the <em>Total Flink Memory</em> where the <a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_setup.html#managed-memory">Managed Memory</a> (if not set explicitly) and <a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_detail.html#capped-fractionated-components">Network Buffers</a> can take certain fractions of it. [...] - -<center> -<img src="/img/blog/2020-04-21-memory-management-improvements-flink-1.10/flink-memory-setup.svg" width="800px" alt="Flink: Example of Memory Setup" /> -<br /> -<i><small>Flink: Example of Memory Setup</small></i> -</center> -<p><br /></p> - -<p><strong>Please note that</strong></p> - -<ul> - <li>Flink will verify that the size of the derived <em>Network Memory</em> is between its minimum and maximum value, otherwise Flink’s startup will fail. The maximum and minimum limits have default values which can be overwritten by the respective configuration options.</li> - <li>In general, the configured fractions are treated by Flink as hints. Under certain scenarios, the derived value might not match the fraction. For example, if the <em>Total Flink Memory</em> and the <em>Task Heap</em> are configured to fixed values, the <em>Managed Memory</em> will get a certain fraction and the <em>Network Memory</em> will get the remaining memory which might not exactly match its fraction.</li> -</ul> - -<h3 id="more-hints-to-control-the-container-memory-limit">More hints to control the container memory limit</h3> - -<p>The heap and direct memory usage are managed by the JVM. There are also many other possible sources of native memory consumption in Apache Flink or its user applications which are not managed by Flink or the JVM. Controlling their limits is often difficult which complicates debugging of potential memory leaks. If Flink’s process allocates too much memory in an unmanaged way, it can often result in killing Task Manager containers in containerized environments. In this case, it ma [...] - -<ul> - <li> - <p><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_tuning.html#rocksdb-state-backend">RocksDB state cannot grow too big</a>. The memory consumption of RocksDB state backend is accounted for in the <em>Managed Memory</em>. RocksDB respects its limit by default (only since Flink 1.10). You can increase the <em>Managed Memory</em> size to improve RocksDB’s performance or decrease it to save resources. [...] - </li> - <li> - <p><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_setup.html#configure-off-heap-memory-direct-or-native">User code or its dependencies consume significant off-heap memory</a>. Tuning the <em>Task Off-Heap</em> option can assign additional direct or native memory to the user code or any of its dependencies. Flink cannot control native allocations but it sets the limit for <em>JVM Direct</em> memory [...] - </li> - <li> - <p><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_detail.html#jvm-parameters">JVM metaspace requires additional memory</a>. If you encounter <code>OutOfMemoryError: Metaspace</code>, Flink provides an option to increase its limit and the JVM will ensure that it is not exceeded.</p> - </li> - <li> - <p><a href="https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/memory/mem_detail.html#capped-fractionated-components">JVM requires more internal memory</a>. There is no direct control over certain types of JVM process allocations but Flink provides <em>JVM Overhead</em> options. The options allow declaring an additional amount of memory, anticipated for those allocations and not covered by other options.</p> - </li> -</ul> - -<h2 id="conclusion">Conclusion</h2> - -<p>The latest Flink release (Flink 1.10) introduces some significant changes to Flink’s memory configuration, making it possible to manage your application memory and debug Flink significantly better than before. Future developments in this area also include adopting a similar memory model for the job manager process in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP+116%3A+Unified+Memory+Configuration+for+Job+Managers">FLIP-116</a>, so stay tu [...] -</description> -<pubDate>Tue, 21 Apr 2020 14:00:00 +0200</pubDate> -<link>https://flink.apache.org/news/2020/04/21/memory-management-improvements-flink-1.10.html</link> -<guid isPermaLink="true">/news/2020/04/21/memory-management-improvements-flink-1.10.html</guid> -</item> - </channel> </rss> diff --git a/content/blog/index.html b/content/blog/index.html index 29c8832ff..4c34dd2ba 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -240,6 +240,24 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></h2> + + <p>20 Jan 2023 + Gabor Somogyi & Marton Balassi (<a href="https://twitter.com/MartonBalassi";>@MartonBalassi</a>)</p> + + <p><p>The Apache Flink Community is pleased to announce that the upcoming minor version of Flink (1.17) includes +the Delegation Token Framework proposed in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support";>FLIP-272</a>. +This enables Flink to authenticate to external services at a central location (JobManager) and distribute authentication +tokens to the TaskManagers.</p> + +</p> + + <p><a href="/news/2023/01/20/delegation-token-framework.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></h2> @@ -367,21 +385,6 @@ with 19 FLIPs and 1100+ issues completed, bringing a lot of exciting features to <hr> - <article> - <h2 class="blog-title"><a href="/news/2022/09/08/akka-license-change.html">Regarding Akka's licensing change</a></h2> - - <p>08 Sep 2022 - Chesnay Schepler </p> - - <p><p>On September 7th Lightbend announced a <a href="https://www.lightbend.com/blog/why-we-are-changing-the-license-for-akka";>license change</a> for the Akka project, the TL;DR being that you will need a commercial license to use future versions of Akka (2.7+) in production if you exceed a certain revenue threshold.</p> - -</p> - - <p><a href="/news/2022/09/08/akka-license-change.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -414,6 +417,16 @@ with 19 FLIPs and 1100+ issues completed, bringing a lot of exciting features to <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page10/index.html b/content/blog/page10/index.html index 9e5d68e3b..1f1eb58d0 100644 --- a/content/blog/page10/index.html +++ b/content/blog/page10/index.html @@ -240,6 +240,26 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2020/07/14/application-mode.html">Application Deployment in Flink: Current State and the new Application Mode</a></h2> + + <p>14 Jul 2020 + Kostas Kloudas (<a href="https://twitter.com/kkloudas";>@kkloudas</a>)</p> + + <p><p>With the rise of stream processing and real-time analytics as a critical tool for modern +businesses, an increasing number of organizations build platforms with Apache Flink at their +core and offer it internally as a service. Many talks with related topics from companies +like <a href="https://www.youtube.com/watch?v=VX3S9POGAdU";>Uber</a>, <a href="https://www.youtube.com/watch?v=VX3S9POGAdU";>Netflix</a> +and <a href="https://www.youtube.com/watch?v=cH9UdK0yYjc";>Alibaba</a> in the latest editions of Flink Forward further +illustrate this trend.</p> + +</p> + + <p><a href="/news/2020/07/14/application-mode.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2020/07/06/release-1.11.0.html">Apache Flink 1.11.0 Release Announcement</a></h2> @@ -370,19 +390,6 @@ and provide a tutorial for running Streaming ETL with Flink on Zeppelin.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2020/04/21/memory-management-improvements-flink-1.10.html">Memory Management Improvements with Apache Flink 1.10</a></h2> - - <p>21 Apr 2020 - Andrey Zagrebin </p> - - <p>This post discusses the recent changes to the memory model of the Task Managers and configuration options for your Flink applications in Flink 1.10.</p> - - <p><a href="/news/2020/04/21/memory-management-improvements-flink-1.10.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -415,6 +422,16 @@ and provide a tutorial for running Streaming ETL with Flink on Zeppelin.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page11/index.html b/content/blog/page11/index.html index 7a7a79874..957066a9c 100644 --- a/content/blog/page11/index.html +++ b/content/blog/page11/index.html @@ -240,6 +240,19 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2020/04/21/memory-management-improvements-flink-1.10.html">Memory Management Improvements with Apache Flink 1.10</a></h2> + + <p>21 Apr 2020 + Andrey Zagrebin </p> + + <p>This post discusses the recent changes to the memory model of the Task Managers and configuration options for your Flink applications in Flink 1.10.</p> + + <p><a href="/news/2020/04/21/memory-management-improvements-flink-1.10.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2020/04/15/flink-serialization-tuning-vol-1.html">Flink Serialization Tuning Vol. 1: Choosing your Serializer — if you can</a></h2> @@ -364,19 +377,6 @@ This release marks a big milestone: Stateful Functions 2.0 is not only an API up <hr> - <article> - <h2 class="blog-title"><a href="/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">A Guide for Unit Testing in Apache Flink</a></h2> - - <p>07 Feb 2020 - Kartik Khare (<a href="https://twitter.com/khare_khote";>@khare_khote</a>)</p> - - <p>This post provides a detailed guide for unit testing of Apache Flink applications.</p> - - <p><a href="/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -409,6 +409,16 @@ This release marks a big milestone: Stateful Functions 2.0 is not only an API up <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page12/index.html b/content/blog/page12/index.html index 9281becd1..30ab85181 100644 --- a/content/blog/page12/index.html +++ b/content/blog/page12/index.html @@ -240,6 +240,19 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">A Guide for Unit Testing in Apache Flink</a></h2> + + <p>07 Feb 2020 + Kartik Khare (<a href="https://twitter.com/khare_khote";>@khare_khote</a>)</p> + + <p>This post provides a detailed guide for unit testing of Apache Flink applications.</p> + + <p><a href="/news/2020/02/07/a-guide-for-unit-testing-in-apache-flink.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2020/01/30/release-1.9.2.html">Apache Flink 1.9.2 Released</a></h2> @@ -365,19 +378,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2019/09/10/community-update.html">Flink Community Update - September'19</a></h2> - - <p>10 Sep 2019 - Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> - - <p>This has been an exciting, fast-paced year for the Apache Flink community. But with over 10k messages across the mailing lists, 3k Jira tickets and 2k pull requests, it is not easy to keep up with the latest state of the project. Plus everything happening around it. With that in mind, we want to bring back regular community updates to the Flink blog.</p> - - <p><a href="/news/2019/09/10/community-update.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -410,6 +410,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page13/index.html b/content/blog/page13/index.html index ffcf0db72..3323faa2a 100644 --- a/content/blog/page13/index.html +++ b/content/blog/page13/index.html @@ -240,6 +240,19 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2019/09/10/community-update.html">Flink Community Update - September'19</a></h2> + + <p>10 Sep 2019 + Marta Paes (<a href="https://twitter.com/morsapaes";>@morsapaes</a>)</p> + + <p>This has been an exciting, fast-paced year for the Apache Flink community. But with over 10k messages across the mailing lists, 3k Jira tickets and 2k pull requests, it is not easy to keep up with the latest state of the project. Plus everything happening around it. With that in mind, we want to bring back regular community updates to the Flink blog.</p> + + <p><a href="/news/2019/09/10/community-update.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2019/08/22/release-1.9.0.html">Apache Flink 1.9.0 Release Announcement</a></h2> @@ -364,25 +377,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2019/04/09/release-1.8.0.html">Apache Flink 1.8.0 Release Announcement</a></h2> - - <p>09 Apr 2019 - Aljoscha Krettek (<a href="https://twitter.com/aljoscha";>@aljoscha</a>)</p> - - <p><p>The Apache Flink community is pleased to announce Apache Flink 1.8.0. The -latest release includes more than 420 resolved issues and some exciting -additions to Flink that we describe in the following sections of this post. -Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12344274";>complete changelog</a> -for more details.</p> - -</p> - - <p><a href="/news/2019/04/09/release-1.8.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -415,6 +409,16 @@ for more details.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page14/index.html b/content/blog/page14/index.html index e20f1c4a2..2e7dbe303 100644 --- a/content/blog/page14/index.html +++ b/content/blog/page14/index.html @@ -240,6 +240,25 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2019/04/09/release-1.8.0.html">Apache Flink 1.8.0 Release Announcement</a></h2> + + <p>09 Apr 2019 + Aljoscha Krettek (<a href="https://twitter.com/aljoscha";>@aljoscha</a>)</p> + + <p><p>The Apache Flink community is pleased to announce Apache Flink 1.8.0. The +latest release includes more than 420 resolved issues and some exciting +additions to Flink that we describe in the following sections of this post. +Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12344274";>complete changelog</a> +for more details.</p> + +</p> + + <p><a href="/news/2019/04/09/release-1.8.0.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/features/2019/03/11/prometheus-monitoring.html">Flink and Prometheus: Cloud-native monitoring of streaming applications</a></h2> @@ -367,23 +386,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2018/11/30/release-1.7.0.html">Apache Flink 1.7.0 Release Announcement</a></h2> - - <p>30 Nov 2018 - Till Rohrmann (<a href="https://twitter.com/stsffap";>@stsffap</a>)</p> - - <p><p>The Apache Flink community is pleased to announce Apache Flink 1.7.0. -The latest release includes more than 420 resolved issues and some exciting additions to Flink that we describe in the following sections of this post. -Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12343585";>complete changelog</a> for more details.</p> - -</p> - - <p><a href="/news/2018/11/30/release-1.7.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -416,6 +418,16 @@ Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page15/index.html b/content/blog/page15/index.html index af116107a..6ca6a6372 100644 --- a/content/blog/page15/index.html +++ b/content/blog/page15/index.html @@ -240,6 +240,23 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2018/11/30/release-1.7.0.html">Apache Flink 1.7.0 Release Announcement</a></h2> + + <p>30 Nov 2018 + Till Rohrmann (<a href="https://twitter.com/stsffap";>@stsffap</a>)</p> + + <p><p>The Apache Flink community is pleased to announce Apache Flink 1.7.0. +The latest release includes more than 420 resolved issues and some exciting additions to Flink that we describe in the following sections of this post. +Please check the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12343585";>complete changelog</a> for more details.</p> + +</p> + + <p><a href="/news/2018/11/30/release-1.7.0.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2018/10/29/release-1.6.2.html">Apache Flink 1.6.2 Released</a></h2> @@ -375,21 +392,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2018/03/15/release-1.3.3.html">Apache Flink 1.3.3 Released</a></h2> - - <p>15 Mar 2018 - </p> - - <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.3 series.</p> - -</p> - - <p><a href="/news/2018/03/15/release-1.3.3.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -422,6 +424,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page16/index.html b/content/blog/page16/index.html index 66fb5c6b7..cb3071d90 100644 --- a/content/blog/page16/index.html +++ b/content/blog/page16/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2018/03/15/release-1.3.3.html">Apache Flink 1.3.3 Released</a></h2> + + <p>15 Mar 2018 + </p> + + <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.3 series.</p> + +</p> + + <p><a href="/news/2018/03/15/release-1.3.3.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2018/03/08/release-1.4.2.html">Apache Flink 1.4.2 Released</a></h2> @@ -372,21 +387,6 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community <hr> - <article> - <h2 class="blog-title"><a href="/news/2017/06/23/release-1.3.1.html">Apache Flink 1.3.1 Released</a></h2> - - <p>23 Jun 2017 - </p> - - <p><p>The Apache Flink community released the first bugfix version of the Apache Flink 1.3 series.</p> - -</p> - - <p><a href="/news/2017/06/23/release-1.3.1.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -419,6 +419,16 @@ what’s coming in Flink 1.4.0 as well as a preview of what the Flink community <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page17/index.html b/content/blog/page17/index.html index 6606e25e4..13f97a93f 100644 --- a/content/blog/page17/index.html +++ b/content/blog/page17/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2017/06/23/release-1.3.1.html">Apache Flink 1.3.1 Released</a></h2> + + <p>23 Jun 2017 + </p> + + <p><p>The Apache Flink community released the first bugfix version of the Apache Flink 1.3 series.</p> + +</p> + + <p><a href="/news/2017/06/23/release-1.3.1.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2017/06/01/release-1.3.0.html">Apache Flink 1.3.0 Release Announcement</a></h2> @@ -368,21 +383,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2016/10/12/release-1.1.3.html">Apache Flink 1.1.3 Released</a></h2> - - <p>12 Oct 2016 - </p> - - <p><p>The Apache Flink community released the next bugfix version of the Apache Flink 1.1. series.</p> - -</p> - - <p><a href="/news/2016/10/12/release-1.1.3.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -415,6 +415,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page18/index.html b/content/blog/page18/index.html index 3ce1ae7c9..aa39a388c 100644 --- a/content/blog/page18/index.html +++ b/content/blog/page18/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2016/10/12/release-1.1.3.html">Apache Flink 1.1.3 Released</a></h2> + + <p>12 Oct 2016 + </p> + + <p><p>The Apache Flink community released the next bugfix version of the Apache Flink 1.1. series.</p> + +</p> + + <p><a href="/news/2016/10/12/release-1.1.3.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2016/09/05/release-1.1.2.html">Apache Flink 1.1.2 Released</a></h2> @@ -372,21 +387,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2016/04/06/release-1.0.1.html">Flink 1.0.1 Released</a></h2> - - <p>06 Apr 2016 - </p> - - <p><p>Today, the Flink community released Flink version <strong>1.0.1</strong>, the first bugfix release of the 1.0 series.</p> - -</p> - - <p><a href="/news/2016/04/06/release-1.0.1.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -419,6 +419,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page19/index.html b/content/blog/page19/index.html index e9559bb3a..6ffd30d5f 100644 --- a/content/blog/page19/index.html +++ b/content/blog/page19/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2016/04/06/release-1.0.1.html">Flink 1.0.1 Released</a></h2> + + <p>06 Apr 2016 + </p> + + <p><p>Today, the Flink community released Flink version <strong>1.0.1</strong>, the first bugfix release of the 1.0 series.</p> + +</p> + + <p><a href="/news/2016/04/06/release-1.0.1.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2016/03/08/release-1.0.0.html">Announcing Apache Flink 1.0.0</a></h2> @@ -373,21 +388,6 @@ Apache Flink started.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2015/09/01/release-0.9.1.html">Apache Flink 0.9.1 available</a></h2> - - <p>01 Sep 2015 - </p> - - <p><p>The Flink community is happy to announce that Flink 0.9.1 is now available.</p> - -</p> - - <p><a href="/news/2015/09/01/release-0.9.1.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -420,6 +420,16 @@ Apache Flink started.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page2/index.html b/content/blog/page2/index.html index cb2a109ab..fe987d8f2 100644 --- a/content/blog/page2/index.html +++ b/content/blog/page2/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2022/09/08/akka-license-change.html">Regarding Akka's licensing change</a></h2> + + <p>08 Sep 2022 + Chesnay Schepler </p> + + <p><p>On September 7th Lightbend announced a <a href="https://www.lightbend.com/blog/why-we-are-changing-the-license-for-akka";>license change</a> for the Akka project, the TL;DR being that you will need a commercial license to use future versions of Akka (2.7+) in production if you exceed a certain revenue threshold.</p> + +</p> + + <p><a href="/news/2022/09/08/akka-license-change.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2022/08/29/release-table-store-0.2.0.html">Apache Flink Table Store 0.2.0 Release Announcement</a></h2> @@ -359,22 +374,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2022/06/05/release-kubernetes-operator-1.0.0.html">Apache Flink Kubernetes Operator 1.0.0 Release Announcement</a></h2> - - <p>05 Jun 2022 - Gyula Fora (<a href="https://twitter.com/GyulaFora";>@GyulaFora</a>) & Yang Wang </p> - - <p><p>In the last two months since our <a href="https://flink.apache.org/news/2022/04/03/release-kubernetes-operator-0.1.0.html";>initial preview release</a> the community has been hard at work to stabilize and improve the core Flink Kubernetes Operator logic. -We are now proud to announce the first production ready release of the operator project.</p> - -</p> - - <p><a href="/news/2022/06/05/release-kubernetes-operator-1.0.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -407,6 +406,16 @@ We are now proud to announce the first production ready release of the operator <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page20/index.html b/content/blog/page20/index.html index 6a18b4757..7de72ba95 100644 --- a/content/blog/page20/index.html +++ b/content/blog/page20/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2015/09/01/release-0.9.1.html">Apache Flink 0.9.1 available</a></h2> + + <p>01 Sep 2015 + </p> + + <p><p>The Flink community is happy to announce that Flink 0.9.1 is now available.</p> + +</p> + + <p><a href="/news/2015/09/01/release-0.9.1.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2015/08/24/introducing-flink-gelly.html">Introducing Gelly: Graph Processing with Apache Flink</a></h2> @@ -385,21 +400,6 @@ and offers a new API including definition of flexible windows.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2015/02/04/january-in-flink.html">January 2015 in the Flink community</a></h2> - - <p>04 Feb 2015 - </p> - - <p><p>Happy 2015! Here is a (hopefully digestible) summary of what happened last month in the Flink community.</p> - -</p> - - <p><a href="/news/2015/02/04/january-in-flink.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -432,6 +432,16 @@ and offers a new API including definition of flexible windows.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page21/index.html b/content/blog/page21/index.html index 58c64ef6b..ef383b14c 100644 --- a/content/blog/page21/index.html +++ b/content/blog/page21/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2015/02/04/january-in-flink.html">January 2015 in the Flink community</a></h2> + + <p>04 Feb 2015 + </p> + + <p><p>Happy 2015! Here is a (hopefully digestible) summary of what happened last month in the Flink community.</p> + +</p> + + <p><a href="/news/2015/02/04/january-in-flink.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2015/01/21/release-0.8.html">Apache Flink 0.8.0 available</a></h2> @@ -380,6 +395,16 @@ academic and open source project that Flink originates from.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page3/index.html b/content/blog/page3/index.html index aee68634d..70a068bc9 100644 --- a/content/blog/page3/index.html +++ b/content/blog/page3/index.html @@ -240,6 +240,22 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2022/06/05/release-kubernetes-operator-1.0.0.html">Apache Flink Kubernetes Operator 1.0.0 Release Announcement</a></h2> + + <p>05 Jun 2022 + Gyula Fora (<a href="https://twitter.com/GyulaFora";>@GyulaFora</a>) & Yang Wang </p> + + <p><p>In the last two months since our <a href="https://flink.apache.org/news/2022/04/03/release-kubernetes-operator-0.1.0.html";>initial preview release</a> the community has been hard at work to stabilize and improve the core Flink Kubernetes Operator logic. +We are now proud to announce the first production ready release of the operator project.</p> + +</p> + + <p><a href="/news/2022/06/05/release-kubernetes-operator-1.0.0.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/2022/05/30/changelog-state-backend.html">Improving speed and stability of checkpointing with generic log-based incremental checkpoints</a></h2> @@ -368,19 +384,6 @@ exciting changes.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2022/03/11/release-1.14.4.html">Apache Flink 1.14.4 Release Announcement</a></h2> - - <p>11 Mar 2022 - Konstantin Knauf (<a href="https://twitter.com/snntrable";>@snntrable</a>)</p> - - <p>The Apache Flink Community is please to announce another bug fix release for Flink 1.14.</p> - - <p><a href="/news/2022/03/11/release-1.14.4.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -413,6 +416,16 @@ exciting changes.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page4/index.html b/content/blog/page4/index.html index aee05731a..ddfaa83c4 100644 --- a/content/blog/page4/index.html +++ b/content/blog/page4/index.html @@ -240,6 +240,19 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2022/03/11/release-1.14.4.html">Apache Flink 1.14.4 Release Announcement</a></h2> + + <p>11 Mar 2022 + Konstantin Knauf (<a href="https://twitter.com/snntrable";>@snntrable</a>)</p> + + <p>The Apache Flink Community is please to announce another bug fix release for Flink 1.14.</p> + + <p><a href="/news/2022/03/11/release-1.14.4.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/2022/02/22/scala-free.html">Scala Free in One Fifteen</a></h2> @@ -362,21 +375,6 @@ This new release brings various improvements to the StateFun runtime, a leaner w <hr> - <article> - <h2 class="blog-title"><a href="/news/2021/12/16/log4j-patch-releases.html">Apache Flink Log4j emergency releases</a></h2> - - <p>16 Dec 2021 - Chesnay Schepler </p> - - <p><p>The Apache Flink community has released emergency bugfix versions of Apache Flink for the 1.11, 1.12, 1.13 and 1.14 series.</p> - -</p> - - <p><a href="/news/2021/12/16/log4j-patch-releases.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -409,6 +407,16 @@ This new release brings various improvements to the StateFun runtime, a leaner w <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page5/index.html b/content/blog/page5/index.html index 6d26772fc..ea20a3447 100644 --- a/content/blog/page5/index.html +++ b/content/blog/page5/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2021/12/16/log4j-patch-releases.html">Apache Flink Log4j emergency releases</a></h2> + + <p>16 Dec 2021 + Chesnay Schepler </p> + + <p><p>The Apache Flink community has released emergency bugfix versions of Apache Flink for the 1.11, 1.12, 1.13 and 1.14 series.</p> + +</p> + + <p><a href="/news/2021/12/16/log4j-patch-releases.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/2021/12/10/log4j-cve.html">Advise on Apache Log4j Zero Day (CVE-2021-44228)</a></h2> @@ -366,28 +381,6 @@ This new release brings various improvements to the StateFun runtime, a leaner w <hr> - <article> - <h2 class="blog-title"><a href="/news/2021/08/31/release-1.14.0-rc0.html">Help us stabilize Apache Flink 1.14.0 RC0</a></h2> - - <p>31 Aug 2021 - Johannes Moser </p> - - <p><div class="note"> - <h5>Hint</h5> - <p> - Update 29th of September: Today - <a href="https://flink.apache.org/news/2021/09/29/release-1.14.0.html";>Apache Flink 1.14</a> - has been released. For sure we'd still like to hear your feedback. - </p> -</div> - -</p> - - <p><a href="/news/2021/08/31/release-1.14.0-rc0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -420,6 +413,16 @@ This new release brings various improvements to the StateFun runtime, a leaner w <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page6/index.html b/content/blog/page6/index.html index 67dfc4a77..fdd71ff27 100644 --- a/content/blog/page6/index.html +++ b/content/blog/page6/index.html @@ -240,6 +240,28 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2021/08/31/release-1.14.0-rc0.html">Help us stabilize Apache Flink 1.14.0 RC0</a></h2> + + <p>31 Aug 2021 + Johannes Moser </p> + + <p><div class="note"> + <h5>Hint</h5> + <p> + Update 29th of September: Today + <a href="https://flink.apache.org/news/2021/09/29/release-1.14.0.html";>Apache Flink 1.14</a> + has been released. For sure we'd still like to hear your feedback. + </p> +</div> + +</p> + + <p><a href="/news/2021/08/31/release-1.14.0-rc0.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2021/08/09/release-1.11.4.html">Apache Flink 1.11.4 Released</a></h2> @@ -369,23 +391,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2021/04/15/release-statefun-3.0.0.html">Stateful Functions 3.0.0: Remote Functions Front and Center</a></h2> - - <p>15 Apr 2021 - Igal Shilman (<a href="https://twitter.com/IgalShilman";>@IgalShilman</a>) & Tzu-Li (Gordon) Tai (<a href="https://twitter.com/tzulitai";>@tzulitai</a>)</p> - - <p><p>The Apache Flink community is happy to announce the release of Stateful Functions (StateFun) 3.0.0! -Stateful Functions is a cross-platform stack for building Stateful Serverless applications, making it radically simpler -to develop scalable, consistent, and elastic distributed applications.</p> - -</p> - - <p><a href="/news/2021/04/15/release-statefun-3.0.0.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -418,6 +423,16 @@ to develop scalable, consistent, and elastic distributed applications.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page7/index.html b/content/blog/page7/index.html index 3fc33143f..a2b27f96a 100644 --- a/content/blog/page7/index.html +++ b/content/blog/page7/index.html @@ -240,6 +240,23 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2021/04/15/release-statefun-3.0.0.html">Stateful Functions 3.0.0: Remote Functions Front and Center</a></h2> + + <p>15 Apr 2021 + Igal Shilman (<a href="https://twitter.com/IgalShilman";>@IgalShilman</a>) & Tzu-Li (Gordon) Tai (<a href="https://twitter.com/tzulitai";>@tzulitai</a>)</p> + + <p><p>The Apache Flink community is happy to announce the release of Stateful Functions (StateFun) 3.0.0! +Stateful Functions is a cross-platform stack for building Stateful Serverless applications, making it radically simpler +to develop scalable, consistent, and elastic distributed applications.</p> + +</p> + + <p><a href="/news/2021/04/15/release-statefun-3.0.0.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/2021/03/11/batch-execution-mode.html">A Rundown of Batch Execution Mode in the DataStream API</a></h2> @@ -365,21 +382,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2020/12/18/release-1.11.3.html">Apache Flink 1.11.3 Released</a></h2> - - <p>18 Dec 2020 - Xintong Song </p> - - <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.11 series.</p> - -</p> - - <p><a href="/news/2020/12/18/release-1.11.3.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -412,6 +414,16 @@ <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page8/index.html b/content/blog/page8/index.html index 5786b8004..e202f078e 100644 --- a/content/blog/page8/index.html +++ b/content/blog/page8/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2020/12/18/release-1.11.3.html">Apache Flink 1.11.3 Released</a></h2> + + <p>18 Dec 2020 + Xintong Song </p> + + <p><p>The Apache Flink community released the third bugfix version of the Apache Flink 1.11 series.</p> + +</p> + + <p><a href="/news/2020/12/18/release-1.11.3.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/2020/12/15/pipelined-region-sheduling.html">Improvements in task scheduling for batch workloads in Apache Flink 1.12</a></h2> @@ -367,21 +382,6 @@ as well as increased observability for operational purposes.</p> <hr> - <article> - <h2 class="blog-title"><a href="/news/2020/08/25/release-1.10.2.html">Apache Flink 1.10.2 Released</a></h2> - - <p>25 Aug 2020 - Zhu Zhu (<a href="https://twitter.com/zhuzhv";>@zhuzhv</a>)</p> - - <p><p>The Apache Flink community released the second bugfix version of the Apache Flink 1.10 series.</p> - -</p> - - <p><a href="/news/2020/08/25/release-1.10.2.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -414,6 +414,16 @@ as well as increased observability for operational purposes.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/blog/page9/index.html b/content/blog/page9/index.html index 998c359ff..d003b5c93 100644 --- a/content/blog/page9/index.html +++ b/content/blog/page9/index.html @@ -240,6 +240,21 @@ <div class="col-sm-8"> <!-- Blog posts --> + <article> + <h2 class="blog-title"><a href="/news/2020/08/25/release-1.10.2.html">Apache Flink 1.10.2 Released</a></h2> + + <p>25 Aug 2020 + Zhu Zhu (<a href="https://twitter.com/zhuzhv";>@zhuzhv</a>)</p> + + <p><p>The Apache Flink community released the second bugfix version of the Apache Flink 1.10 series.</p> + +</p> + + <p><a href="/news/2020/08/25/release-1.10.2.html">Continue reading »</a></p> + </article> + + <hr> + <article> <h2 class="blog-title"><a href="/news/2020/08/20/flink-docker.html">The State of Flink on Docker</a></h2> @@ -363,26 +378,6 @@ <hr> - <article> - <h2 class="blog-title"><a href="/news/2020/07/14/application-mode.html">Application Deployment in Flink: Current State and the new Application Mode</a></h2> - - <p>14 Jul 2020 - Kostas Kloudas (<a href="https://twitter.com/kkloudas";>@kkloudas</a>)</p> - - <p><p>With the rise of stream processing and real-time analytics as a critical tool for modern -businesses, an increasing number of organizations build platforms with Apache Flink at their -core and offer it internally as a service. Many talks with related topics from companies -like <a href="https://www.youtube.com/watch?v=VX3S9POGAdU";>Uber</a>, <a href="https://www.youtube.com/watch?v=VX3S9POGAdU";>Netflix</a> -and <a href="https://www.youtube.com/watch?v=cH9UdK0yYjc";>Alibaba</a> in the latest editions of Flink Forward further -illustrate this trend.</p> - -</p> - - <p><a href="/news/2020/07/14/application-mode.html">Continue reading »</a></p> - </article> - - <hr> - <!-- Pagination links --> @@ -415,6 +410,16 @@ illustrate this trend.</p> <ul id="markdown-toc"> + <li><a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></li> + + + + + + + + + <li><a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></li> diff --git a/content/img/blog/2023-01-20-delegation-token-framework/delegation_token_framework.svg b/content/img/blog/2023-01-20-delegation-token-framework/delegation_token_framework.svg new file mode 100644 index 000000000..82eda539f --- /dev/null +++ b/content/img/blog/2023-01-20-delegation-token-framework/delegation_token_framework.svg @@ -0,0 +1,23 @@ +<?xml version="1.0" encoding="UTF-8"?> +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +<!-- Do not edit this file with editors other than diagrams.net --> +<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd";> +<svg xmlns="http://www.w3.org/2000/svg"; xmlns:xlink="http://www.w3.org/1999/xlink"; version="1.1" width="851px" height="768px" viewBox="-0.5 -0.5 851 768" content="<mxfile host="app.diagrams.net" modified="2023-01-04T12:07:02.859Z" agent="5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" etag="yuoZn9JIeDNMMz-aMEgE" version="20.8.1" type="google"><diagram id=&qu [...] diff --git a/content/index.html b/content/index.html index 8aa539986..887592fbe 100644 --- a/content/index.html +++ b/content/index.html @@ -405,6 +405,14 @@ <dl> + <dt> <a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></dt> + <dd><p>The Apache Flink Community is pleased to announce that the upcoming minor version of Flink (1.17) includes +the Delegation Token Framework proposed in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support";>FLIP-272</a>. +This enables Flink to authenticate to external services at a central location (JobManager) and distribute authentication +tokens to the TaskManagers.</p> + +</dd> + <dt> <a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce the release for Flink Table Store 0.3.0!</dd> @@ -420,9 +428,6 @@ <dt> <a href="/2022/11/25/async-sink-rate-limiting-strategy.html">Optimising the throughput of async sinks using a custom RateLimitingStrategy</a></dt> <dd>An overview of how to optimise the throughput of async sinks using a custom RateLimitingStrategy</dd> - - <dt> <a href="/news/2022/11/10/release-1.15.3.html">Apache Flink 1.15.3 Release Announcement</a></dt> - <dd>The Apache Flink Community is pleased to announce a bug fix release for Flink 1.15.</dd> </dl> diff --git a/content/index.html b/content/news/2023/01/20/delegation-token-framework.html similarity index 61% copy from content/index.html copy to content/news/2023/01/20/delegation-token-framework.html index 8aa539986..af50b788d 100644 --- a/content/index.html +++ b/content/news/2023/01/20/delegation-token-framework.html @@ -5,7 +5,7 @@ <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags --> - <title>Apache Flink: Stateful Computations over Data Streams</title> + <title>Apache Flink: Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</title> <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> <link rel="icon" href="/favicon.ico" type="image/x-icon"> @@ -153,7 +153,7 @@ <li><a href="/gettinghelp.html">Getting Help</a></li> <!-- Blog --> - <li><a href="/blog/"><b>Flink Blog</b></a></li> + <li class="active"><a href="/blog/"><b>Flink Blog</b></a></li> <!-- Flink-packages --> @@ -185,7 +185,8 @@ <li> - <a href="/zh/">中文版</a> + <!-- link to the Chinese home page when current is blog page --> + <a href="/zh">中文版</a> </li> @@ -233,261 +234,130 @@ </div> <div class="col-sm-9"> <div class="row-fluid"> - <div class="col-sm-12"> - <p class="lead"> - <strong>Apache Flink<sup>®</sup> — Stateful Computations over Data Streams</strong> - </p> - </div> + <div class="row"> + <h1>Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</h1> + <p><i></i></p> -<div class="col-sm-12"> - <hr /> -</div> + <article> + <p>20 Jan 2023 Gabor Somogyi & Marton Balassi (<a href="https://twitter.com/MartonBalassi";>@MartonBalassi</a>)</p> -</div> +<p>The Apache Flink Community is pleased to announce that the upcoming minor version of Flink (1.17) includes +the Delegation Token Framework proposed in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support";>FLIP-272</a>. +This enables Flink to authenticate to external services at a central location (JobManager) and distribute authentication +tokens to the TaskManagers.</p> -<!-- High-level architecture figure --> +<h2 id="introduction">Introduction</h2> -<div class="row front-graphic"> - <hr /> - <img src="/img/flink-home-graphic.png" width="800px" /> -</div> +<p>Authentication in distributed systems is not an easy task. Previously all worker nodes (TaskManagers) reading from or +writing to an external system needed to authenticate on their own. In such a case several things can go wrong, including but not limited to:</p> -<!-- Feature grid --> +<ul> + <li>Too many authentication requests (potentially resulting in rejected requests)</li> + <li>Large number of retries on authentication failures</li> + <li>Re-occurring propagation/update of temporary credentials in a timely manner</li> + <li>Dependency issues when external system libraries are having the same dependency with different versions</li> + <li>Each authentication/temporary credentials are different making standardization challenging</li> + <li>…</li> +</ul> -<!-- -<div class="row"> - <div class="col-sm-12"> - <hr /> - <h2><a href="/features.html">Features</a></h2> - </div> -</div> ---> -<div class="row"> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-th"></span> <b>All streaming use cases</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Event-driven Applications</li> - <li>Stream & Batch Analytics</li> - <li>Data Pipelines & ETL</li> - </ul> - <a href="/usecases.html">Learn more</a> - </div> - </div> - </div> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-ok"></span> <b>Guaranteed correctness</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Exactly-once state consistency</li> - <li>Event-time processing</li> - <li>Sophisticated late data handling</li> - </ul> - <a href="/flink-applications.html#building-blocks-for-streaming-applications">Learn more</a> - </div> - </div> - </div> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon glyphicon-sort-by-attributes"></span> <b>Layered APIs</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>SQL on Stream & Batch Data</li> - <li>DataStream API & DataSet API</li> - <li>ProcessFunction (Time & State)</li> - </ul> - <a href="/flink-applications.html#layered-apis">Learn more</a> - </div> - </div> - </div> -</div> -<div class="row"> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-dashboard"></span> <b>Operational Focus</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Flexible deployment</li> - <li>High-availability setup</li> - <li>Savepoints</li> - </ul> - <a href="/flink-operations.html">Learn more</a> - </div> - </div> - </div> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-fullscreen"></span> <b>Scales to any use case</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Scale-out architecture</li> - <li>Support for very large state</li> - <li>Incremental checkpointing</li> - </ul> - <a href="/flink-architecture.html#run-applications-at-any-scale">Learn more</a> - </div> - </div> - </div> - <div class="col-sm-4"> - <div class="panel panel-default"> - <div class="panel-heading"> - <span class="glyphicon glyphicon-flash"></span> <b>Excellent Performance</b> - </div> - <div class="panel-body"> - <ul style="font-size: small;"> - <li>Low latency</li> - <li>High throughput</li> - <li>In-Memory computing</li> - </ul> - <a href="/flink-architecture.html#leverage-in-memory-performance">Learn more</a> - </div> - </div> - </div> -</div> +<p>The aim of Delegation Token Framework is to solve the above challenges. The framework is authentication protocol agnostic and pluggable. +The primary design concept is that authentication happens only at a single location (JobManager), the obtained temporary +credentials propagated automatically to all the task managers where they can be used. The token re-obtain process is also handled +in the JobManager.</p> -<!-- Events section --> -<div class="row"> +<p align="center"> +<img src="/img/blog/2023-01-20-delegation-token-framework/delegation_token_framework.svg" width="70%" height="70%" /> +</p> -<div class="col-sm-12"> - <hr /> -</div> +<p>New authentication providers can be added with small amount of code which is going to be loaded by Flink automatically. +At the moment the following external systems are supported:</p> -<div class="col-sm-3"> +<ul> + <li>Hadoop filesystems</li> + <li>HBase</li> + <li>S3</li> +</ul> - <h2><a>Upcoming Events</a></h2> +<p>Planned, but not yet implemented/contributed:</p> -</div> -<div class="col-sm-9"> - <!-- Flink Forward --> - <a href="https://flink-forward.org"; target="_blank"> - <img style="width: 180px; padding-right: 10px" src="/img/flink-forward.png" alt="Flink Forward" /> - </a> - <!-- ApacheCon --> - <a href="https://www.apache.org/events/current-event"; target="_blank"> - <img style="width: 200px; padding-right: 10px" src="https://www.apache.org/events/current-event-234x60.png"; alt="ApacheCon" /> - </a> - <!-- Flink Forward Asia --> - <a href="https://flink-forward.org.cn/"; target="_blank"> - <img style="width: 230px" src="/img/flink-forward-asia.png" alt="Flink Forward Asia" /> - </a> -</div> +<ul> + <li>Kafka</li> + <li>Hive</li> +</ul> -</div> +<p>The design and implementation approach has already been proven in <a href="https://spark.apache.org/docs/latest/security.html#kerberos";>Apache Spark</a>. +Gabor is a Spark committer, he championed this feature in the Spark community. The most notable improvement we achieved compared to the +current state in Spark is that the framework in Flink is already authentication protocol agnostic (and not bound to Kerberos).</p> -<!-- Updates section --> +<h2 id="documentation">Documentation</h2> -<div class="row"> +<p>For more details please refer to the following documentation:</p> -<div class="col-sm-12"> - <hr /> -</div> +<ul> + <li><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/security/security-delegation-token/";>Delegation Tokens In General</a></li> + <li><a href="https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/security/security-kerberos/#using-delegation-tokens";>How to use Kerberos delegation tokens</a></li> +</ul> -<div class="col-sm-3"> +<h2 id="development-details">Development details</h2> - <h2><a href="/blog">Latest Blog Posts</a></h2> +<p>Major tickets where the framework has been added:</p> -</div> +<ul> + <li><a href="https://issues.apache.org/jira/browse/FLINK-21232";>FLINK-21232</a> Kerberos delegation token framework</li> + <li><a href="https://issues.apache.org/jira/browse/FLINK-29918";>FLINK-29918</a> Generalized delegation token support</li> + <li><a href="https://issues.apache.org/jira/browse/FLINK-30704";>FLINK-30704</a> Add S3 delegation token support</li> +</ul> -<div class="col-sm-9"> +<h2 id="example-implementation">Example implementation</h2> - <dl> - - <dt> <a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></dt> - <dd>The Apache Flink Community is pleased to announce the release for Flink Table Store 0.3.0!</dd> - - <dt> <a href="/news/2023/01/10/release-kubernetes-operator-1.3.1.html">Apache Flink Kubernetes Operator 1.3.1 Release Announcement</a></dt> - <dd><p>The Apache Flink Community is pleased to announce the first bug fix release of the Flink Kubernetes Operator 1.3 series.</p> +<p>Adding a new authentication protocol is relatively straight-forward:</p> -</dd> - - <dt> <a href="/news/2022/12/14/release-kubernetes-operator-1.3.0.html">Apache Flink Kubernetes Operator 1.3.0 Release Announcement</a></dt> - <dd><p>The Flink community is happy to announce that the latest Flink Kubernetes Operator version went live today. Beyond the regular operator improvements and fixes the 1.3.0 version also integrates better with some popular infrastructure management tools like OLM and Argo CD. These improvements are clear indicators that the original intentions of the Flink community, namely to provide the de facto standard solution for managing Flink applications on Kubernetes is making steady [...] +<ul> + <li>Check out the <a href="https://github.com/gaborgsomogyi/flink-test-java-delegation-token-provider";>example implementation</a></li> + <li>Change <code>FlinkTestJavaDelegationTokenProvider.obtainDelegationTokens</code> to obtain a custom token from any external service</li> + <li>Change <code>FlinkTestJavaDelegationTokenReceiver.onNewTokensObtained</code> to receive the previously obtained tokens on all task managers</li> + <li>Use the tokens for external service authentication</li> + <li>Compile the project and put it into the classpath (adding it inside a plugin also supported)</li> + <li>Enjoy that Flink does all the heavy lifting behind the scenes :-)</li> +</ul> -</dd> - - <dt> <a href="/2022/11/25/async-sink-rate-limiting-strategy.html">Optimising the throughput of async sinks using a custom RateLimitingStrategy</a></dt> - <dd>An overview of how to optimise the throughput of async sinks using a custom RateLimitingStrategy</dd> - - <dt> <a href="/news/2022/11/10/release-1.15.3.html">Apache Flink 1.15.3 Release Announcement</a></dt> - <dd>The Apache Flink Community is pleased to announce a bug fix release for Flink 1.15.</dd> - - </dl> +<h2 id="example-implementation-testing">Example implementation testing</h2> -</div> +<p>The existing providers are tested with the <a href="https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/";>Flink Kubernetes Operator</a> +but one can use any other supported deployment model, because the framework is not bound to any of them. +We choose the Kubernetes Operator so that we could provide a completely containerized and easily reproducible test environment.</p> -<!-- Scripts section --> - -<script type="text/javascript" src="/js/jquery.jcarousel.min.js"></script> - -<script type="text/javascript"> - - $(window).load(function(){ - $(function() { - var jcarousel = $('.jcarousel'); - - jcarousel - .on('jcarousel:reload jcarousel:create', function () { - var carousel = $(this), - width = carousel.innerWidth(); - - if (width >= 600) { - width = width / 4; - } else if (width >= 350) { - width = width / 3; - } - - carousel.jcarousel('items').css('width', Math.ceil(width) + 'px'); - }) - .jcarousel({ - wrap: 'circular', - autostart: true - }); - - $('.jcarousel-control-prev') - .jcarouselControl({ - target: '-=1' - }); - - $('.jcarousel-control-next') - .jcarouselControl({ - target: '+=1' - }); - - $('.jcarousel-pagination') - .on('jcarouselpagination:active', 'a', function() { - $(this).addClass('active'); - }) - .on('jcarouselpagination:inactive', 'a', function() { - $(this).removeClass('active'); - }) - .on('click', function(e) { - e.preventDefault(); - }) - .jcarouselPagination({ - perPage: 1, - item: function(page) { - return '<a href="#' + page + '">' + page + '</a>'; - } - }); - }); - }); - -</script> -</div> +<p>An example tutorial can be found <a href="https://gist.github.com/gaborgsomogyi/ac4f71ead8494da2f5c35265bcb1e885";>here</a> on +external system authentication.</p> + +<h2 id="summary">Summary</h2> + +<p>The Delegation Token Framework is feature complete on the master branch and is becoming generally available on the release of +Flink 1.17. The framework obtains authentication tokens at a central location and propagates them to all workers on a re-occurring basis.</p> +<p>Any connector to an external system which supports authentication can be a potential user of this framework. +To support authentication in your connector we encourage you to implement your own <code>DelegationTokenProvider/DelegationTokenReceiver</code> pair.</p> + + </article> + </div> + + <div class="row"> + <div id="disqus_thread"></div> + <script type="text/javascript"> + /* * * CONFIGURATION VARIABLES: EDIT BEFORE PASTING INTO YOUR WEBPAGE * * */ + var disqus_shortname = 'stratosphere-eu'; // required: replace example with your forum shortname + + /* * * DON'T EDIT BELOW THIS LINE * * */ + (function() { + var dsq = document.createElement('script'); dsq.type = 'text/javascript'; dsq.async = true; + dsq.src = '//' + disqus_shortname + '.disqus.com/embed.js'; + (document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq); + })(); + </script> + </div> + </div> +</div> </div> </div> diff --git a/content/zh/index.html b/content/zh/index.html index 9ad6ec339..07648b578 100644 --- a/content/zh/index.html +++ b/content/zh/index.html @@ -402,6 +402,14 @@ <dl> + <dt> <a href="/news/2023/01/20/delegation-token-framework.html">Delegation Token Framework: Obtain, Distribute and Use Temporary Credentials Automatically</a></dt> + <dd><p>The Apache Flink Community is pleased to announce that the upcoming minor version of Flink (1.17) includes +the Delegation Token Framework proposed in <a href="https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support";>FLIP-272</a>. +This enables Flink to authenticate to external services at a central location (JobManager) and distribute authentication +tokens to the TaskManagers.</p> + +</dd> + <dt> <a href="/news/2023/01/13/release-table-store-0.3.0.html">Apache Flink Table Store 0.3.0 Release Announcement</a></dt> <dd>The Apache Flink Community is pleased to announce the release for Flink Table Store 0.3.0!</dd> @@ -417,9 +425,6 @@ <dt> <a href="/2022/11/25/async-sink-rate-limiting-strategy.html">Optimising the throughput of async sinks using a custom RateLimitingStrategy</a></dt> <dd>An overview of how to optimise the throughput of async sinks using a custom RateLimitingStrategy</dd> - - <dt> <a href="/news/2022/11/10/release-1.15.3.html">Apache Flink 1.15.3 Release Announcement</a></dt> - <dd>The Apache Flink Community is pleased to announce a bug fix release for Flink 1.15.</dd> </dl>
![https://www.apache.org/events/current-event-234x60.png"](https://www.apache.org/events/current-event-234x60.png"){kind=link}