This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/flink-web.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 9ea37c070 Add Table Store 0.1.0 release
9ea37c070 is described below
commit 9ea37c07096e17424af22d57f1152571ad1771c8
Author: Jingsong Lee <[email protected]>
AuthorDate: Wed May 11 13:17:52 2022 +0800
Add Table Store 0.1.0 release
This closes #531
---
_config.yml | 23 +++++
_posts/2022-05-11-release-table-store-0.1.0.md | 103 ++++++++++++++++++++++
downloads.md | 32 +++++++
img/blog/table-store/table-store-architecture.png | Bin 0 -> 145608 bytes
4 files changed, 158 insertions(+)
diff --git a/_config.yml b/_config.yml
index f0d16fe09..a58345448 100644
--- a/_config.yml
+++ b/_config.yml
@@ -213,6 +213,24 @@ flink_kubernetes_operator_releases:
asc_url:
"https://downloads.apache.org/flink/flink-kubernetes-operator-0.1.0/flink-kubernetes-operator-0.1.0-helm.tgz.asc";
sha512_url:
"https://downloads.apache.org/flink/flink-kubernetes-operator-0.1.0/flink-kubernetes-operator-0.1.0-helm.tgz.sha512";
+flink_table_store_releases:
+ -
+ version_short: "0.1"
+ source_release:
+ name: "Apache Flink Table Store 0.1.0"
+ id: "010-table-store-download-source"
+ flink_version: "1.15.0"
+ url:
"https://www.apache.org/dyn/closer.lua/flink/flink-table-store-0.1.0/flink-table-store-0.1.0-src.tgz";
+ asc_url:
"https://downloads.apache.org/flink/flink-table-store-0.1.0/flink-table-store-0.1.0-src.tgz.asc";
+ sha512_url:
"https://downloads.apache.org/flink/flink-table-store-0.1.0/flink-table-store-0.1.0-src.tgz.sha512";
+ binaries_release:
+ name: "Apache Flink Table Store Binaries 0.1.0"
+ id: "010-table-store-download-binaries"
+ flink_version: "1.15.0"
+ url:
"https://repo.maven.apache.org/maven2/org/apache/flink/flink-table-store-dist/0.1.0/flink-table-store-dist-0.1.0.jar";
+ asc_url:
"https://repo.maven.apache.org/maven2/org/apache/flink/flink-table-store-dist/0.1.0/flink-table-store-dist-0.1.0.jar.asc";
+ sha1_url:
"https://repo.maven.apache.org/maven2/org/apache/flink/flink-table-store-dist/0.1.0/flink-table-store-dist-0.1.0.jar.sha1";
+
component_releases:
-
name: "Apache Flink-shaded 15.0 Source Release"
@@ -656,6 +674,11 @@ release_archive:
version_long: 0.1.0
release_date: 2022-04-02
+ flink_table_store:
+ - version_short: 0.1
+ version_long: 0.1.0
+ release_date: 2022-05-11
+
# Version numbers used in the text for stable and snapshot versions,
# e.g. "Documentation for {{ site.stable }".
stable: "1.15"
diff --git a/_posts/2022-05-11-release-table-store-0.1.0.md
b/_posts/2022-05-11-release-table-store-0.1.0.md
new file mode 100644
index 000000000..491ae4a0e
--- /dev/null
+++ b/_posts/2022-05-11-release-table-store-0.1.0.md
@@ -0,0 +1,103 @@
+---
+layout: post
+title: "Apache Flink Table Store 0.1.0 Release Announcement"
+subtitle: "For building dynamic tables for both stream and batch processing in
Flink, supporting high speed data ingestion and timely data query."
+date: 2022-05-11T08:00:00.000Z
+categories: news
+authors:
+- JingsongLi:
+ name: "Jingsong Lee"
+- becketqin:
+ name: "Jiangjie (Becket) Qin"
+---
+
+The Apache Flink community is pleased to announce the preview release of the
+[Apache Flink Table Store](https://github.com/apache/flink-table-store)
(0.1.0).
+
+Please check out the full
[documentation]({{site.DOCS_BASE_URL}}flink-table-store-docs-release-0.1/) for
detailed information and user guides.
+
+Note: Flink Table Store is still in beta status and undergoing rapid
development.
+We do not recommend that you use it directly in a production environment.
+
+## What is Flink Table Store
+
+In the past years, thanks to our numerous contributors and users, Apache Flink
has established
+itself as one of the best distributed computing engines, especially for
stateful stream processing
+at large scale. However, there are still a few challenges people are facing
when they try to obtain
+insights from their data in real-time. Among these challenges, one prominent
problem is lack of
+storage that caters to all the computing patterns.
+
+As of now it is quite common that people deploy a few storage systems to work
with Flink for different
+purposes. A typical setup is a message queue for stream processing, a
scannable file system / object store
+for batch processing and ad-hoc queries, and a K-V store for lookups. Such an
architecture posts challenge
+in data quality and system maintenance, due to its complexity and
heterogeneity. This is becoming a major
+issue that hurts the end-to-end user experience of streaming and batch
unification brought by Apache Flink.
+
+The goal of Flink table store is to address the above issues. This is an
important step of the project.
+It extends Flink's capability from computing to the storage domain. So we can
provide a better end-to-end
+experience to the users.
+
+Flink Table Store aims to provide a unified storage abstraction, so users
don't have to build the hybrid
+storage by themselves. More specifically, Table Store offers the following
core capabilities:
+
+* Support storage of large datasets and allows read / write in both batch and
streaming manner.
+* Support streaming queries with minimum latency down to milliseconds.
+* Support Batch/OLAP queries with minimum latency down to the second level.
+* Support incremental snapshots for stream consumption by default. So users
don't need to solve the
+ problem of combining different stores by themselves.
+
+<center>
+<img src="{{site.baseurl}}/img/blog/table-store/table-store-architecture.png"
width="100%"/>
+</center>
+
+In this preview version, as shown in the architecture above:
+
+* Users can use Flink to insert data into the Table Store, either by streaming
the change log
+ captured from databases, or by loading the data in batches from the other
stores like data warehouses.
+* Users can use Flink to query the table store in different ways, including
streaming queries and
+ Batch/OLAP queries. It is also worth noting that users can use other engines
such as Apache Hive to
+ query from the table store as well.
+* Under the hood, table Store uses a hybrid storage architecture, using a Lake
Store to store historical data
+ and a Queue system (Apache Kafka integration is currently supported) to
store incremental data. It provides
+ incremental snapshots for hybrid streaming reads.
+* Table Store's Lake Store stores data as columnar files on file system /
object store, and uses the LSM Structure
+ to support a large amount of data updates and high-performance queries.
+
+Many thanks for the inspiration of the following systems: [Apache
Iceberg](https://iceberg.apache.org/) and [RocksDB](http://rocksdb.org/).
+
+## Getting started
+
+Please refer to the [getting started
guide]({{site.DOCS_BASE_URL}}flink-table-store-docs-release-0.1/docs/try-table-store/quick-start/)
for more details.
+
+## What's Next?
+
+The community is currently working on hardening the core logic, stabilizing
the storage format and adding the remaining bits for making the Flink Table
Store production-ready.
+
+In the upcoming 0.2.0 release you can expect (at-least) the following
additional features:
+
+* Ecosystem: Support Flink Table Store Reader for Apache Hive Engine
+* Core: Support the adjustment of the number of Bucket
+* Core: Support for Append Only Data, Table Store is not just limited to
update scenarios
+* Core: Full Schema Evolution
+* Improvements based on feedback from the preview release
+
+In the medium term, you can also expect:
+
+* Ecosystem: Support Flink Table Store Reader for Trino, PrestoDB and Apache
Spark
+* Flink Table Store Service to accelerate updates and improve query performance
+
+Please give the preview release a try, share your feedback on the Flink
mailing list and contribute to the project!
+
+## Release Resources
+
+The source artifacts and binaries are now available on the updated
[Downloads](https://flink.apache.org/downloads.html)
+page of the Flink website.
+
+We encourage you to download the release and share your feedback with the
community through the [Flink mailing
lists](https://flink.apache.org/community.html#mailing-lists)
+or
[JIRA](https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20component%20%3D%20%22Table%20Store%22).
+
+## List of Contributors
+
+The Apache Flink community would like to thank every one of the contributors
that have made this release possible:
+
+Jane Chan, Jiangjie (Becket) Qin, Jingsong Lee, Leonard Xu, Nicholas Jiang,
Shen Zhu, tsreaper, Yubin Li
diff --git a/downloads.md b/downloads.md
index 18d539c31..574a29e4d 100644
--- a/downloads.md
+++ b/downloads.md
@@ -162,6 +162,27 @@ This version is compatible with Apache Flink version {{
flink_kubernetes_operato
{% endfor %}
+Apache Flink® Table Store {{ site.FLINK_TABLE_STORE_VERSION_STABLE }} is the
latest stable release for the [Flink Table
Store](https://github.com/apache/flink-table-store).
+
+{% for flink_table_store_release in site.flink_table_store_releases %}
+
+## {{ flink_table_store_release.source_release.name }}
+
+<p>
+<a href="{{ flink_table_store_release.source_release.url }}" id="{{
flink_table_store_release.source_release.id }}">{{
flink_table_store_release.source_release.name }} Source Release</a>
+(<a href="{{ flink_table_store_release.source_release.asc_url }}">asc</a>, <a
href="{{ flink_table_store_release.source_release.sha512_url }}">sha512</a>)
+</p>
+<p>
+<a href="{{ flink_table_store_release.binaries_release.url }}" id="{{
flink_table_store_release.binaries_release.id }}">{{
flink_table_store_release.binaries_release.name }} Binaries Release</a>
+(<a href="{{ flink_table_store_release.binaries_release.asc_url }}">asc</a>,
<a href="{{ flink_table_store_release.binaries_release.sha1_url }}">sha1</a>)
+</p>
+
+This version is compatible with Apache Flink version {{
flink_table_store_release.source_release.flink_version }}.
+
+---
+
+{% endfor %}
+
## Additional Components
These are components that the Flink project develops which are not part of the
@@ -340,3 +361,14 @@ Flink Kubernetes Operator {{
flink_kubernetes_operator_release.version_long }} -
</li>
{% endfor %}
</ul>
+
+### Flink-Table-Store
+{% assign flink_table_store_releases = site.release_archive.flink_table_store
%}
+<ul>
+{% for flink_table_store_release in flink_table_store_releases %}
+<li>
+Flink Table Store {{ flink_table_store_release.version_long }} - {{
flink_table_store_release.release_date }}
+(<a href="https://archive.apache.org/dist/flink/flink-table-store-{{
flink_table_store_release.version_long }}/flink-table-store-{{
flink_table_store_release.version_long }}-src.tgz">Source</a>, <a
href="https://repo.maven.apache.org/maven2/org/apache/flink/flink-table-store-dist/{{
flink_table_store_release.version_long }}/flink-table-store-dist-{{
flink_table_store_release.version_long }}.jar">Binaries</a>)
+</li>
+{% endfor %}
+</ul>
diff --git a/img/blog/table-store/table-store-architecture.png
b/img/blog/table-store/table-store-architecture.png
new file mode 100644
index 000000000..749af2190
Binary files /dev/null and b/img/blog/table-store/table-store-architecture.png
differ
