from:"rmetzger"

svn commit: r19845 - /release/flink/flink-1.3.0/

2017-05-31 Thread rmetzger

Author: rmetzger
Date: Wed May 31 12:30:20 2017
New Revision: 19845

Log:
[Flink] Add release 1.3.0

Added:
release/flink/flink-1.3.0/
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.11.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.11.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.11.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.11.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.10.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.10.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.10.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.10.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.11.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.11.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.11.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop24-scala_2.11.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.10.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.10.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.10.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.10.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.11.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.11.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.11.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop26-scala_2.11.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.10.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.10.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.10.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.10.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz   (with 
props)
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop27-scala_2.11.tgz.sha
release/flink/flink-1.3.0/flink-1.3.0-src.tgz   (with props)
release/flink/flink-1.3.0/flink-1.3.0-src.tgz.asc
release/flink/flink-1.3.0/flink-1.3.0-src.tgz.md5
release/flink/flink-1.3.0/flink-1.3.0-src.tgz.sha

Added: release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz
==
Binary file - no diff available.

Propchange: release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz
--
svn:mime-type = application/octet-stream

Added: release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.asc
==
--- release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.asc (added)
+++ release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.asc Wed 
May 31 12:30:20 2017
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+Version: GnuPG v1
+
+iQIcBAABAgAGBQJZKDlBAAoJEBg/aUTZg5FZQEUP/jrar/ogrmmE4YFLj4Y9DdVv
+xMWFvpkk64/EB7B/mTNjDGJMr2sMW/IxGCcwmXl7ufNel0GYMgrHehr9i5fuTDQe
+C2vVy4jpHX+iuFKQE8Ao8+5GoqdqpaiVQr6pqoOHlolgCodlwjKNwFRH2iPWMzMb
+wtI/DF6OB5BwMGGoZ4XBVjuUW7oeJ3SMk1lgDI4EqagjfyLTg6beR0wD0xzjRcyj
+Bkx+PlXL4frEAEBdpCNrx7Ksi1KYg6h6W5ZKz/4usfUz39Hottyzq0qsbugwppwL
+QWK2qY15hoOPMuoGWzHwDWWaMPRwtXW73WIwh7habiuK9ni+TS3Is7JiPFOYmZIz
+tAwJ0/01JkGZc28Fslom7txKjVbyrw+6PL44TtfcwZUOkUeWqzZ/ctIUmHSArHEQ
+VYZ2KEfHET1SfDkHYWfzsjbqvDJo/9Cf9//BBtCHyMTQ60t1dcwi4qjW5dLht88N
+S9fEmQJHorLqknUjXHHSqjBQGPExEseIxd3W+5hwIGzHUTXiqOlVXxyQWsleo5ev
+epSURwTLwbzh3QI527DWuFRxihYd5DZwuOA2Z6lutBv4Gbv2EFpsFKTUkvKS4WeQ
+hBWXJ7mrMjvx1gD+TP7iPNnISxPMQWNlEDKx0wHL2RxD3VA9c/xBd/7/CJk7iipG
+3D9UUa9kEOGXP4hovkyw
+=NMyb
+-END PGP SIGNATURE-

Added: release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.md5
==
--- release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.md5 (added)
+++ release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.md5 Wed 
May 31 12:30:20 2017
@@ -0,0 +1 @@
+aa3bc47e358c2330e8823c60f860719d  flink-1.3.0-bin-hadoop2-scala_2.10.tgz

Added: release/flink/flink-1.3.0/flink-1.3.0-bin-hadoop2-scala_2.10.tgz.sha
==
--- release/flink

flink git commit: [FLINK-6766] [docs] Update documentation about async backends and incremental checkpoints

2017-05-31 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/master 5982ea93f -> 88545130b


[FLINK-6766] [docs] Update documentation about async backends and incremental 
checkpoints

This closes #4011


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/88545130
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/88545130
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/88545130

Branch: refs/heads/master
Commit: 88545130b7debb3fe39d675bc14041d5c07930a1
Parents: 5982ea9
Author: Stefan Richter 
Authored: Mon May 29 17:18:19 2017 +0200
Committer: Robert Metzger 
Committed: Wed May 31 18:17:31 2017 +0200

--
 docs/monitoring/large_state_tuning.md | 16 
 docs/ops/state_backends.md| 23 +++
 2 files changed, 39 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/flink/blob/88545130/docs/monitoring/large_state_tuning.md
--
diff --git a/docs/monitoring/large_state_tuning.md 
b/docs/monitoring/large_state_tuning.md
index a520106..9e1ecc7 100644
--- a/docs/monitoring/large_state_tuning.md
+++ b/docs/monitoring/large_state_tuning.md
@@ -138,6 +138,22 @@ Unfortunately, RocksDB's performance can vary with 
configuration, and there is l
 RocksDB properly. For example, the default configuration is tailored towards 
SSDs and performs suboptimal
 on spinning disks.
 
+**Incremental Checkpoints**
+
+Incremental checkpoints can dramatically reduce the checkpointing time in 
comparison to full checkpoints, at the cost of a (potentially) longer
+recovery time. The core idea is that incremental checkpoints only record all 
changes to the previous completed checkpoint, instead of
+producing a full, self-contained backup of the state backend. Like this, 
incremental checkpoints build upon previous checkpoints. Flink leverages
+RocksDB's internal backup mechanism in a way that is self-consolidating over 
time. As a result, the incremental checkpoint history in Flink
+does not grow indefinitely, and old checkpoints are eventually subsumed and 
pruned automatically. `
+
+While we strongly encourage the use of incremental checkpoints for large 
state, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a 
`RocksDBStateBackend` with the corresponding boolean flag in the constructor 
set to `true`, e.g.:
+
+{% highlight java %}
+RocksDBStateBackend backend =
+new RocksDBStateBackend(filebackend, true);
+{% endhighlight %}
+
 **Passing Options to RocksDB**
 
 {% highlight java %}

http://git-wip-us.apache.org/repos/asf/flink/blob/88545130/docs/ops/state_backends.md
--
diff --git a/docs/ops/state_backends.md b/docs/ops/state_backends.md
index 656594d..781b2c5 100644
--- a/docs/ops/state_backends.md
+++ b/docs/ops/state_backends.md
@@ -56,6 +56,13 @@ that store the values, triggers, etc.
 Upon checkpoints, this state backend will snapshot the state and send it as 
part of the checkpoint acknowledgement messages to the
 JobManager (master), which stores it on its heap as well.
 
+The MemoryStateBackend can be configured to use asynchronous snapshots. While 
we strongly encourage the use of asynchronous snapshots to avoid blocking 
pipelines, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a 
`MemoryStateBackend` with the corresponding boolean flag in the constructor set 
to `true`, e.g.:
+
+{% highlight java %}
+new MemoryStateBackend(MAX_MEM_STATE_SIZE, true);
+{% endhighlight %}
+
 Limitations of the MemoryStateBackend:
 
   - The size of each individual state is by default limited to 5 MB. This 
value can be increased in the constructor of the MemoryStateBackend.
@@ -74,6 +81,13 @@ The *FsStateBackend* is configured with a file system URL 
(type, address, path),
 
 The FsStateBackend holds in-flight data in the TaskManager's memory. Upon 
checkpointing, it writes state snapshots into files in the configured file 
system and directory. Minimal metadata is stored in the JobManager's memory 
(or, in high-availability mode, in the metadata checkpoint).
 
+The FsStateBackend can be configured to use asynchronous snapshots. While we 
strongly encourage the use of asynchronous snapshots to avoid blocking 
pipelines, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a `FsStateBackend` 
with the corresponding boolean flag in the constructor set to `true`, e.g.:
+
+{% highlight java %}
+new FsStateBackend(path, true);
+{% endhighlight %}
+
 The FsStateBackend is encouraged for:
 
   - Jobs with large state, long window

flink git commit: [FLINK-6766] [docs] Update documentation about async backends and incremental checkpoints

2017-05-31 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/release-1.3 144f663bd -> dd1c05b13


[FLINK-6766] [docs] Update documentation about async backends and incremental 
checkpoints

This closes #4011


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/dd1c05b1
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/dd1c05b1
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/dd1c05b1

Branch: refs/heads/release-1.3
Commit: dd1c05b1334e72db60ce686cdffe5d7b2a29f2aa
Parents: 144f663
Author: Stefan Richter 
Authored: Mon May 29 17:18:19 2017 +0200
Committer: Robert Metzger 
Committed: Wed May 31 18:18:09 2017 +0200

--
 docs/monitoring/large_state_tuning.md | 16 
 docs/ops/state_backends.md| 23 +++
 2 files changed, 39 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/flink/blob/dd1c05b1/docs/monitoring/large_state_tuning.md
--
diff --git a/docs/monitoring/large_state_tuning.md 
b/docs/monitoring/large_state_tuning.md
index a520106..9e1ecc7 100644
--- a/docs/monitoring/large_state_tuning.md
+++ b/docs/monitoring/large_state_tuning.md
@@ -138,6 +138,22 @@ Unfortunately, RocksDB's performance can vary with 
configuration, and there is l
 RocksDB properly. For example, the default configuration is tailored towards 
SSDs and performs suboptimal
 on spinning disks.
 
+**Incremental Checkpoints**
+
+Incremental checkpoints can dramatically reduce the checkpointing time in 
comparison to full checkpoints, at the cost of a (potentially) longer
+recovery time. The core idea is that incremental checkpoints only record all 
changes to the previous completed checkpoint, instead of
+producing a full, self-contained backup of the state backend. Like this, 
incremental checkpoints build upon previous checkpoints. Flink leverages
+RocksDB's internal backup mechanism in a way that is self-consolidating over 
time. As a result, the incremental checkpoint history in Flink
+does not grow indefinitely, and old checkpoints are eventually subsumed and 
pruned automatically. `
+
+While we strongly encourage the use of incremental checkpoints for large 
state, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a 
`RocksDBStateBackend` with the corresponding boolean flag in the constructor 
set to `true`, e.g.:
+
+{% highlight java %}
+RocksDBStateBackend backend =
+new RocksDBStateBackend(filebackend, true);
+{% endhighlight %}
+
 **Passing Options to RocksDB**
 
 {% highlight java %}

http://git-wip-us.apache.org/repos/asf/flink/blob/dd1c05b1/docs/ops/state_backends.md
--
diff --git a/docs/ops/state_backends.md b/docs/ops/state_backends.md
index 656594d..781b2c5 100644
--- a/docs/ops/state_backends.md
+++ b/docs/ops/state_backends.md
@@ -56,6 +56,13 @@ that store the values, triggers, etc.
 Upon checkpoints, this state backend will snapshot the state and send it as 
part of the checkpoint acknowledgement messages to the
 JobManager (master), which stores it on its heap as well.
 
+The MemoryStateBackend can be configured to use asynchronous snapshots. While 
we strongly encourage the use of asynchronous snapshots to avoid blocking 
pipelines, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a 
`MemoryStateBackend` with the corresponding boolean flag in the constructor set 
to `true`, e.g.:
+
+{% highlight java %}
+new MemoryStateBackend(MAX_MEM_STATE_SIZE, true);
+{% endhighlight %}
+
 Limitations of the MemoryStateBackend:
 
   - The size of each individual state is by default limited to 5 MB. This 
value can be increased in the constructor of the MemoryStateBackend.
@@ -74,6 +81,13 @@ The *FsStateBackend* is configured with a file system URL 
(type, address, path),
 
 The FsStateBackend holds in-flight data in the TaskManager's memory. Upon 
checkpointing, it writes state snapshots into files in the configured file 
system and directory. Minimal metadata is stored in the JobManager's memory 
(or, in high-availability mode, in the metadata checkpoint).
 
+The FsStateBackend can be configured to use asynchronous snapshots. While we 
strongly encourage the use of asynchronous snapshots to avoid blocking 
pipelines, please note that this is a new feature and currently not enabled 
+by default. To enable this feature, users can instantiate a `FsStateBackend` 
with the corresponding boolean flag in the constructor set to `true`, e.g.:
+
+{% highlight java %}
+new FsStateBackend(path, true);
+{% endhighlight %}
+
 The FsStateBackend is encouraged for:
 
   - Jobs with large state, l

[5/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/blog/feed.xml
--
diff --git a/content/blog/feed.xml b/content/blog/feed.xml
index 57b6876..5b37a9a 100644
--- a/content/blog/feed.xml
+++ b/content/blog/feed.xml
@@ -7,6 +7,186 @@
 http://flink.apache.org/blog/feed.xml"; rel="self" 
type="application/rss+xml" />
 
 
+Apache Flink 1.3.0 Release Announcement
+The Apache Flink community is pleased to announce the 
1.3.0 release. Over the past 4 months, the Flink community has been working 
hard to resolve more than 680 issues. See the complete 
changelog for more detail.
+
+This is the fourth major release in the 1.x.y series. It is API 
compatible with the other 1.x.y releases for APIs annotated with the @Public 
annotation.
+
+Users can expect Flink releases now in a 4 month cycle. At the 
beginning of the 1.3 release
 cycle, the community decided to follow a strict time-based
 release model.
+
+We encourage everyone to download the release and check out the documentation;.
 Feedback through the Flink 
mailing lists is, as always, gladly encouraged!
+
+You can find the binaries on the updated Downloads 
page. Some highlights of the release are listed below.
+
+Large State 
Handling/Recovery
+
+
+  
+Incremental Checkpointing for 
RocksDB: It is now possible to checkpoint only the difference 
from the previous successful checkpoint, rather than checkpointing the entire 
application state. This speeds up checkpointing and saves disk space, because 
the individual checkpoints are smaller. (FLINK-5053;).
+  
+  
+Asynchronous snapshots for heap-based state 
backends: The filesystem and memory statebackends now also 
support asynchronous snapshots using a copy-on-write HashMap implementation. 
Asynchronous snapshotting makes Flink more resilient to slow storage systems 
and expensive serialization. The time an operator blocks on a snapshot is 
reduced to a minimum (FLINK-6048;,
 FLINK-5715;).
+  
+  
+Allow upgrades to state serializers: 
Users can now upgrade serializers, while keeping their application state. One 
use case of this is upgrading custom serializers used for managed operator 
state/keyed state. Also, registration order for POJO types/Kryo types is now no 
longer fixed (Documentation;,
 FLINK-6178;).
+  
+  
+Recover job state at the granularity of 
operator: Before Flink 1.3, operator state was bound to 
Flinkâs internal âTaskâ representation. This made it hard to change a 
jobâs topology while keeping its state around. With this change, users are 
allowed to do more topology changes (un-chain operators) by restoring state 
into logical operators instead of âTasksâ (FLINK-5892;).
+  
+  
+Fine-grained recovery (beta): 
Instead of restarting the complete ExecutionGraph in case of a task failure, 
Flink is now able to restart only the affected subgraph and thereby 
significantly decrease recovery time (FLINK-4256;).
+  
+
+
+DataStream API
+
+
+  
+Side Outputs: This change allows 
users to have more than one output stream for an operator. Operator metadata, 
internal system information (debugging, performance etc.) or rejected/late 
elements are potential use-cases for this new API feature. The 
Window operator is now using this new feature for late window 
elements (Side
 Outputs Documentation, FLINK-4460;).
+  
+  
+Union Operator State: Flink 1.2.0 
introduced broadcast state functionality, but this had not yet been exposed

[3/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/community.html
--
diff --git a/content/community.html b/content/community.html
index 698ab37..733f163 100644
--- a/content/community.html
+++ b/content/community.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Snapshot) 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
 
   
 
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
 
 
 
@@ -317,7 +317,7 @@
 
 Project Wiki
 
-The Apache Flink https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"; 
target="_blank">project wiki contains a range of relevant resources for 
Flink users. However, some content on the wiki might be out-of-date. When in 
doubt, please refer to the http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">Flink documentation.
+The Apache Flink https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home"; 
target="_blank">project wiki contains a range of relevant resources for 
Flink users. However, some content on the wiki might be out-of-date. When in 
doubt, please refer to the http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">Flink documentation.
 
 Flink Forward
 
@@ -553,7 +553,7 @@
 
 Slides
 
-Note: Keep in mind that code examples on slides have a 
chance of being incomplete or outdated. Always refer to the http://ci.apache.org/projects/flink/flink-docs-release-1.3";>latest 
documentation for an up to date reference.
+Note: Keep in mind that code examples on slides have a 
chance of being incomplete or outdated. Always refer to the http://ci.apache.org/projects/flink/flink-docs-master";>latest 
documentation for an up to date reference.
 
 2016
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/contribute-code.html
--
diff --git a/content/contribute-code.html b/content/contribute-code.html
index 54d3dd8..81dde9f 100644
--- a/content/contribute-code.html
+++ b/content/contribute-code.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Snapshot) 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
 
   
 
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
 
 
 
@@ -451,15 +451,15 @@ Note: If you do not have the jar file, you probably did 
not run the command line
 
 Snapshots (Nightly Builds)
 
-Apache Flink 1.3-SNAPSHOT is our latest development 
version.
+Apache Flink 1.4-SNAPSHOT is our latest development 
version.
 
 You can download a packaged version of our nightly builds, which include
 the most recent development code. You can use them if you need a feature
 before its release. Only builds that pass all tests are published here.
 
 
-  Hadoop 1: https://s3.amazonaws.com/flink-nightly/flink-1.3-SNAPSHOT-bin-hadoop1.tgz";
 class="ga-track" 
id="download-hadoop1-nightly">flink-1.3-SNAPSHOT-bin-hadoop1.tgz
-  Hadoop 2 and YARN: https://s3.amazonaws.com/flink-nightly/flink-1.3-SNAPSHOT-bin-hadoop2.tgz";
 class="ga-track" 
id="download-hadoop2-nightly">flink-1.3-SNAPSHOT-bin-hadoop2.tgz
+  Hadoop 1: https://s3.amazonaws.com/flink-nightly/flink-1.4-SNAPSHOT-bin-hadoop1.tgz";
 class="ga-track" 
id="download-hadoop1-nightly">flink-1.4-SNAPSHOT-bin-hadoop1.tgz
+  Hadoop 2 and YARN: https://s3.amazonaws.com/flink-nightly/flink-1.4-SNAPSHOT-bin-hadoop2.tgz";
 class="ga-tr

[4/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/blog/release_1.3.0-changelog.html
--
diff --git a/content/blog/release_1.3.0-changelog.html 
b/content/blog/release_1.3.0-changelog.html
new file mode 100644
index 000..0e62184
--- /dev/null
+++ b/content/blog/release_1.3.0-changelog.html
@@ -0,0 +1,1662 @@
+
+
+  
+
+
+
+
+Apache Flink: Release 1.3.0 â Changelog
+
+
+
+
+https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css";>
+
+
+
+
+
+
+
+
+https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js";>
+
+
+
+
+  
+
+
+
+
+
+
+
+  
+ 
+  
+
+
+
+  
+
+
+
+  
+  
+
+  
+
+  
+
+
+
+
+  
+
+
+Download Flink
+
+
+Home
+
+
+Introduction to Flink
+
+
+Flink Use Cases
+
+
+Powered by Flink
+
+
+Ecosystem
+
+
+Community & Project Info
+
+
+How to Contribute
+
+
+Flink 
Blog
+
+
+
+
+
+
+
+
+  Documentation
+
+
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
+
+  
+
+
+
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+
+
+
+
+  https://github.com/apache/flink"; target="_blank">Flink 
on GitHub 
+
+
+  
+
+
+
+  
+  
+
+
+Project FAQ
+
+
+https://twitter.com/apacheflink"; 
target="_blank">@ApacheFlink 
+
+
+Plan Visualizer 
+
+  
+
+
+
+  
+  
+  
+  
+Release 1.3.0 â Changelog
+
+   
+  Changelog
+
+
+Changelog
+
+The 1.3.0 release https://issues.apache.org/jira/issues/?jql=project+%3D+FLINK+AND+fixVersion+%3D+1.3.0";>resolved
 772 JIRA issues in total.
+
+Sub-task
+
+
+[https://issues.apache.org/jira/browse/FLINK-3722";>FLINK-3722] -   
  The divisions in the InMemorySorters' swap/compare methods hurt 
performance
+
+[https://issues.apache.org/jira/browse/FLINK-4562";>FLINK-4562] -   
  table examples make an divided module in flink-examples
+
+[https://issues.apache.org/jira/browse/FLINK-4692";>FLINK-4692] -   
  Add tumbling group-windows for batch tables
+
+[https://issues.apache.org/jira/browse/FLINK-4693";>FLINK-4693] -   
  Add session group-windows for batch tables   
+
+[https://issues.apache.org/jira/browse/FLINK-4697";>FLINK-4697] -   
  Gather more detailed checkpoint stats in CheckpointStatsTracker
+
+[https://issues.apache.org/jira/browse/FLINK-4698";>FLINK-4698] -   
  Visualize additional checkpoint information
+
+[https://issues.apache.org/jira/browse/FLINK-4769";>FLINK-4769] -   
  Migrate Metrics configuration options
+
+[https://issues.apache.org/jira/browse/FLINK-4912";>FLINK-4912] -   
  Introduce RECONCILING state in ExecutionGraph
+
+[https://issues.apache.org/jira/browse/FLINK-4959";>FLINK-4959] -   
  Write Documentation for ProcessFunction
+
+[https://issues.apache.org/jira/browse/FLINK-4994";>FLINK-4994] -   
  Don't Clear Trigger State and Merging Window Set When Purging
+
+[https://issues.apache.org/jira/browse/FLINK-5132";>FLINK-5132] -   
  Introduce the ResourceSpec for grouping different resource factors in API
+
+[https://issues.apache.org/jira/browse/FLINK-5133";>FLINK-5133] -   
  Support to set resource for operator in DataStream and DataSet
+
+[https://issues.apache.org/jira/browse/FLINK-5134";>FLINK-5134] -   
  Aggregate ResourceSpec for chained operators when generating job graph
+
+[https://issues.apache.org/jira/browse/FLINK-5135";>FLINK-5135] -   
  ResourceProfile for slot request should be expanded to correspond with 
ResourceSpec
+
+[https://issues.apache.org/jira/browse/FLINK-5219";>FLINK-5219] -   
  Add non-grouped session windows for batch tables
+
+[https://issues.apache.org/jira/browse/FLINK-5239";>FLINK-5239] -   
  Properly unpack thrown exceptions in RPC methods
+
+[https://issues.apache.org/jira/browse/FLINK-5268";>FLINK-5268] -   
  Split TableProgramsTestBase into TableProgramsCollectionTestBase and 
TableProgramsClusterTestBase
+
+[https://issues.apache.org/jira/browse/FLINK-53

[7/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

Add Flink 1.3.0 release announcement

This closes #62


Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/4e75b86e
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/4e75b86e
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/4e75b86e

Branch: refs/heads/asf-site
Commit: 4e75b86eb4447bda5c52fbd8d296f00a4f006cd0
Parents: edbd65a
Author: Robert Metzger 
Authored: Tue May 30 10:56:23 2017 +0200
Committer: Robert Metzger 
Committed: Thu Jun 1 16:14:20 2017 +0200

--
 _config.yml |   45 +-
 _posts/2017-5-31-release-1.3.0.md   |  131 ++
 blog/release_1.3.0-changelog.md | 1491 
 content/blog/feed.xml   |  182 +-
 content/blog/index.html |   44 +-
 content/blog/page2/index.html   |   44 +-
 content/blog/page3/index.html   |   47 +-
 content/blog/page4/index.html   |   47 +-
 content/blog/page5/index.html   |   31 +-
 .../release_1.0.0-changelog_known_issues.html   |8 +-
 content/blog/release_1.1.0-changelog.html   |8 +-
 content/blog/release_1.2.0-changelog.html   |8 +-
 content/blog/release_1.3.0-changelog.html   | 1662 ++
 content/community.html  |   12 +-
 content/contribute-code.html|   16 +-
 content/contribute-documentation.html   |8 +-
 content/documentation.html  |8 +-
 content/downloads.html  |   41 +-
 content/ecosystem.html  |   26 +-
 content/faq.html|   28 +-
 content/features.html   |8 +-
 content/how-to-contribute.html  |8 +-
 content/improve-website.html|8 +-
 content/index.html  |   18 +-
 content/introduction.html   |   22 +-
 content/material.html   |8 +-
 content/news/2014/08/26/release-0.6.html|8 +-
 content/news/2014/09/26/release-0.6.1.html  |8 +-
 content/news/2014/10/03/upcoming_events.html|8 +-
 content/news/2014/11/04/release-0.7.0.html  |8 +-
 .../news/2014/11/18/hadoop-compatibility.html   |8 +-
 content/news/2015/01/06/december-in-flink.html  |8 +-
 content/news/2015/01/21/release-0.8.html|8 +-
 content/news/2015/02/04/january-in-flink.html   |8 +-
 content/news/2015/02/09/streaming-example.html  |8 +-
 .../news/2015/03/02/february-2015-in-flink.html |8 +-
 .../peeking-into-Apache-Flinks-Engine-Room.html |8 +-
 content/news/2015/04/07/march-in-flink.html |8 +-
 .../2015/04/13/release-0.9.0-milestone1.html|8 +-
 .../05/11/Juggling-with-Bits-and-Bytes.html |8 +-
 .../news/2015/05/14/Community-update-April.html |8 +-
 .../announcing-apache-flink-0.9.0-release.html  |8 +-
 .../2015/08/24/introducing-flink-gelly.html |8 +-
 content/news/2015/09/01/release-0.9.1.html  |   10 +-
 content/news/2015/09/03/flink-forward.html  |8 +-
 content/news/2015/09/16/off-heap-memory.html|8 +-
 content/news/2015/11/16/release-0.10.0.html |8 +-
 content/news/2015/11/27/release-0.10.1.html |8 +-
 .../news/2015/12/04/Introducing-windows.html|8 +-
 .../news/2015/12/11/storm-compatibility.html|8 +-
 content/news/2015/12/18/a-year-in-review.html   |8 +-
 content/news/2016/02/11/release-0.10.2.html |8 +-
 content/news/2016/03/08/release-1.0.0.html  |8 +-
 content/news/2016/04/06/cep-monitoring.html |8 +-
 content/news/2016/04/06/release-1.0.1.html  |8 +-
 .../news/2016/04/14/flink-forward-announce.html |8 +-
 content/news/2016/04/22/release-1.0.2.html  |8 +-
 content/news/2016/05/11/release-1.0.3.html  |8 +-
 content/news/2016/05/24/stream-sql.html |8 +-
 content/news/2016/08/08/release-1.1.0.html  |8 +-
 content/news/2016/08/11/release-1.1.1.html  |8 +-
 .../news/2016/08/24/ff16-keynotes-panels.html   |8 +-
 content/news/2016/09/05/release-1.1.2.html  |8 +-
 content/news/2016/10/12/release-1.1.3.html  |8 +-
 .../news/2016/12/19/2016-year-in-review.html|8 +-
 content/news/2016/12/21/release-1.1.4.html  |8 +-
 content/news/2017/02/06/release-1.2.0.html  |8 +-
 content/news/2017/03/23/release-1.1.5.html  |8 +-
 .../news/2017/03/29/table-sql-api-update.html   |8 +-
 content/news/2017/04/04/dynamic-tables.html |8 +-
 content/news/2017/04/26/release-1.2.1.html  |8 +-
 .../news/2017/05/16/official-docker-image.html  |8 +-
 content/news/2017/06/01/release-1.3.0.html  |  367 
 content/poweredby.html

[2/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/news/2015/04/07/march-in-flink.html
--
diff --git a/content/news/2015/04/07/march-in-flink.html 
b/content/news/2015/04/07/march-in-flink.html
index a0efc74..e345c04 100644
--- a/content/news/2015/04/07/march-in-flink.html
+++ b/content/news/2015/04/07/march-in-flink.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Snapshot) 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
 
   
 
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
 
 
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/news/2015/04/13/release-0.9.0-milestone1.html
--
diff --git a/content/news/2015/04/13/release-0.9.0-milestone1.html 
b/content/news/2015/04/13/release-0.9.0-milestone1.html
index c82d8eb..fa07442 100644
--- a/content/news/2015/04/13/release-0.9.0-milestone1.html
+++ b/content/news/2015/04/13/release-0.9.0-milestone1.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Snapshot) 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
 
   
 
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
 
 
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
--
diff --git a/content/news/2015/05/11/Juggling-with-Bits-and-Bytes.html 
b/content/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
index 05f8c15..6de4229 100644
--- a/content/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
+++ b/content/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Snapshot) 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
 
   
 
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
 
 
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/news/2015/05/14/Community-update-April.html
--
diff --git a/content/news/2015/05/14/Community-update-April.html 
b/content/news/2015/05/14/Community-update-April.html
index 6234f39..a2558f8 100644
--- a/content/news/2015/05/14/Community-update-April.html
+++ b/content/news/2015/05/14/Community-update-April.html
@@ -90,20 +90,20 @@
 
 
 
 
   Documentation
 
 
-  http://ci.apache.org/projects/flink/flink-docs-release-1.2"; 
target="_blank">1.2 (Latest stable release) 
-

[1/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

Repository: flink-web
Updated Branches:
  refs/heads/asf-site edbd65a2e -> 4e75b86eb


http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/content/news/2017/06/01/release-1.3.0.html
--
diff --git a/content/news/2017/06/01/release-1.3.0.html 
b/content/news/2017/06/01/release-1.3.0.html
new file mode 100644
index 000..b2a71db
--- /dev/null
+++ b/content/news/2017/06/01/release-1.3.0.html
@@ -0,0 +1,367 @@
+
+
+  
+
+
+
+
+Apache Flink: Apache Flink 1.3.0 Release Announcement
+
+
+
+
+https://maxcdn.bootstrapcdn.com/bootstrap/3.3.4/css/bootstrap.min.css";>
+
+
+
+
+
+
+
+
+https://ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js";>
+
+
+
+
+  
+
+
+
+
+
+
+
+  
+ 
+  
+
+
+
+  
+
+
+
+  
+  
+
+  
+
+  
+
+
+
+
+  
+
+
+Download Flink
+
+
+Home
+
+
+Introduction to Flink
+
+
+Flink Use Cases
+
+
+Powered by Flink
+
+
+Ecosystem
+
+
+Community & Project Info
+
+
+How to Contribute
+
+
+Flink 
Blog
+
+
+
+
+
+
+
+
+  Documentation
+
+
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3"; 
target="_blank">1.3 (Latest stable release) 
+  http://ci.apache.org/projects/flink/flink-docs-master"; 
target="_blank">1.4 (Snapshot) 
+
+  
+
+
+
+  http://ci.apache.org/projects/flink/flink-docs-release-1.3/quickstart/setup_quickstart.html";
 target="_blank">Quickstart 
+
+
+
+
+  https://github.com/apache/flink"; target="_blank">Flink 
on GitHub 
+
+
+  
+
+
+
+  
+  
+
+
+Project FAQ
+
+
+https://twitter.com/apacheflink"; 
target="_blank">@ApacheFlink 
+
+
+Plan Visualizer 
+
+  
+
+
+
+  
+  
+  
+  
+
+  Apache Flink 1.3.0 Release Announcement
+
+  
+01 Jun 2017 by Robert Metzger (https://twitter.com/rmetzger_";>@rmetzger_)
+
+The Apache Flink community is pleased to announce the 1.3.0 release. Over 
the past 4 months, the Flink community has been working hard to resolve more 
than 680 issues. See the complete 
changelog for more detail.
+
+This is the fourth major release in the 1.x.y series. It is API compatible 
with the other 1.x.y releases for APIs annotated with the @Public 
annotation.
+
+Users can expect Flink releases now in a 4 month cycle. At the beginning of 
the 1.3 https://cwiki.apache.org/confluence/display/FLINK/Flink+Release+and+Feature+Plan";>release
 cycle, the community decided to follow a strict https://cwiki.apache.org/confluence/display/FLINK/Time-based+releases";>time-based
 release model.
+
+We encourage everyone to download the release and check out the https://ci.apache.org/projects/flink/flink-docs-release-1.3/";>documentation.
 Feedback through the http://flink.apache.org/community.html#mailing-lists";>Flink mailing 
lists is, as always, gladly encouraged!
+
+You can find the binaries on the updated http://flink.apache.org/downloads.html";>Downloads page. Some 
highlights of the release are listed below.
+
+Large State Handling/Recovery
+
+
+  
+Incremental Checkpointing for RocksDB: It is now 
possible to checkpoint only the difference from the previous successful 
checkpoint, rather than checkpointing the entire application state. This speeds 
up checkpointing and saves disk space, because the individual checkpoints are 
smaller. (https://issues.apache.org/jira/browse/FLINK-5053";>FLINK-5053).
+  
+  
+Asynchronous snapshots for heap-based state backends: 
The filesystem and memory statebackends now also support asynchronous snapshots 
using a copy-on-write HashMap implementation. Asynchronous snapshotting makes 
Flink more resilient to slow storage systems and expensive serialization. The 
time an operator blocks on a snapshot is reduced to a minimum (https://issues.apache.org/jira/browse/FLINK-6048";>FLINK-6048, https://issues.apache.org/jira/browse/FLINK-5715";>FLINK-5715).
+  
+  
+Allow upgrades to state serializers: Users can now 
upgrade serializers, while keeping their application state. One use case of 
this is upgrading custom serializers used for managed operator state/keyed 
state. Also, registration order for POJO types/Kryo types is now no longer 
fixed (https://ci.apache.org/projects/flink/flin

[6/7] flink-web git commit: Add Flink 1.3.0 release announcement

2017-06-01 Thread rmetzger

http://git-wip-us.apache.org/repos/asf/flink-web/blob/4e75b86e/blog/release_1.3.0-changelog.md
--
diff --git a/blog/release_1.3.0-changelog.md b/blog/release_1.3.0-changelog.md
new file mode 100755
index 000..f91e1b1
--- /dev/null
+++ b/blog/release_1.3.0-changelog.md
@@ -0,0 +1,1491 @@
+---
+title: "Release 1.3.0 â Changelog"
+---
+
+* toc
+{:toc}
+
+## Changelog
+
+The 1.3.0 release [resolved 772 JIRA 
issues](https://issues.apache.org/jira/issues/?jql=project+%3D+FLINK+AND+fixVersion+%3D+1.3.0)
 in total.
+
+
+
+Sub-task
+
+
+[FLINK-3722] -   
  The divisions in the InMemorySorters' swap/compare methods hurt 
performance
+
+[FLINK-4562] -   
  table examples make an divided module in flink-examples
+
+[FLINK-4692] -   
  Add tumbling group-windows for batch tables
+
+[FLINK-4693] -   
  Add session group-windows for batch tables   
+
+[FLINK-4697] -   
  Gather more detailed checkpoint stats in CheckpointStatsTracker
+
+[FLINK-4698] -   
  Visualize additional checkpoint information
+
+[FLINK-4769] -   
  Migrate Metrics configuration options
+
+[FLINK-4912] -   
  Introduce RECONCILING state in ExecutionGraph
+
+[FLINK-4959] -   
  Write Documentation for ProcessFunction
+
+[FLINK-4994] -   
  Don't Clear Trigger State and Merging Window Set When Purging
+
+[FLINK-5132] -   
  Introduce the ResourceSpec for grouping different resource factors in API
+
+[FLINK-5133] -   
  Support to set resource for operator in DataStream and DataSet
+
+[FLINK-5134] -   
  Aggregate ResourceSpec for chained operators when generating job graph
+
+[FLINK-5135] -   
  ResourceProfile for slot request should be expanded to correspond with 
ResourceSpec
+
+[FLINK-5219] -   
  Add non-grouped session windows for batch tables
+
+[FLINK-5239] -   
  Properly unpack thrown exceptions in RPC methods
+
+[FLINK-5268] -   
  Split TableProgramsTestBase into TableProgramsCollectionTestBase and 
TableProgramsClusterTestBase
+
+[FLINK-5386] -   
  Refactoring Window Clause
+
+[FLINK-5417] -   
  Fix the wrong config file name 
+
+[FLINK-5435] -   
  Cleanup the rules introduced by FLINK-5144 when calcite releases 1.12
+
+[FLINK-5454] -   
  Add Documentation about how to tune Checkpointing for large state
+
+[FLINK-5456] -   
  Add docs about new state and checkpointing interfaces
+
+[FLINK-5457] -   
  Create documentation for Asynchronous I/O
+
+[FLINK-5458] -   
  Add documentation how to migrate from Flink 1.1. to Flink 1.2
+
+[FLINK-5459] -   
  Add documentation how to debug classloading issues
+
+[FLINK-5474] -   
  Extend DC/OS documentation
+
+[FLINK-5494] -   
  Improve Mesos documentation
+
+[FLINK-5501] -   
  Determine whether the job starts from last JobManager failure
+
+[FLINK-5529] -   
  Improve / extends windowing documentation
+
+[FLINK-5545] -   
  Remove FlinkAggregateExpandDistinctAggregatesRule when upgrading to Calcite 
1.12
+
+[FLINK-] -   
  Add documentation about debugging watermarks
+
+[FLINK-5566] -   
  Introduce structure to hold table and column level statistics
+
+[FLINK-5567] -   
  Introduce and migrate current table statistics to FlinkStatistics
+
+[FLINK-5570] -   
  Support register external catalog to table environment
+
+[FLINK-5618] -   
  Add queryable state documentation
+
+[FLINK-5640] -   
  configure the explicit Unit Test file suffix
+
+[FLINK-5653] -   
  Add processing time OVER ROWS BETWEEN x PRECEDING aggregation to SQL
+
+[FLINK-5654] -   
  Add processing time OVER RANGE BETWEEN x PRECEDING aggregation to SQL
+
+[FLINK-5655] -   
  Add event time OVER RANGE BETWEEN x PRECEDING aggregation to SQL
+
+[FLINK-5656] -   
  Add processing time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL
+
+[FLINK-5658] -   
  Add event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL
+
+[FLINK-5693] -   
  ChecksumHashCode DataSetAnalytic
+
+[FLINK-5694] -   
  Collect DataSetAnalytic
+
+[FLINK-5716] -   
  Make streaming SourceContexts aware of source idleness
+
+[FLINK-5723] -   
  Use "Used" instead of "Initial" to make taskmanager tag 
more readable
+
+[FLINK-5729] -   
  add hostname option in SocketWindowWordCount example to be more convenient
+
+[FLINK-5767] -   
  New aggregate function interface and built-in aggregate functions
+
+[FLINK-5768] -   
  Apply new aggregation functions for datastream and dataset tables
+
+[FLINK-5777] -   
  Pass savepoint information to CheckpointingOperation
+
+[FLINK-5794] -   
  update the documentation  about âUDF/UDTF"  support have parameters 
constructor.
+
+[FLINK-5795] -   
  Improve UDF&UDTF to support constructor with parameter
+
+[FLINK-5798] -   
  Let the RPCService provide a ScheduledExecutorService
+
+[FLINK-5799] -   
  Let

flink git commit: [docs] Set version to 1.3.0

2017-06-01 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/release-1.3 90d0d9114 -> 05a5fd99e


[docs] Set version to 1.3.0


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/05a5fd99
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/05a5fd99
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/05a5fd99

Branch: refs/heads/release-1.3
Commit: 05a5fd99e0c4b2aca747a45ab4dc895de29b1caf
Parents: 90d0d91
Author: Robert Metzger 
Authored: Thu Jun 1 16:26:27 2017 +0200
Committer: Robert Metzger 
Committed: Thu Jun 1 16:26:41 2017 +0200

--
 docs/_config.yml | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/flink/blob/05a5fd99/docs/_config.yml
--
diff --git a/docs/_config.yml b/docs/_config.yml
index 9167ace..809c6bc 100644
--- a/docs/_config.yml
+++ b/docs/_config.yml
@@ -26,7 +26,7 @@
 # to reference a specific Flink version, because this is the only place where
 # we change the version for the complete docs when forking of a release branch
 # etc.
-version: "1.3-SNAPSHOT"
+version: "1.3.0"
 version_short: "1.3" # Used for the top navbar w/o snapshot suffix
 is_snapshot_version: true
 
@@ -43,9 +43,10 @@ download_url: "http://flink.apache.org/downloads.html";
 # Flag whether this is the latest stable version or not. If not, a warning
 # will be printed pointing to the docs of the latest stable version.
 is_latest: true
-is_stable: false
+is_stable: true
 
 previous_docs:
+  1.3: http://ci.apache.org/projects/flink/flink-docs-release-1.3
   1.2: http://ci.apache.org/projects/flink/flink-docs-release-1.2
   1.1: http://ci.apache.org/projects/flink/flink-docs-release-1.1
   1.0: http://ci.apache.org/projects/flink/flink-docs-release-1.0

flink-web git commit: Update date in URL and fix link indentation in 1.3 blog post

2017-06-01 Thread rmetzger

Repository: flink-web
Updated Branches:
  refs/heads/asf-site 4e75b86eb -> 2ac4d1c8f


Update date in URL and fix link indentation in 1.3 blog post


Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/2ac4d1c8
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/2ac4d1c8
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/2ac4d1c8

Branch: refs/heads/asf-site
Commit: 2ac4d1c8ff84e1b074e6be7e78b49dac51198039
Parents: 4e75b86
Author: Robert Metzger 
Authored: Thu Jun 1 16:30:44 2017 +0200
Committer: Robert Metzger 
Committed: Thu Jun 1 16:30:44 2017 +0200

--
 _posts/2017-06-01-release-1.3.0.md | 131 
 _posts/2017-5-31-release-1.3.0.md  | 131 
 content/blog/feed.xml  |   4 +-
 content/news/2017/06/01/release-1.3.0.html |   4 +-
 4 files changed, 135 insertions(+), 135 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/flink-web/blob/2ac4d1c8/_posts/2017-06-01-release-1.3.0.md
--
diff --git a/_posts/2017-06-01-release-1.3.0.md 
b/_posts/2017-06-01-release-1.3.0.md
new file mode 100644
index 000..c1372cf
--- /dev/null
+++ b/_posts/2017-06-01-release-1.3.0.md
@@ -0,0 +1,131 @@
+---
+layout: post
+title:  "Apache Flink 1.3.0 Release Announcement"
+date:   2017-06-01 12:00:00
+author: "Robert Metzger"
+author-twitter: "rmetzger_"
+categories: news
+---
+
+
+The Apache Flink community is pleased to announce the 1.3.0 release. Over the 
past 4 months, the Flink community has been working hard to resolve more than 
680 issues. See the [complete changelog]({{ site.baseurl 
}}/blog/release_1.3.0-changelog.html) for more detail.
+
+This is the fourth major release in the 1.x.y series. It is API compatible 
with the other 1.x.y releases for APIs annotated with the @Public annotation.
+
+Users can expect Flink releases now in a 4 month cycle. At the beginning of 
the 1.3 [release 
cycle](https://cwiki.apache.org/confluence/display/FLINK/Flink+Release+and+Feature+Plan),
 the community decided to follow a strict [time-based release 
model](https://cwiki.apache.org/confluence/display/FLINK/Time-based+releases).
+
+We encourage everyone to download the release and check out the 
[documentation](https://ci.apache.org/projects/flink/flink-docs-release-1.3/). 
Feedback through the [Flink mailing 
lists](http://flink.apache.org/community.html#mailing-lists) is, as always, 
gladly encouraged!
+
+You can find the binaries on the updated [Downloads 
page](http://flink.apache.org/downloads.html). Some highlights of the release 
are listed below.
+
+
+
+# Large State Handling/Recovery
+
+* **Incremental Checkpointing for RocksDB**: It is now possible to checkpoint 
only the difference from the previous successful checkpoint, rather than 
checkpointing the entire application state. This speeds up checkpointing and 
saves disk space, because the individual checkpoints are smaller. 
([FLINK-5053](https://issues.apache.org/jira/browse/FLINK-5053)).
+
+* **Asynchronous snapshots for heap-based state backends**: The filesystem and 
memory statebackends now also support asynchronous snapshots using a 
copy-on-write HashMap implementation. Asynchronous snapshotting makes Flink 
more resilient to slow storage systems and expensive serialization. The time an 
operator blocks on a snapshot is reduced to a minimum 
([FLINK-6048](https://issues.apache.org/jira/browse/FLINK-6048), 
[FLINK-5715](https://issues.apache.org/jira/browse/FLINK-5715)).
+
+* **Allow upgrades to state serializers:** Users can now upgrade serializers, 
while keeping their application state. One use case of this is upgrading custom 
serializers used for managed operator state/keyed state. Also, registration 
order for POJO types/Kryo types is now no longer fixed 
([Documentation](https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/state.html#custom-serialization-for-managed-state),
 [FLINK-6178](https://issues.apache.org/jira/browse/FLINK-6178)).
+
+* **Recover job state at the granularity of operator**: Before Flink 1.3, 
operator state was bound to Flinkâs internal "Task" representation. This made 
it hard to change a jobâs topology while keeping its state around. With this 
change, users are allowed to do more topology changes (un-chain operators) by 
restoring state into logical operators instead of âTasksâ 
([FLINK-5892](https://issues.apache.org/jira/browse/FLINK-5892)).
+
+* **Fine-grained recovery** (beta): Instead of restarting the complete 
ExecutionGraph in case of a task failure, Flink is now able to restart only the 
affected subgraph and thereby significantly decrease recovery time 
([FLINK-4256](https://issues.apache.org/jira/browse/FLINK-4256)).
+
+#

flink-web git commit: Remove feature from CEP release 1.3 blog post

2017-06-01 Thread rmetzger

Repository: flink-web
Updated Branches:
  refs/heads/asf-site 2ac4d1c8f -> 433cefa78


Remove feature from CEP release 1.3 blog post


Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/433cefa7
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/433cefa7
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/433cefa7

Branch: refs/heads/asf-site
Commit: 433cefa7874e632d9222115bd33e99ae3fa73e1b
Parents: 2ac4d1c
Author: Robert Metzger 
Authored: Thu Jun 1 17:24:21 2017 +0200
Committer: Robert Metzger 
Committed: Thu Jun 1 17:24:44 2017 +0200

--
 _posts/2017-06-01-release-1.3.0.md | 1 -
 content/blog/feed.xml  | 3 ---
 content/news/2017/06/01/release-1.3.0.html | 3 ---
 3 files changed, 7 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/flink-web/blob/433cefa7/_posts/2017-06-01-release-1.3.0.md
--
diff --git a/_posts/2017-06-01-release-1.3.0.md 
b/_posts/2017-06-01-release-1.3.0.md
index c1372cf..f192749 100644
--- a/_posts/2017-06-01-release-1.3.0.md
+++ b/_posts/2017-06-01-release-1.3.0.md
@@ -95,7 +95,6 @@ Below are some of the main features of the revamped CEP 
library:
 
 * **Make CEP operators rescalable**: Flink 1.2.0 introduced rescalable state 
for DataStream programs. With Flink 1.3, the CEP library also makes use of that 
engine feature ([FLINK-5420](https://issues.apache.org/jira/browse/FLINK-5420)).
 
-* **State Cleanup and Late element handling**: The CEP library will now output 
late elements using the newly introduced side outputs 
([FLINK-6205](https://issues.apache.org/jira/browse/FLINK-6205), 
[FLINK-5174](https://issues.apache.org/jira/browse/FLINK-5174)).
 
 * **New operators for the CEP library**:
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/433cefa7/content/blog/feed.xml
--
diff --git a/content/blog/feed.xml b/content/blog/feed.xml
index 4e6e594..bac3cce 100644
--- a/content/blog/feed.xml
+++ b/content/blog/feed.xml
@@ -135,9 +135,6 @@
 Make CEP operators rescalable: Flink 
1.2.0 introduced rescalable state for DataStream programs. With Flink 1.3, the 
CEP library also makes use of that engine feature (FLINK-5420;).
   
   
-State Cleanup and Late element 
handling: The CEP library will now output late elements using 
the newly introduced side outputs (FLINK-6205;,
 FLINK-5174;).
-  
-  
 New operators for the CEP 
library:
 
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/433cefa7/content/news/2017/06/01/release-1.3.0.html
--
diff --git a/content/news/2017/06/01/release-1.3.0.html 
b/content/news/2017/06/01/release-1.3.0.html
index d822d50..0c3cef4 100644
--- a/content/news/2017/06/01/release-1.3.0.html
+++ b/content/news/2017/06/01/release-1.3.0.html
@@ -268,9 +268,6 @@
 Make CEP operators rescalable: Flink 1.2.0 introduced 
rescalable state for DataStream programs. With Flink 1.3, the CEP library also 
makes use of that engine feature (https://issues.apache.org/jira/browse/FLINK-5420";>FLINK-5420).
   
   
-State Cleanup and Late element handling: The CEP 
library will now output late elements using the newly introduced side outputs 
(https://issues.apache.org/jira/browse/FLINK-6205";>FLINK-6205, https://issues.apache.org/jira/browse/FLINK-5174";>FLINK-5174).
-  
-  
 New operators for the CEP library:

[flink] Git Push Summary

2017-06-02 Thread rmetzger

Repository: flink
Updated Tags:  refs/tags/release-1.3.0 [created] 760eea8a1

[flink] Git Push Summary

2017-06-02 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/release-1.3.0-rc1 [deleted] 3659a82f5

[flink] Git Push Summary

2017-06-02 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/release-1.3.0-rc0 [deleted] f94c00299

[flink] Git Push Summary

2017-06-02 Thread rmetzger

Repository: flink
Updated Branches:
  refs/heads/release-1.3.0-rc2 [deleted] e0a886e9a

flink-web git commit: Release 1.3 announcement: Fix JIRA link

2017-06-06 Thread rmetzger

Repository: flink-web
Updated Branches:
  refs/heads/asf-site 66c6acd78 -> fbc90d1bd


Release 1.3 announcement: Fix JIRA link


Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/fbc90d1b
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/fbc90d1b
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/fbc90d1b

Branch: refs/heads/asf-site
Commit: fbc90d1bddd9bc9c85e6a615f8f77e249e1a2b50
Parents: 66c6acd
Author: Robert Metzger 
Authored: Tue Jun 6 14:07:29 2017 +0200
Committer: Robert Metzger 
Committed: Tue Jun 6 14:07:31 2017 +0200

--
 _posts/2017-06-01-release-1.3.0.md | 2 +-
 content/blog/feed.xml  | 2 +-
 content/news/2017/06/01/release-1.3.0.html | 2 +-
 3 files changed, 3 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/flink-web/blob/fbc90d1b/_posts/2017-06-01-release-1.3.0.md
--
diff --git a/_posts/2017-06-01-release-1.3.0.md 
b/_posts/2017-06-01-release-1.3.0.md
index ff9af2c..d67d86d 100644
--- a/_posts/2017-06-01-release-1.3.0.md
+++ b/_posts/2017-06-01-release-1.3.0.md
@@ -117,7 +117,7 @@ Below are some of the main features of the revamped CEP 
library:
   
   
https://issues.apache.org/jira/browse/FLINK-6783";>FLINK-6783: Wrongly 
extracted TypeInformations for WindowedStream::aggregate
-   https://issues.apache.org/jira/browse/FLINK-6775";>FLINK-6783: 
StateDescriptor cannot be shared by multiple subtasks
+   https://issues.apache.org/jira/browse/FLINK-6775";>FLINK-6775: 
StateDescriptor cannot be shared by multiple subtasks

 
 

http://git-wip-us.apache.org/repos/asf/flink-web/blob/fbc90d1b/content/blog/feed.xml
--
diff --git a/content/blog/feed.xml b/content/blog/feed.xml
index 5b72a8b..07033dd 100644
--- a/content/blog/feed.xml
+++ b/content/blog/feed.xml
@@ -166,7 +166,7 @@
   

   
FLINK-6783:
 Wrongly extracted TypeInformations for 
WindowedStream::aggregate
-   FLINK-6783:
 StateDescriptor cannot be shared by multiple subtasks
+   FLINK-6775:
 StateDescriptor cannot be shared by multiple subtasks

Large State Handling/Recovery

DataStream API

< 5 6 7 8 9 10 11 12 13 14 >

901 - 1000 of 1773 matches

Mail list logo