GitHub user Ashwin4590 opened a pull request:
https://github.com/apache/flink/pull/4408
Release 1.3
*Thank you very much for contributing to Apache Flink - we are happy that
you want to help us improve Flink. To help the community review your
contribution in the best possible way, please go through the checklist below,
which will get the contribution into a shape in which it can be best reviewed.*
*Please understand that we do not do this to make contributions to Flink a
hassle. In order to uphold a high standard of quality for code contributions,
while at the same time managing a large number of contributions, we need
contributors to prepare the contributions well, and give reviewers enough
contextual information for the review. Please also understand that
contributions that do not follow this guide will take longer to review and thus
typically be picked up with lower priority by the community.*
## Contribution Checklist
- Make sure that the pull request corresponds to a [JIRA
issue](https://issues.apache.org/jira/projects/FLINK/issues). Exceptions are
made for typos in JavaDoc or documentation files, which need no JIRA issue.
- Name the pull request in the form "[FLINK-1234] [component] Title of
the pull request", where *FLINK-1234* should be replaced by the actual issue
number. Skip *component* if you are unsure about which is the best component.
Typo fixes that have no associated JIRA issue should be named following
this pattern: `[hotfix] [docs] Fix typo in event time introduction` or
`[hotfix] [javadocs] Expand JavaDoc for PuncuatedWatermarkGenerator`.
- Fill out the template below to describe the changes contributed by the
pull request. That will give reviewers the context they need to do the review.
- Make sure that the change passes the automated tests, i.e., `mvn clean
verify` passes. You can set up Travis CI to do that following [this
guide](http://flink.apache.org/contribute-code.html#best-practices).
- Each pull request should address only one issue, not mix up code from
multiple issues.
- Each commit in the pull request has a meaningful commit message
(including the JIRA id)
- Once all items of the checklist are addressed, remove the above text
and this checklist, leaving only the filled out template below.
**(The sections below can be removed for hotfixes of typos)**
## What is the purpose of the change
*(For example: This pull request makes task deployment go through the blob
server, rather than through RPC. That way we avoid re-transferring them on each
deployment (during recovery).)*
## Brief change log
*(for example:)*
- *The TaskInfo is stored in the blob store on job creation time as a
persistent artifact*
- *Deployments RPC transmits only the blob storage reference*
- *TaskManagers retrieve the TaskInfo from the blob cache*
## Verifying this change
*(Please pick either of the following options)*
This change is a trivial rework / code cleanup without any test coverage.
*(or)*
This change is already covered by existing tests, such as *(please describe
tests)*.
*(or)*
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end deployment with large payloads
(100MB)*
- *Extended integration test for recovery after master (JobManager)
failure*
- *Added test that validates that TaskInfo is transferred only once
across recoveries*
- *Manually verified the change by running a 4 node cluser with 2
JobManagers and 4 TaskManagers, a stateful streaming program, and killing one
JobManager and two TaskManagers during the execution, verifying that recovery
happens correctly.*
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes / no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (yes / no)
- The serializers: (yes / no / don't know)
- The runtime per-record code paths (performance sensitive): (yes / no /
don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
## Documentation
- Does this pull request introduce a new feature? (yes / no)
- If yes, how is the feature documented? (not applicable / docs /
JavaDocs / not documented)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/flink release-1.3
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4408.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4408
----
commit fa64a60ff9229cd1c7723d95b8a1bf1a1eb2bd63
Author: kl0u <[email protected]>
Date: 2017-05-05T11:55:07Z
[FLINK-6371] [cep] NFA return matched patterns as Map<String, List<T>>.
commit 4f14e53b877eab204d4d970d29f886d8fcc0034b
Author: kl0u <[email protected]>
Date: 2017-05-11T09:39:00Z
[FLINK-6536] [cep] Improve error message in SharedBuffer::put().
commit 4560d56c6fdface683116dc2db5d7a4942a8b6e3
Author: kl0u <[email protected]>
Date: 2017-05-12T14:01:38Z
[FLINK-6255] [cep] Remove PatternStream.getSideOutput().
commit 36df90196fcbb713175466d4b31574d570890262
Author: kkloudas <[email protected]>
Date: 2017-05-15T12:33:09Z
[FLINK-6578] [cep] Fix self-loop handling in SharedBuffer.
commit 34a6020ff6d51cd8148366677fadb9317cfaa153
Author: kkloudas <[email protected]>
Date: 2017-05-15T12:49:00Z
[hotfix] [cep] Remove unused keySelector in operator.
commit d80af81972ba5adf291d891881aee26b97ec7a60
Author: kkloudas <[email protected]>
Date: 2017-05-16T15:07:29Z
[FLINK-6604] [cep] Remove java serialization from the library.
commit 849dd9d8588ec8b1971c2c2b3f0a07f87715741b
Author: Dawid Wysakowicz <[email protected]>
Date: 2017-05-17T07:16:08Z
[FLINK-6609] [cep] Fix wrong version assignment with multiple TAKEs.
commit 7a045f20432cbaf1dcfa70206004fbee3a91d875
Author: twalthr <[email protected]>
Date: 2017-05-17T13:10:21Z
[hotfix] Add configuration notice to HistryServer overview
commit 056d9553d713834d18c1b3490a6e3f106129a9ef
Author: sunjincheng121 <[email protected]>
Date: 2017-05-16T11:08:11Z
[FLINK-6598] [table] Remove unused parameter from DataStreamGroupAggregate.
commit 36cac0fb64ade6debc66f06e00d4184cdc0fba5f
Author: sunjincheng121 <[email protected]>
Date: 2017-05-16T03:58:37Z
[FLINK-6583] [table] Add state cleanup for counting GroupWindows.
commit 98f4fad93263b05f0e55562ddd81385430546225
Author: Fabian Hueske <[email protected]>
Date: 2017-05-15T19:41:51Z
[FLINK-6589] [core] Deserialize ArrayList with capacity of size+1 to
prevent growth.
commit 8b5ba676fb3b52f69b0a523d57264462ac73c23f
Author: Tzu-Li (Gordon) Tai <[email protected]>
Date: 2017-05-16T17:15:57Z
[FLINK-6600] Add key serializer config snapshot to keyed backend checkpoints
This commit adds the config snapshot of the key serializer of keyed
backends to its checkpoints. This allows the oppurtunity to upgrade key
serializers, as well as state migration in the future in the case of
incompatible old and new key serializers.
This closes #3925.
commit a30a8be98c4a7416e4621c48e961dd8a802b56b4
Author: gosubpl <[email protected]>
Date: 2017-05-17T00:03:45Z
[FLINK-6570] QueryableStateClient docs with matching constructor signature
This closes #3926.
commit 5605feb5dd7c676a8e03102bd93dd6e1d43e19ad
Author: kkloudas <[email protected]>
Date: 2017-05-18T09:27:42Z
[FLINK-6624] [cep] Fix SharedBuffer#hashCode().
commit ca3e403e9f7845d455be4e3df0b00f8e4bac02db
Author: zentol <[email protected]>
Date: 2017-05-17T16:15:27Z
[FLINK-6031][yarn] Add config parameter for user-jar inclusion in classpath
This closes #3931
commit 44be162980d7f18e5859f215cd3283b71ae9d447
Author: zentol <[email protected]>
Date: 2017-05-16T07:19:15Z
[FLINK-6596][travis] Disable javadoc generation for jdk 7
commit 5569c4fafb08755ef12b7a96a173170dad883184
Author: zentol <[email protected]>
Date: 2017-05-16T08:19:18Z
[FLINK-6440][metrics] Downgrade fetching failure logging to DEBUG
commit 979228b3e2cac52c79c78855645a536d515befc9
Author: zentol <[email protected]>
Date: 2017-05-15T11:44:54Z
[FLINK-6416] Fix divide-by-zero in InputGateMetrics
commit 542068760901cba2fd6f2b3f3ff6a980aee0e23e
Author: Patrick Lucas <[email protected]>
Date: 2017-05-12T16:26:28Z
[hotfix] [docs] Fix link to docker-compose.yml
This closes #3887
commit 45923ffb8e5fcc98c569e55137e52a495cc7635f
Author: Greg Hogan <[email protected]>
Date: 2017-05-17T16:27:34Z
[FLINK-6616] [docs] Clarify provenance of official Docker images
Note that the official Docker images for Flink are community supported
and not an official release of the Apache Flink PMC.
This closes #3932
commit c794d6e0b2d5b0e26c2aa4e35ebe2f6c1e66e9c9
Author: twalthr <[email protected]>
Date: 2017-05-15T11:29:50Z
[FLINK-6585] [table] Fix execution of Table examples in IDE.
commit 0246ce51aaa12ce6ce4ac95898e014916a99ccd2
Author: twalthr <[email protected]>
Date: 2017-05-17T09:31:33Z
[FLINK-6543] [table] Deprecate toDataStream and add toAppendStream.
commit 51fb7ed791bc8c5c1c35dffcd9855a2e5a8f3087
Author: Fabian Hueske <[email protected]>
Date: 2017-05-17T14:26:27Z
[FLINK-6614] [table] Fix translation of group auxiliary functions (e.g.,
TUMBLE_END).
commit 6583fb4c1f85d5c4f57a81ec9a6294915ea165ac
Author: sunjincheng121 <[email protected]>
Date: 2017-05-18T05:02:24Z
[FLINK-6618] [table] Fix translation of WindowProperties in Table API.
commit cfb6a6982cce89f76209d7c4bea4c9905fd5092a
Author: Till Rohrmann <[email protected]>
Date: 2017-05-18T14:41:15Z
[hotfix] Restore KeySerializer only once
commit 6c573540f1e558192cbd3763446a9e6dd848efce
Author: Till Rohrmann <[email protected]>
Date: 2017-05-18T15:05:50Z
[hotfix] Remove some raw type usage in RocksDBKeyedStateBackend
Introduce more generic parameters
commit fe5b92f7e17a90315245706d5bc6868f9f729e56
Author: Till Rohrmann <[email protected]>
Date: 2017-05-18T15:48:30Z
[hotfix] Remove unnecessary job id from RocksDBKeyedStateBackend
commit 94111f98558274f6c17284ba7a9b627143ac7b1e
Author: Till Rohrmann <[email protected]>
Date: 2017-05-18T17:16:06Z
[hotfix] Correct equals & hashCode implementation of KryoSerializer
commit 1a43badcd2e7893819f6aba9e7cd7688176efc58
Author: Tzu-Li (Gordon) Tai <[email protected]>
Date: 2017-05-17T08:00:37Z
[FLINK-6608] [security, config] Relax Kerberos login contexts parsing
This closes #3928.
commit 58c4eed5accb0912472735bb00c148f6344a5679
Author: zjureel <[email protected]>
Date: 2017-05-15T09:41:47Z
[FLINK-6288] [kafka] New custom partitioner API that correctly handles
multiple Kafka sink topics
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
