GitHub user tzulitai opened a pull request:
https://github.com/apache/flink/pull/5745
[FLINK-8976] [test] Add end-to-end test for resuming savepoints with
different parallelism
## What is the purpose of the change
This PR adds end-to-end tests for resuming a savepoint with different
parallelisms.
## Brief change log
The changes are based on the new `test_resume_savepoint.sh` test script in
#5733, so only the last commit is relevant.
That script has been modified to be able to specify parallelism of the
state machine job, before and after the savepoint restore.
- Adapt `test_resume_savepoint.sh` to be able to use different parallelism
after the savepoint restore.
- Add scale up / scale down tests to be executed by Travis.
## Verifying this change
This PR adds new tests.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes / **no**)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (yes / **no**)
- The serializers: (yes / **no** / don't know)
- The runtime per-record code paths (performance sensitive): (yes /
**no** / don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / **no** / don't know)
- The S3 file system connector: (yes / **no** / don't know)
## Documentation
- Does this pull request introduce a new feature? (yes / **no**)
- If yes, how is the feature documented? (**not applicable** / docs /
JavaDocs / not documented)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tzulitai/flink FLINK-8976
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/5745.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5745
----
commit 529e060cb05fd723b8656dcc9ef48f8011282dd8
Author: Tzu-Li (Gordon) Tai <tzulitai@...>
Date: 2018-03-21T08:25:37Z
[FLINK-8975] [test] Add Kafka events generator job for StateMachineExample
commit 6b5126c006c752c6c1bee2699d429927e74587c9
Author: Tzu-Li (Gordon) Tai <tzulitai@...>
Date: 2018-03-21T08:32:51Z
[FLINK-8975] [test] Add resume from savepoint end-to-end test
commit 475ef4de0f8abbd3bb485e0e6fefcce2612074d3
Author: Tzu-Li (Gordon) Tai <tzulitai@...>
Date: 2018-03-22T07:34:49Z
fixup! Use SLF4J reporter to monitor state machine progress
commit 55d69567bc4cb61cd08ad852126c9c2c39b8feb4
Author: Tzu-Li (Gordon) Tai <tzulitai@...>
Date: 2018-03-22T09:09:53Z
[FLINK-8976] [test] Add end-to-end tests for resuming savepoint with
differrent parallelism
----
---