[
https://issues.apache.org/jira/browse/FLINK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411031#comment-16411031
]
ASF GitHub Bot commented on FLINK-8972:
---------------------------------------
GitHub user fhueske opened a pull request:
https://github.com/apache/flink/pull/5752
[FLINK-8972] [e2eTests] Add DataSetAllroundTestProgram and e2e test script.
## What is the purpose of the change
* Add a program that covers many features of the DataSet API
* Add a script to start a cluster, run the program, shutdown the cluster,
and validate the result
## Brief change log
* Add a DataSet program
* Extend `pom.xml` file to package the program
* Add a script to run the end-to-end test
## Verifying this change
* Program is validated by test script.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): **no**
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: **no**
- The serializers: **no**
- The runtime per-record code paths (performance sensitive): **no**
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: **no**
- The S3 file system connector: **no**
## Documentation
- Does this pull request introduce a new feature? **no**
- If yes, how is the feature documented? **n/a**
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/fhueske/flink e2eTestsDataSet
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/5752.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5752
----
commit 00dbec86aeaaf0efed45bb204d1ab4c024ac476d
Author: Fabian Hueske <fhueske@...>
Date: 2018-03-21T15:21:46Z
[FLINK-8972] [e2eTests] Add DataSetAllroundTestProgram and e2e test script.
----
> Create general purpose DataSet testing job
> ------------------------------------------
>
> Key: FLINK-8972
> URL: https://issues.apache.org/jira/browse/FLINK-8972
> Project: Flink
> Issue Type: Task
> Components: Tests
> Affects Versions: 1.5.0
> Reporter: Till Rohrmann
> Assignee: Fabian Hueske
> Priority: Critical
>
> Likewise to FLINK-8971, we should have a general purpose testing job for the
> {{DataSet}} API. The job should contain at least the following aspects:
> * Co-group operation
> * Join operation
> * Iteration
> The input should generate a deterministic output which can be verified for
> correctness.
> The job should be made available in the {{flink-end-to-end-tests}} module.
> The job should also include some misbehavior such as failures which can be
> activated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
