[ 
https://issues.apache.org/jira/browse/FLINK-13597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907962#comment-16907962
 ] 

Andrey Zagrebin commented on FLINK-13597:
-----------------------------------------

Tested in AWS EMR Yarn: 1 master and 4 worker nodes (m5.xlarge: 4 vCore, 16 
GiB).

EMR runs only on Java 8. Fine-grained recovery is enabled by default.

Modified E2E test scripts can be found here (asserting output): 
[https://github.com/azagrebin/flink/commits/FLINK-13597]

Batch SQL:
 * S3(a) filesystem over HADOOP works out-of-the-box (already on AWS class 
path) and also if put in plugins

Streaming SQL:
 * Hadoop output (s3 does not support recoverable writers)

 

> Test Flink 1.9.0 on cluster
> ---------------------------
>
>                 Key: FLINK-13597
>                 URL: https://issues.apache.org/jira/browse/FLINK-13597
>             Project: Flink
>          Issue Type: Test
>          Components: Tests
>    Affects Versions: 1.9.0
>            Reporter: Till Rohrmann
>            Assignee: Aljoscha Krettek
>            Priority: Blocker
>             Fix For: 1.9.0
>
>
> In order to verify the Flink {{1.9.0}} release, we should try it out on one 
> of the available cloud providers (AWS, GCP). I would suggest to run a 
> non-trivial workload on the cluster with using some of the new features:
> - SQL job
> - Filesystem being loaded as a plugin
> - Enable fine-grained recovery for batch job
> - Java 9
> - Checkpoints to GFS



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to