Hi there,
Looking at Flink document [1], EMR is the recommended way to run Flink on
AWS. However, Flink is currently not supported in an EMR cluster with
multiple master nodes [2].

For example, I can create a EMR HA cluster with Zookeeper, Hive, etc. But,
if I add Flink to the application list when I create the cluster, I got the
following error from aws cli:
"An error occurred (ValidationException) when calling the RunJobFlow
operation: HA clusters do not support the specified applications: Flink.
Revise the applications and resubmit.".

My question is what is the recommended way to run flink with high
availability on AWS.

Thanks
--
Pei

[1]:
https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/aws.html
[2]:
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha-applications.html

Reply via email to