[
https://issues.apache.org/jira/browse/FLINK-32667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yangze Guo updated FLINK-32667:
-------------------------------
Description:
In OLAP scenarios, we only require the leader election services for the
Dispatcher / ResourceManager and RestEndpoint in the JobManager process. Leader
election services and persistent services are redundant for jobs and may impact
cluster performance.
To generate HA services suitable for OLAP scenarios, we introduce the
high-availability.enable-job-recovery parameter. When users enable HA with
Kubernetes or ZooKeeper and set this option to false, we will select the
combination of DefaultLeaderServices and EmbeddedPersistentServices.
Additionally, we will set the JobMaster's LeaderElectionService and
LeaderRetrieverService to the Standalone version.
was:When a flink session cluster use zk or k8s high availability service, it
will store jobs in zk or ConfigMap. When we submit flink olap jobs to the
session cluster, they always turn off restart strategy. These jobs with
no-restart-strategy should not be stored in zk or ConfigMap in k8s
> Enable users to independently adjust the high availability strategies related
> to jobs through configuration
> -----------------------------------------------------------------------------------------------------------
>
> Key: FLINK-32667
> URL: https://issues.apache.org/jira/browse/FLINK-32667
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Affects Versions: 1.18.0
> Reporter: Fang Yong
> Assignee: Yangze Guo
> Priority: Major
> Labels: pull-request-available, stale-assigned
>
> In OLAP scenarios, we only require the leader election services for the
> Dispatcher / ResourceManager and RestEndpoint in the JobManager process.
> Leader election services and persistent services are redundant for jobs and
> may impact cluster performance.
> To generate HA services suitable for OLAP scenarios, we introduce the
> high-availability.enable-job-recovery parameter. When users enable HA with
> Kubernetes or ZooKeeper and set this option to false, we will select the
> combination of DefaultLeaderServices and EmbeddedPersistentServices.
> Additionally, we will set the JobMaster's LeaderElectionService and
> LeaderRetrieverService to the Standalone version.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
