[
https://issues.apache.org/jira/browse/SPARK-57466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Mészáros updated SPARK-57466:
------------------------------------
Summary: Add option for dynamic-config to use mounted-ConfigMap (was:
Replace dynamic-config controller with mounted-ConfigMap file watcher)
> Add option for dynamic-config to use mounted-ConfigMap
> ------------------------------------------------------
>
> Key: SPARK-57466
> URL: https://issues.apache.org/jira/browse/SPARK-57466
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: kubernetes-operator-1.0.0
> Reporter: Attila Mészáros
> Priority: Major
> Labels: pull-request-available
>
> Add a second option, for mount-based source for dynamic configuration
> overrides and makes the dynamic-config mechanism pluggable, while retaining
> the existing ConfigMap-informer behavior for backwards compatibility.
> A new config option `spark.kubernetes.operator.dynamicConfig.source`
> selects the source:
> - **`configMap`** (default) — the existing behavior: a dedicated `Operator`
> runs `SparkOperatorConfigMapReconciler`, watching a ConfigMap via a
> Kubernetes informer. Requires RBAC to read ConfigMaps.
> - **`file`** — a new `DynamicConfigMonitor` periodically reloads a
> properties file mounted from a ConfigMap volume, requiring no extra RBAC.
> Both paths funnel through the same `SparkOperatorConfManager.refresh(...)`
> + watched-namespace update logic, so runtime behavior is identical once
> overrides are applied.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
