This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 76b2766 [SPARK-53983] Increase
`s.k.o.reconciler.foregroundRequestTimeoutSeconds` to `60s`
76b2766 is described below
commit 76b2766156932e6ca17ad9fcb91fc8aaa9fb46a9
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Oct 22 10:59:20 2025 -0700
[SPARK-53983] Increase `s.k.o.reconciler.foregroundRequestTimeoutSeconds`
to `60s`
### What changes were proposed in this pull request?
This PR aims to increase `s.k.o.reconciler.foregroundRequestTimeoutSeconds`
to `60s`.
### Why are the changes needed?
While testing on EKS clusters, `30s` timeout happens too frequently.
### Does this PR introduce _any_ user-facing change?
This only increases the timeout. `Spark Operator` will wait more instead of
timing out.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #395 from dongjoon-hyun/SPARK-53983.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/config_properties.md | 2 +-
.../java/org/apache/spark/k8s/operator/config/SparkOperatorConf.java | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/config_properties.md b/docs/config_properties.md
index 1c166c2..47f9d59 100644
--- a/docs/config_properties.md
+++ b/docs/config_properties.md
@@ -8,7 +8,7 @@
| spark.kubernetes.operator.terminateOnInformerFailureEnabled | Boolean |
false | false | Enable to indicate informer errors should stop operator
startup. If disabled, operator startup will ignore recoverable errors, caused
for example by RBAC issues and will retry periodically. |
| spark.kubernetes.operator.reconciler.terminationTimeoutSeconds | Integer |
30 | false | Grace period for operator shutdown before reconciliation threads
are killed. |
| spark.kubernetes.operator.reconciler.parallelism | Integer | 50 | false |
Thread pool size for Spark Operator reconcilers. Unbounded pool would be used
if set to non-positive number. |
- | spark.kubernetes.operator.reconciler.foregroundRequestTimeoutSeconds | Long
| 30 | true | Timeout (in seconds) for requests made to API server. This
applies only to foreground requests. |
+ | spark.kubernetes.operator.reconciler.foregroundRequestTimeoutSeconds | Long
| 60 | true | Timeout (in seconds) for requests made to API server. This
applies only to foreground requests. |
| spark.kubernetes.operator.reconciler.intervalSeconds | Long | 120 | true |
Interval (in seconds, non-negative) to reconcile Spark applications. Note that
reconciliation is always expected to be triggered when app spec / status is
updated. This interval controls the reconcile behavior of operator
reconciliation even when there's no update on SparkApplication, e.g. to
determine whether a hanging app needs to be proactively terminated. Thus this
is recommended to set to above 2 minutes t [...]
| spark.kubernetes.operator.reconciler.trimStateTransitionHistoryEnabled |
Boolean | true | true | When enabled, operator would trim state transition
history when a new attempt starts, keeping previous attempt summary only. |
| spark.kubernetes.operator.reconciler.appStatusListenerClassNames | String |
| false | Comma-separated names of SparkAppStatusListener class
implementations |
diff --git
a/spark-operator/src/main/java/org/apache/spark/k8s/operator/config/SparkOperatorConf.java
b/spark-operator/src/main/java/org/apache/spark/k8s/operator/config/SparkOperatorConf.java
index 953c84c..18cd4cd 100644
---
a/spark-operator/src/main/java/org/apache/spark/k8s/operator/config/SparkOperatorConf.java
+++
b/spark-operator/src/main/java/org/apache/spark/k8s/operator/config/SparkOperatorConf.java
@@ -123,7 +123,7 @@ public final class SparkOperatorConf {
"Timeout (in seconds) for requests made to API server. This "
+ "applies only to foreground requests.")
.typeParameterClass(Long.class)
- .defaultValue(30L)
+ .defaultValue(60L)
.build();
/**
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
