dongjoon-hyun opened a new pull request, #59114: URL: https://github.com/apache/spark/pull/59114
### What changes were proposed in this pull request? This PR aims to fix `spark.kubernetes.executor.resizeInterval` handling in `ExecutorResizePlugin`. - Change the default value from `0s` to `1m` to match the existing runtime behavior. - Disable `ExecutorResizePlugin` when the interval is `0`, like `ExecutorPVCResizePlugin` does. ### Why are the changes needed? Since Apache Spark 4.2.0, `spark.kubernetes.executor.resizeInterval` is documented as `0s` (disabled) by default, but `ExecutorResizePlugin` actually runs every minute when the config is unset. Moreover, setting `0` as documented makes `SparkContext` fail to start due to `IllegalArgumentException` from `scheduleAtFixedRate`. ### Does this PR introduce _any_ user-facing change? Yes. `spark.kubernetes.executor.resizeInterval=0` disables `ExecutorResizePlugin` instead of failing `SparkContext` initialization. The behavior of the unset case is unchanged. ### How was this patch tested? Pass the CIs with the newly added test cases. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 5.5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
