dongjoon-hyun opened a new pull request, #58589: URL: https://github.com/apache/spark/pull/58589
### What changes were proposed in this pull request? This PR aims to document the heterogeneous K8s executor management features (SPARK-55555) by adding a new `Heterogeneous Executor Management` section to `docs/running-on-kubernetes.md`. The section covers the following three features as one coherent topic, with a minimal `--conf` example, prerequisites (Kubernetes version, metrics server, StorageClass expansion, `direct` allocator, RBAC verbs), and caveats for each: - `ExecutorResizePlugin` (in-place executor pod memory resize) - `ExecutorPVCResizePlugin` (executor PVC storage growth) - Recovery-mode executors (`spark.kubernetes.allocation.recoveryMode.enabled`) It also explains how the features combine and how they differ from stage level scheduling with `ResourceProfile`. ### Why are the changes needed? These features only appear as individual rows in the `Spark Properties` table, with no prose that ties them together or explains the prerequisites. ### Does this PR introduce _any_ user-facing change? No. This is a documentation-only change. ### How was this patch tested? Manual review after building the page with `SKIP_API=1 SKIP_ERRORDOC=1 bundle exec jekyll build`. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Fable 5.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
