dongjoon-hyun commented on PR #55642: URL: https://github.com/apache/spark/pull/55642#issuecomment-4358131810
For documentation, of course, I'm able to explain specifically. - What is the expected scenario and what are the practical valid configuration ranges. For example, resizeInterval > 1hour or higher with the explanation of 6 hour-limit (EBS-case). > The current code computes a new desired state from the already-increased spec on each interval. - When a user should not set `spark.plugins=org.apache.spark.scheduler.cluster.k8s.ExecutorPVCResizePlugin`. For example, non-shuffle-storage PVC cases. For the code, we may introduce a string pattern (`*-exec-*-pvc-*`), but a user may already use the same name pattern via SPARK-32713 and SPARK-32766. I hope we can support those user-mounted PVCs independently. > preferably restrict the implementation to Spark local-dir PVC mounts only? ``` [SPARK-32713][K8S] Support execId placeholder in executor PVC conf [SPARK-32655][K8S] Support appId/execId placeholder in K8s SPARK_EXECUTOR_DIRS ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
