dongjoon-hyun commented on code in PR #41076:
URL: https://github.com/apache/spark/pull/41076#discussion_r1186914804
##########
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala:
##########
@@ -66,6 +66,9 @@ import org.apache.spark.util.{Clock, SystemClock,
ThreadUtils, Utils}
* the executor, then it is removed. Note that an executor caching any data
* blocks will be removed if it has been idle for more than L seconds.
*
+ * When storage decommission (shuffle or rdd) is enabled, the max number of
decommissioning(removed)
+ * executors is limited by running executors * M.
Review Comment:
This is wrong. M is `spark.dynamicAllocation.schedulerBacklogTimeout (M)`
currently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
