Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add
cachedExecutorIdleTimeout docs at ExecutorAllocationManager
URL: https://github.com/apache/spark/pull/23386#discussion_r244268180
##########
File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala
##########
@@ -81,7 +82,12 @@ import org.apache.spark.util.{Clock, SystemClock,
ThreadUtils, Utils}
* This is used only after the initial backlog timeout is exceeded
*
* spark.dynamicAllocation.executorIdleTimeout (K) -
- * If an executor has been idle for this duration, remove it
+ * If an executor without caching any data blocks has been idle for this
duration, remove it
+ *
+ * spark.dynamicAllocation.cachedExecutorIdleTimeout (L) -
+ * If an executor which has cached data blocks has been idle for more than
this duration,
+ * the executor will be removed
Review comment:
Aslo, `If an executor which has cached data blocks` -> `If an executor with
caching data blocks` ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
