tgravescs commented on a change in pull request #27207: [SPARK-18886][CORE]
Make Locality wait time measure resource under utilization due to delay
scheduling.
URL: https://github.com/apache/spark/pull/27207#discussion_r402310761
##########
File path: core/src/main/scala/org/apache/spark/internal/config/package.scala
##########
@@ -543,6 +543,11 @@ package object config {
.version("1.2.0")
.fallbackConf(DYN_ALLOCATION_SCHEDULER_BACKLOG_TIMEOUT)
+ private[spark] val LEGACY_LOCALITY_WAIT_RESET =
+ ConfigBuilder("spark.locality.wait.legacyResetOnTaskLaunch")
Review comment:
yes please add the .doc and .version - it would be nice to get into 3.0.0.
I don't know that I agree with the internal tag. Maybe its being used
differently then I thought. Internal to me means it's not meant for end user,
this one could be if users find issues with the new algorithm. I'm definitely
fine with not documenting it and it seems it has that side affect so maybe not
a big deal.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
