squito commented on a change in pull request #26682: [SPARK-29306][CORE] Stage
Level Sched: Executors need to track what ResourceProfile they are created with
URL: https://github.com/apache/spark/pull/26682#discussion_r356842134
##########
File path: core/src/main/scala/org/apache/spark/resource/ResourceProfile.scala
##########
@@ -144,4 +166,63 @@ private[spark] object ResourceProfile extends Logging {
// for testing purposes
def resetDefaultProfile(conf: SparkConf): Unit =
getOrCreateDefaultProfile(conf).reset()
+
+ /**
+ * Create the ResourceProfile internal confs that are used to pass between
Driver and Executors.
+ * It pulls any "resource." resources from the ResourceProfile and returns a
Map of key
+ * to value where the keys get formatted as:
+ *
+ * spark.resourceProfile.executor.[rpId].[resourceName].[amount, vendor,
discoveryScript]
+ *
+ * Keep this here as utility a function rather then in public
ResourceProfile interface because
+ * end users doesn't need this.
Review comment:
typo: a utility function
end users don't
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
