tgravescs commented on a change in pull request #24841: [SPARK-27369][CORE]
Setup resources when Standalone Worker starts up
URL: https://github.com/apache/spark/pull/24841#discussion_r296715635
##########
File path: core/src/main/scala/org/apache/spark/internal/config/Worker.scala
##########
@@ -20,6 +20,17 @@ package org.apache.spark.internal.config
import java.util.concurrent.TimeUnit
private[spark] object Worker {
+ val SPARK_WORKER_PREFIX = "spark.worker"
+
+ val SPARK_WORKER_RESOURCE_FILE =
+ ConfigBuilder("spark.worker.resourcesFile")
+ .internal()
+ .doc("Path to a file containing the resources allocated to the worker. " +
+ "The file should be formatted as a JSON array of ResourceInformation
objects. " +
Review comment:
I don't think this is true anymore, I think the json has to be formatted
like a ResourceAllocation
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
