wbo4958 commented on code in PR #43494:
URL: https://github.com/apache/spark/pull/43494#discussion_r1378466375
##########
core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala:
##########
@@ -58,6 +58,9 @@ private[spark] class TaskDescription(
val properties: Properties,
val cpus: Int,
val resources: immutable.Map[String, ResourceInformation],
+ // resourcesAmounts is the total resources assigned to the task
+ // Eg, Map("gpu" -> Map("0" -> 0.7)): assign 0.7 of the gpu address "0" to
this task
+ val resourcesAmounts: immutable.Map[String, immutable.Map[String, Double]],
Review Comment:
My original thinking is we can remove `val resources: immutable.Map[String,
ResourceInformation]` and re-construct it in the TaskContext according to
resourcesAmounts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
