Github user shahidki31 commented on a diff in the pull request:
https://github.com/apache/spark/pull/23038#discussion_r234032510
--- Diff: core/src/main/scala/org/apache/spark/status/api/v1/api.scala ---
@@ -63,6 +63,7 @@ case class ApplicationAttemptInfo private[spark](
class ExecutorStageSummary private[spark](
val taskTime : Long,
+ val activeTasks: Int,
--- End diff --
Thank you @vanzin for the review.
Actually my objective is to get the last task of the particular executorId
of the stage. If corresponding activeTasks == 0, then force update in the
kvstore.
In stages, jobs, exec has "activeTasks" and using the parameter, it force
update on the last task.
https://github.com/apache/spark/blob/9a5fda60e532dc7203d21d5fbe385cd561906ccb/core/src/main/scala/org/apache/spark/status/AppStatusListener.scala#L631
https://github.com/apache/spark/blob/9a5fda60e532dc7203d21d5fbe385cd561906ccb/core/src/main/scala/org/apache/spark/status/AppStatusListener.scala#L563
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
