Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21809#discussion_r204105954
--- Diff: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala
---
@@ -94,6 +94,13 @@ private[spark] class AppStatusStore(
}.toSeq
}
+ def getJobIdsAssociatedWithStage(stageId: Int): Seq[Set[Int]] = {
+
store.view(classOf[StageDataWrapper]).index("stageId").first(stageId).last(stageId)
--- End diff --
can we avoid the store look up here?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]