Github user abellina commented on a diff in the pull request:
https://github.com/apache/spark/pull/21688#discussion_r216838598
--- Diff:
core/src/main/scala/org/apache/spark/status/api/v1/StagesResource.scala ---
@@ -40,8 +43,25 @@ private[v1] class StagesResource extends BaseAppResource
{
@PathParam("stageId") stageId: Int,
@QueryParam("details") @DefaultValue("true") details: Boolean):
Seq[StageData] = {
withUI { ui =>
- val ret = ui.store.stageData(stageId, details = details)
+ var ret = ui.store.stageData(stageId, details = details)
if (ret.nonEmpty) {
+ for (i <- 0 to (ret.length - 1)) {
--- End diff --
I would also think that things like `executorSummary.get.get(execId)` could
be stored somewhere in the stack, e.g. clean up a bit. It's hard to follow what
you are setting.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]