Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21688#discussion_r224856923
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -341,7 +341,9 @@ private class LiveExecutorStageSummary(
metrics.shuffleWriteMetrics.recordsWritten,
metrics.memoryBytesSpilled,
metrics.diskBytesSpilled,
- isBlacklisted)
+ isBlacklisted,
--- End diff --
I don't think the executor stage summary should contain this info.
Is it really that difficult to do the join? The current stage page already
does that:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala#L710
Is the concern that doing something like that from JS would be expensive or
too difficult?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
