Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22341#discussion_r216511718
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -538,6 +538,14 @@ private class LiveRDD(val info: RDDInfo) extends
LiveEntity {
distributions.get(exec.executorId)
}
+ def getPartitions(): Map[String, LiveRDDPartition] = {
+ partitions.toMap
--- End diff --
I think this just creates an immutable map and inserts all elements into it
and so no copy of elements.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]