Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/2851#discussion_r24642522
--- Diff: core/src/main/scala/org/apache/spark/storage/StorageUtils.scala
---
@@ -81,19 +84,38 @@ class StorageStatus(val blockManagerId: BlockManagerId,
val maxMem: Long) {
*/
def rddBlocks: Map[BlockId, BlockStatus] = _rddBlocks.flatMap { case (_,
blocks) => blocks }
+
+ /**
+ * Return the broadcast blocks stored in this block manager.
+ *
+ * Note that this is somewhat expensive, as it involves cloning the
underlying maps and then
+ * concatenating them together. Much faster alternatives exist for
common operations such as
+ * getting the memory, disk, and off-heap memory sizes occupied by this
RDD.
--- End diff --
should be "broadcast variable" instead of "RDD"
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
