Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/11613#discussion_r55900453
--- Diff:
core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala ---
@@ -49,14 +49,6 @@ private[spark] class MemoryStore(
// A mapping from taskAttemptId to amount of memory used for unrolling a
block (in bytes)
// All accesses of this map are assumed to have manually synchronized on
`memoryManager`
private val unrollMemoryMap = mutable.HashMap[Long, Long]()
- // Same as `unrollMemoryMap`, but for pending unroll memory as defined
below.
- // Pending unroll memory refers to the intermediate memory occupied by a
task
- // after the unroll but before the actual putting of the block in the
cache.
- // This chunk of memory is expected to be released *as soon as* we finish
- // caching the corresponding block as opposed to until after the task
finishes.
- // This is only used if a block is successfully unrolled in its entirety
in
- // memory (SPARK-4777).
- private val pendingUnrollMemoryMap = mutable.HashMap[Long, Long]()
--- End diff --
yasss!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
