Github user mgaido91 commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22894#discussion_r231155000
  
    --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala ---
    @@ -149,7 +150,7 @@ private[spark] class HighlyCompressedMapStatus private (
         private[this] var numNonEmptyBlocks: Int,
         private[this] var emptyBlocks: RoaringBitmap,
         private[this] var avgSize: Long,
    -    private var hugeBlockSizes: Map[Int, Byte])
    +    private[this] var hugeBlockSizes: mutable.Map[Int, Byte])
    --- End diff --
    
    yes, you're right. I just checked the implementation of the `MapBuilder`... 
Seems like there is no efficient way to build an immutable map... I am fine 
with the approach you're proposing using `scala.collection.Map`, but still 
seems a bit hacky to me.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to