Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/21212
@squito
I ananlyzed "YourKit Memory Inspections" to analyze the heap, but didn't
find many duplicate objects in ArrayBuffer. I guess your concern is ArrayBuffer
will do lots of copy as size of elements grows, and we don't need fast random
access in `ShuffleBlockFetcherIterator`. I changed it to be ListBuffer.
I also added a test in MapOutputTrackerSuite. Please take a look
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
