Github user squito commented on the issue:
https://github.com/apache/spark/pull/21212
If you have a heap dump, there are tools that can check for wasted space in
ArrayBuffer. Eg. [jxray](http://www.jxray.com/) or [YourKit Memory
Inspections](https://www.yourkit.com/docs/java/help/inspections_mem.jsp#sparse_arrays)
perhaps. if you can share the heapdump, we could analyze, or perhaps you
could try it yourself if you can't share.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
