Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21070
Upstream benchmarks for buffer management changes are here:
https://github.com/apache/parquet-mr/pull/390#issuecomment-338505426
That doesn't show the GC benefit for smaller buffer allocations because of
the heap size. It is just to show that the changes do no harm.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
