Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15178
The current solution could OOM executors whose memory sizes are normally
much smaller than the driver. We might also see the performance regression when
the number of partitions is large and the partition size is small.
How about closing this PR now and we can revisit it when we need this
feature?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
