Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/19394
Ideally, this would also use a TaskMemoryManager so the driver can spill
results to disk instead of dying with an OOM. Is there any plan to add a memory
manager for the driver?--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
