Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19135
So it somehow reflects that CPU core contention is the main issue for
memory pre-occupation , am I right?
AFAIK from our customer, we usually don't allocate so many cores to one
executor, also avoid big executor (many cores + large heap memory) to reduce GC
and other memory/cpu contentions.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
