On Thu, Jan 21, 2016 at 5:42 AM, Olivier Devoisin
wrote:
> The documentation states that it contains VM overheads, interned strings and
> other native overheads. However it's really vague.
It's intentionally vague, because it's "everything that is not Java
objects". That includes JVM internal me
Hello,
In some of our spark applications, when writing outputs to hdfs we
encountered an error about the spark yarn executor memory overhead :
WARN yarn.YarnAllocator: Container killed by YARN for exceeding memory
limits. 3.0 GB of 3 GB physical memory used. Consider boosting
spark.yarn.executor.
