Re: I don't understand what this sentence means."7.1 GB of 7 GB physical memory used"

Spark asked YARN to let an executor use 7GB of memory, but it used more so was killed. In each case you see that the exectuor memory plus overhead equals the YARN allocation requested. What's the issue with that? On Fri, Oct 23, 2015 at 6:46 AM, JoneZhang wrote: > Here is the spark configure and

I don't understand what this sentence means."7.1 GB of 7 GB physical memory used"

Here is the spark configure and error log spark.dynamicAllocation.enabled true spark.shuffle.service.enabled true spark.dynamicAllocation.minExecutors10 spark.executor.cores1 spark.executor.memory 6G